Two Android phones cluster to run a 27B LLM locally, bypassing RAM limits with C++ RPC split and Hadamard Ternary math
Read the original at www.reddit.com→I saw a lot of posts here struggling to run 27B models on 8GB VRAM or complaining about phones turning into space heaters. I hit the exact same OOM wall on my phone, so I decided to build a hardware-split workaround....
Original headline: "I clustered two old Android phones to run a 27B LLM locally. Bypassed RAM limits via C++ RPC split and Hadamard Ternary math (No overheating)"
Coverage timeline
- Oct 13, 04:00 UTC r/LocalLLaMA lead source I clustered two old Android phones to run a 27B LLM locally. Bypassed RAM limits via C++ RPC split and Hadamard Ternary math (No overheating)