Qwen3.5 arch implemented in FPGA fabric for 9B/27B INT4 models on inexpensive eBay mining hardware
Read the original at www.reddit.com→I've been wanting to test out LLM inference on FPGAs for a while now, but didn't have a big reason too since there were no frontier class models at 9B-27B scale (3.6 27B was great still but it didn't motivate me...
Original headline: "Qwen3.5 arch implementation in FPGA fabric for 9B/27B INT4 models on relatively cheap eBay mining hardware"
Coverage timeline
- Oct 4, 16:51 UTC r/LocalLLaMA lead source Qwen3.5 arch implementation in FPGA fabric for 9B/27B INT4 models on relatively cheap eBay mining hardware