MiniPC to run a LLM w/ voice assistant on Ubuntu 24.04; llama.cpp and Python setup for offline, local voice-first assistant on a fanless mini PC
Read the original at www.reddit.com→I'm having a go at building a fully offline, voice-first assistant running locally on a fanless mini PC (4 core Celeron J6412 w/ 16GB DDR4, 512GB SATA SSD, crappy Intel UHD iGPU only) Going to try Ubuntu 24.04,...
Original headline: "MiniPC to run a LLM w/ voice assistant - Best small LLM?"
Coverage timeline
- Oct 3, 05:04 UTC r/LocalLLaMA lead source MiniPC to run a LLM w/ voice assistant - Best small LLM?