Echo Dot 2 runs 28M LLMs locally with llama.cpp and offline speech recognition
Read the original at old.reddit.com→Code and instructions available here: https://github.com/albertoZurini/echo-dot-2-playground Hello there! After a few days of experimenting I was able to get a completely local voice pipeline running on an Amazon...
Original headline: "Echo Dot 2 can run 28M LLM at decent speed"
Coverage timeline
- Aug 7, 02:36 UTC r/LocalLLaMA lead source Echo Dot 2 can run 28M LLM at decent speed