LLMs hallucinate world knowledge; a 4B with local Wikipedia and kiwix reduces hallucinations, suggests building a personal agent with internet knowledge fallback
Read the original at old.reddit.com→Any LLM will hallucinate the world knowledge, even a 3T model. Use a 4B with a kiwix skill and local Wikipedia, 50gb and no more hallucinated world knowledge. Ask your coding agent to build your own, with your rules...
Original headline: "Waiting for a 122B because of world knowledge?"
Coverage timeline
- Aug 19, 11:59 UTC r/LocalLLaMA lead source Waiting for a 122B because of world knowledge?