Local-first CLI over your own notes ensures the model never sees a document id, preventing invented citations; transcript describes local 30B model and citation mechanism.
Read the original at old.reddit.com→Mine, MIT, free, nothing to sign up for. Any OpenAI-compatible endpoint including loopback; transcript below is a local 30B. The bit I couldn't get elsewhere: **the model is never in a position to invent a...
Original headline: "A local-first CLI over your own notes: the model never sees a document id, so it can't fabricate a citation (MIT)"
Coverage timeline
- Aug 9, 18:46 UTC r/LocalLLaMA lead source A local-first CLI over your own notes: the model never sees a document id, so it can't fabricate a citation (MIT)