Local LLMs benefit from deterministic context and added code; jOpenAgent for Java suggested to improve reliability
Read the original at old.reddit.com→Hi, After some tries, it seems that for local models (27B+) the best way to have reliable outputs is to add a little more code and have a determinist context for loop iteration. If you can code in Java (or use a LLM...
Original headline: "The best harness for local LLM is the one you code"
Coverage timeline
- Aug 9, 10:00 UTC r/LocalLLaMA lead source The best harness for local LLM is the one you code