Strata: how to configure sampling parameters
Read the original at www.reddit.com→The top-level README doesn't mention this, but you can add a "sampling" key to your strata-iq3_s.json like this: { "sampling": {"temperature": 1.0, "top_p": 0.95, "top_k": 20}, "exe": "/path/to/Strata/engine/strata",...
Coverage timeline
- Oct 1, 05:19 UTC r/LocalLLaMA lead source Strata: how to configure sampling parameters