llm-psicotest runs a 38-turn conversation to assess whether a quant swap changes behaviour; prompts are seed-identical across endpoints and code scores each turn against a computed key
Read the original at www.reddit.com→llm-psicotest runs one 38-turn conversation against any OpenAI-compatible endpoint: 29 capability items plus protocol turns. The items come from seeded generators, so a seed gives byte-identical prompts on any...
Original headline: "llm-psicotest: a seeded 38-turn conversation to check whether a quant swap changed behaviour"
Coverage timeline
- Nov 9, 19:45 UTC r/LocalLLaMA lead source llm-psicotest: a seeded 38-turn conversation to check whether a quant swap changed behaviour