Open source jevlikes benchmark requested to match jev’s official calibration benchmarks and rankings
Read the original at www.reddit.com→Okay so there are strongish open jevlikes. But jev's official benchmarks seem to indicate they think open models have bad calibration, and their ranking of which they think performs best doesn't match the open...
Original headline: "I'd like a jevlikes benchmark that tests for what jev's official benchmarks do (eg, calibration). Anyone got one or want to make it?"
Coverage timeline
- Oct 17, 09:46 UTC r/LocalLLaMA lead source I'd like a jevlikes benchmark that tests for what jev's official benchmarks do (eg, calibration). Anyone got one or want to make it?