Proposal for a community-led private quality benchmarks revolution to avoid chasing tokens per second and share private benchmark results
Read the original at www.reddit.com→Proposal: A community revolution for private quality benchmarks (and why endless chasing tok/s is rotting our brains honestly we in r/LocalLLaMA need a revolution of people making their own private benchmarks(not...
Original headline: "Proposal: A community revolution for private quality benchmarks (and why endless chasing tok/s is rotting our brains"
Coverage timeline
- Nov 2, 11:33 UTC r/LocalLLaMA lead source Proposal: A community revolution for private quality benchmarks (and why endless chasing tok/s is rotting our brains