BetterBench provides more accurate PP and TPS measurements with 1% content consistency across types
Read the original at old.reddit.com→I built this because the existing benchmarks were using random data and with MTP content types can vary a lot on what performance you see. 5% or more with content types. BetterBench is designed to have content...
Original headline: "Introducing BetterBench - more accurate PP and TPS measurement"
Coverage timeline
- Aug 6, 02:23 UTC r/LocalLLaMA lead source Introducing BetterBench - more accurate PP and TPS measurement