Person builds local GPU benchmark server for 4B to 35B LLMs to compare practical performance on affordable hardware
Read the original at www.reddit.com→Hi everyone, whenever I looked at existing LLM leaderboards I was missing practical numbers for running quantized open weight models on affordable local hardware. Most tables only copy vendor cloud scores or run tiny...
Original headline: "I built a local GPU benchmark server for 4B to 35B models because I was tired of synthetic cloud leaderboards and tiny sample tests"
Coverage timeline
- Oct 27, 22:35 UTC r/LocalLLaMA lead source I built a local GPU benchmark server for 4B to 35B models because I was tired of synthetic cloud leaderboards and tiny sample tests