Benchmarking offline LLMs locally: strategies, prompts, and tools to compare speed, efficiency, reasoning, tool use, and coding across multiple models
Read the original at www.reddit.com→If I wanted to locally compare performance for multiple different offline LLM models across various modalities (speed, efficiency, reasoning, tool use, programing/coding, etc), what strategies, prompts, software are...
Original headline: "How do you locally benchmark and compare local LLMs?"
Coverage timeline
- Nov 8, 22:49 UTC r/LocalLLaMA lead source How do you locally benchmark and compare local LLMs?