Models chase unrealistic benchmarks while working-level intelligence is already achieved
Read the original at www.reddit.com→I have a feeling that recent benchmarks are unrealistically pushing the bar into areas a normal developer rarely encounters, like binary reverse engineering or one-shotting a complex application, with some strictly...
Original headline: "Models are chasing unrealistic benchmarks but the working-level intelligence is already achieved"
Coverage timeline
- Oct 28, 19:44 UTC r/LocalLLaMA lead source Models are chasing unrealistic benchmarks but the working-level intelligence is already achieved