Gemma 4-31B fails SWEBench verified with LimitExceeded errors; Qwen3.8 27B IQ4_NL achieves 333/388 resolved on SWEBench, per tests and update to Gemma 4 chat template
Read the original at www.reddit.com→I wanted to compare gemma 4 31b qat q4 and qwen3.8 27b iq4_nl, so I run SWEBench verfied on them. The original gemma 4 chat template doesn't work with preserve reasoning, so google released an update such that it can...
Original headline: "How to make gemma 4 works with SWEBench?"
Coverage timeline
- Oct 10, 22:38 UTC r/LocalLLaMA lead source How to make gemma 4 works with SWEBench?