Try out a “high” reasoning mode for 27B (tested on VLLM)
Read the original at old.reddit.com→After a lot of tweaking, I have come to the conclusion that 27B lacks a reasoning mode that is between low and xhigh. The "medium" mode isn't actually medium, it erases the explicit instructions to the model. When...
Original headline: "Try out this "high" reasoning mode for 27B (tested on VLLM)"
Coverage timeline
- Aug 15, 08:19 UTC r/LocalLLaMA lead source Try out this "high" reasoning mode for 27B (tested on VLLM)