Gemma 5 should be a looped transformer with configurable loop depth to improve reasoning ability, says a Gemma 4 enhancement suggestion
Read the original at www.reddit.com→Recently Omar Sanseviero asked for suggestions on Twitter for future Gemma models. Here is my take on this: Gemma 5 should be a looped transformer. Being a looped transformer with configurable loop depth will...
Original headline: "List of suggestions for Gemma 5."
Coverage timeline
- Oct 28, 16:48 UTC r/LocalLLaMA lead source List of suggestions for Gemma 5.