Gemma4: graph optimizations yield massive gains on pp for E2B and E4B in llama.cpp Keras? Not. Wait.
Read the original at www.reddit.com→big prompt processing speedup for gemma E2B/E4B submitted by /u/jacek2023 [link] [comments]
Original headline: "gemma4: graph optimizations (massive gains on pp for E2B and E4B) by max-krasnyansky · Pull Request #31356 · ggml-org/llama.cpp"
Coverage timeline
- Nov 3, 22:02 UTC r/LocalLLaMA lead source gemma4: graph optimizations (massive gains on pp for E2B and E4B) by max-krasnyansky · Pull Request #31356 · ggml-org/llama.cpp