Ling-3.0 support added to llama.cpp in a 40-line PR for Tiny model; PR 26608 still not merged to mainline
Read the original at old.reddit.com→aetherbird has done some great work getting Ling-3.0 to work in llama.cpp. The architecture is generally identical to deepseekv2. I recently added a microscopic 40 line PR to his that adds support for the Tiny...
Original headline: "[llama.cpp PR #26608] Ling-3.0 support (unmerged)"
Coverage timeline
- Aug 11, 19:14 UTC r/LocalLLaMA lead source [llama.cpp PR #26608] Ling-3.0 support (unmerged)