Qwen3-0.6B model converted into MoE
Read the original at www.reddit.com→This is another update about my MoE-fication project, the first post can be found here. Foreword Since my last model conversion, I’ve been experimenting a lot with new methods, though sadly, most attempts haven't...
Coverage timeline
- Oct 23, 08:18 UTC r/LocalLLaMA lead source Qwen3-0.6B model converted into MoE