Strix halo-centric gearing for 3.8 drop; discussion on MTP performance and available software stacks for quick results
Read the original at old.reddit.com→https://sleepingrobots.com/dreams/mtp-qwen36-strix-halo/ This is slightly out of date but the eli5 is that MTP is awesome on these qwen models. Since 3.8 is said to be the same architecture as 3.6 I suppose the same...
Original headline: "Getting ready for the big 3.8 drop (strix halo centric but applies widely)"
Coverage timeline
- Aug 14, 10:16 UTC r/LocalLLaMA lead source Getting ready for the big 3.8 drop (strix halo centric but applies widely)