noctrex Ling-3.0-tiny-MXFP4_MOE-GGUF model touted as possibly fastest in its size range; user asks for throughput and speed stats
Read the original at old.reddit.com→u/noctrex 👍 where's flash? 😄 Possibly fastest model(in this model size range). Share t/s stats. submitted by /u/pmttyji [link] [comments]
Original headline: "noctrex/Ling-3.0-tiny-MXFP4_MOE-GGUF · Hugging Face"
Coverage timeline
- Aug 17, 14:36 UTC r/LocalLLaMA lead source noctrex/Ling-3.0-tiny-MXFP4_MOE-GGUF · Hugging Face