DecisionTune 1.0: a 395M encoder for offline option selection with ~10 ms per decision on MLX
Read the original at www.reddit.com→Disclosure: I made this. Sharing it here because it is fully local and small, and I want feedback from people who run models on their own machines. What it is: a 395M decision model (ModernBERT-large plus a 4 KB...
Original headline: "DecisionTune 1.0: a 395M encoder that picks from your options offline, about 10 ms per short decision on MLX (Apache-2.0)"
Coverage timeline
- Oct 5, 08:34 UTC r/LocalLLaMA lead source DecisionTune 1.0: a 395M encoder that picks from your options offline, about 10 ms per short decision on MLX (Apache-2.0)