TinyStories-style model MacroStories with 19,969 parameters can write stories, despite being the smallest such model to date.
Read the original at www.reddit.com→I’ve been pushing TinyStories-style models downward in size, and this is the smallest one so far: MacroStories — 19,969 parameters, 81 KB FP32 https://huggingface.co/raincandy-u/MacroStories For scale: → ~50× smaller...
Original headline: "Trained a ~20K LM (probably smallest) that can still write stories"
Coverage timeline
- Oct 7, 06:10 UTC r/LocalLLaMA lead source Trained a ~20K LM (probably smallest) that can still write stories