OpenBonsai open-sources compression of BF16 models and fine-tunes into ~2 GB ternary GGUFs
Read the original at www.reddit.com→I've been experimenting with tiny models for WebBrain, my open-source browser agent. The long-term goal is to run as much intelligence as possible locally, ideally through WebGPU. One approach I've been particularly...
Original headline: "I open-sourced OpenBonsai: compress your own BF16 models and fine-tunes into ~2 GB ternary GGUFs"
Coverage timeline
- Oct 29, 08:13 UTC r/LocalLLaMA lead source I open-sourced OpenBonsai: compress your own BF16 models and fine-tunes into ~2 GB ternary GGUFs