Bonsai and Ternary Bonsai updates: 1-bit, 1.58-bit (Ternary), and 27B models; CUDA and Vulkan backends merged on mainline with optimization PRs improving throughput by 15–40% and perf by 8%
Read the original at old.reddit.com→Bonsai / Ternary Bonsai During April Bonsai came with bunch of models .... 1-bit & 1.58-bit(Ternary) versions. And last month(July) they released 27B models in same versions. Last month itself, Bonsai-27B was able to...
Original headline: "1-bit / 2-bit / Ternary / Bitnet Models - Updates & Tracking"
Coverage timeline
- Aug 18, 18:51 UTC r/LocalLLaMA lead source 1-bit / 2-bit / Ternary / Bitnet Models - Updates & Tracking