Aleph Alpha releases Kolibri-1 with 78B parameters, 3.46B active, and up to 1M tokens of context under Apache 2.0
Read the original at www.reddit.com→From Aleph Alpha on 𝕏: https://x.com/Aleph__Alpha/status/2106306840657297814 Tech report: https://aleph-alpha.com/downloads/tech-report.pdf submitted by /u/Nunki08 [link] [comments]
Original headline: "Aleph-Alpha/Kolibri-1 · Hugging Face - 78B parameters. 3.46B active. Up to 1M tokens of context - Apache 2.0"
Coverage timeline
- Oct 3, 11:44 UTC r/LocalLLaMA lead source Aleph-Alpha/Kolibri-1 · Hugging Face - 78B parameters. 3.46B active. Up to 1M tokens of context - Apache 2.0