SupraBrain-50M-v0.1 released; hybrid model uses Gated DeltaNet recurrence and Sliding-Window Attention to deliver strong performance

Hey there! So today we're releasing SupraBrain-50M, a hybrid language model that combines Gated DeltaNet linear recurrence with Sliding-Window Attention and Surprise-Gated update mechanisms to deliver very strong...