Mellum2.1 Thinking with the MTP head enables faster inference by using speculative drafting with a multi-token prediction head

Mellum2.1 Thinking with the MTP head Multi-token prediction head The multi-token prediction (MTP) head is one extra transformer block, trained together with the model, that predicts the token after the one just...