Tencent unveils Hy4 Preview: a 770B-parameter LLM with 49B active parameters and 1M token context, available on Hugging Face with 1.56TB model weight; marks a substantial increase from Hy3.
Read the original at simonwillison.net→Introducing Hy4 Preview New open weight text input (no vision) LLM from Chinese company Tencent today: 770B total parameters, 49B active parameters, 1M token context window, 1.56TB on Hugging Face. This is a big...
Original headline: "Introducing Hy4 Preview"
Coverage timeline
- Aug 29, 23:53 UTC Simon Willison lead source Introducing Hy4 Preview