Scaling Indic pretraining: 2.8 trillion tokens and an open data generation pipeline
Read the original at huggingface.co→Original headline: "Scaling Indic Pretraining: 2.8 Trillion Tokens and an Open Data Generation Pipeline"
Coverage timeline
- Oct 16, 01:44 UTC Hugging Face lead source Scaling Indic Pretraining: 2.8 Trillion Tokens and an Open Data Generation Pipeline