NVIDIA Unveils 2.8T-Token Indic Pretraining Corpus and Open Pipeline

NVIDIA, working with IIT Madras and its AI4Bharat lab, on October 16, 2026 introduced Nemotron-pretraining-Indic-v1, a synthetic pretraining corpus of approximately 2.8 trillion tokens across 22 Indian languages that is releasing soon, together with the open, GPU-accelerated data generation pipeline used to create it. The 22 languages are those listed in India’s Constitution, which the announcement describes as the first languages for 97% of Indians, nearly 1.2 billion citizens at the 2011 Census.

Authors on the post span AI4Bharat researchers Mohammed Safi Ur Rahman Khan, Mitesh Khapra, and Anoop Kunchukuttan and NVIDIA’s Niket Agarwal, Raviraj Joshi, Anusha Kamath, Markus Kliegl, Yev Meyer, Sriharsha Niverty, Kiran Praveen, and Utkarsh Vaidya. Khapra, who heads AI4Bharat, has named the core problem behind Indian language technology trailing English: “we do not have enough data for Indian languages.” The pipeline captures the full generation recipe, including prompts, LLM workflows, and quality checks, so developers can adapt it to their own source material.

NVIDIA said every record traces back to a curated source document and each output is checked against its input. The corpus contains 2,601.0…