Kashmiri text corpora
Collections of Kashmiri text, monolingual and parallel, that models can be trained or tested on. Check each licence before use: they range from open to non-commercial to permission-only.
- 49
- Resources2003–2026
- 37
- Datasets
- 2
- Models
- 8
- Papers
Filter this task in the full hub · Guide: Kashmiri language data
Datasets 37
BharatSetu-22Indic-1M
The bharatSetu table on Hugging Face: 984,764 English sentences with machine translations in 22 Indian languages including Kashmiri. Machine-generated, not human-verified; access requires accepting the repository's conditions.
Bolbosh Kashmiri TTS Dataset — Gaash Lab
About 40,000 Kashmiri utterances with transcripts (33,182 train, 4,542 validation, 2,272 test) curated from IndicVoices-R and RASA for text-to-speech; the training data behind Bolbosh. Mostly spontaneous speech; the RASA part keeps its original licence.
COILD-MT Corpus — Hindi↔Kashmiri
Indic-centric parallel corpus and benchmark from the COILD project, with a Hindi–Kashmiri section and test files. Non-commercial research use; access needs the COILD request form plus the Hugging Face request.
Kashmiri News Articles Text Dataset (HNM)
Kashmiri news article text released by HNM for language-model training. Access requires the author's approval.
UD Kashmiri-Zaan Treebank
A Kashmiri treebank being added to Universal Dependencies, with manual lemmas, part-of-speech tags, features and dependency relations, announced for UD v2.19 (November 2026). CC BY-SA 4.0.
COILD × AIKosh Domain Corpora (Hindi→Kashmiri)
Hindi→Indian-language parallel sets in eight domains (agriculture, education, governance, health, judiciary, tourism, climate, science and technology), each with a Hindi–Kashmiri folder; the v2 releases are source-reviewed by native speakers.
CorIL Parallel Corpus (Hindi↔Kashmiri)
Bidirectional parallel data for 11 Indian language pairs pivoting on Hindi, including Hindi–Kashmiri, across governance, health and general domains. Data release of the CorIL paper.
DCAD-2000
Multilingual pretraining corpus covering 2,000+ languages, cleaned by treating noise as anomaly detection (NeurIPS 2025 Datasets & Benchmarks). Includes Kashmiri (kas_Arab) files; licence inherits from its sources.
HPLT 3.0 — Kashmiri subsets
Third release of HPLT's web-crawled monolingual collection (Internet Archive and Common Crawl) in 198 languages, with more data, annotations and metadata than v2. Files are served from HPLT's own servers.
Kashmiri Audio Corpus (Segmented)
1,955 segmented speech samples (16kHz, 16-bit, mono WAV) derived from OpenSLR-122. Ready-to-use format for ASR training pipelines.
Kashmiri Text Corpus Cleaned (2025)
Cleaned and processed Kashmiri text dataset designed for linguistic research and model training. Preprocessed and deduplicated for quality.
KS-LIT-3M — 3.1 Million Word Pretraining Dataset
Meticulously cleaned 3.1-million-word (16.4M characters) Kashmiri text corpus specifically designed for pretraining LLMs from scratch. The largest open Kashmiri text resource.
40K Kashmiri Text-Image Dataset (OCR)
About 40,000 Kashmiri text images paired with their transcriptions, for training and testing OCR models. Released by HNM; the related 600K-KS-OCR corpus is described in its own paper.
FineWeb-2 — Kashmiri subsets
Hugging Face's multilingual web pretraining corpus, with Kashmiri subsets in Perso-Arabic, Devanagari and Latin script. Language identification uses GlotLID.
GlotCC-V1
Document-level CommonCrawl corpus for 1,000+ languages built with the GlotLID language identifier and the Ungoliant pipeline. Has a small Kashmiri (kas-Arab) subset.
HPLT 2.0 — Kashmiri subsets
The HPLT project's cleaned web corpus, with Kashmiri subsets in Perso-Arabic (949 documents) and Devanagari (106 documents) script.
IITB-IndicMonoDoc
Document-level monolingual corpora spanning 22 Indian languages including Kashmiri. Useful for pretraining and for document-level rather than sentence-level modelling.
Kashmiri Language Corpus (nawabhussain)
About 57,000 rows (roughly 60,000 sentences) of Kashmiri text collected from the mzmmoazam/kashmiri_dataset sources, packaged on Hugging Face.
Kashmiri Multilingual Dictionary
Multilingual dictionary dataset with entries in English, Kashmiri, Urdu, Chinese, and Turkish — including example sentences for cross-lingual research.
Kashmiri Poet Dataset — Shruks
1,552 Kashmiri shruks (8,283 lines, about 36K words), offered for classification, generation and translation experiments. Access is granted on request.
Kashmiri Text Corpus (HNM)
A 15 MB plain-text Kashmiri corpus of about 1.69 million words (57K unique), released with a character and word statistics report. Access is granted on request.
Kashmiri-English Dataset 270K
Largest open Kashmiri-English parallel corpus with ~270,000 sentence pairs built from digitized literary texts, manually authored dialogues, and filtered legacy data. Foundation of the first NMT benchmark for Kashmiri.
Kashmiri-English Parallel Corpus (30K)
30,000+ Kashmiri→English sentence pairs organized into raw, cleaned, and processed directories. A widely-used open parallel corpus for Kashmiri MT research.
Kashmiri-English Parallel Corpus 49K (HNM)
About 49,000 Kashmiri-English sentence pairs released by HNM (Haq Nawaz Malik). Access requires the author's approval; no accompanying paper found yet.
MaLA Bilingual Translation Corpus (Kashmiri pairs)
Massively multilingual bitext with Kashmiri paired with many languages, including English, in Perso-Arabic and Devanagari script. Mostly mined from the web, so quality is uneven; filter before use.
OLDI-Seed (NLLB-Seed)
6,193 English Wikipedia sentences professionally translated into 44 languages including Kashmiri, meant to kick-start MT for directions without large datasets. Maintained update of NLLB-Seed.
Sangraha — Kashmiri subset
AI4Bharat's large pretraining corpus for Indian languages; the 'verified' Kashmiri subset is about 0.8 MB.
BPCC — Bharat Parallel Corpus Collection (Kashmiri)
AI4Bharat's parallel corpus for 22 Indian languages and the training data of IndicTrans2. The Kashmiri (Perso-Arabic) part has several subsets: seed-latest (98,929 pairs), seed-v2 (88,381), wiki/seed-v1 (15,512), daily (4,311), nllb_seed (6,193) and nllb_filtered (124,917).
CIIL / LDC-IL Kashmiri Text & Speech Corpora
Government-funded raw text and speech corpora released for Kashmiri alongside Assamese, Dogri, Gujarati, Odia and Tamil, built under India's national language-resource programme.
EMILLE / CIIL Corpus — Kashmiri Monolingual
One of the earliest digital Kashmiri monolingual corpora, built by the EMILLE project as part of a wider effort covering South Asian languages. Historically important as a starting point for Kashmiri corpus linguistics.
Bhasini / ULCA Portal
Official Government of India platform for Indian language datasets and models under the National Language Translation Mission. Central repository for Kashmiri digital resources.
Kashmir AI Research Parallel Corpus
A 124,102-pair Kashmiri–English training corpus aggregated from AI4Bharat BPCC and the SMUQamar corpus, deduplicated and filtered on length and script. The sentence pairs are the work of their original authors; the aggregation, filtering and split are ours. Not redistributed.
Kashmiri Data Corpus (OpenSLR-122)
Transcribed audio recordings from native Kashmiri speakers for Automatic Speech Recognition (ASR) development. The foundational Kashmiri speech dataset. GPL-3.0 licensed.
Kashmiri Spoken Words Dataset
Processed audio data of 12 frequently spoken Kashmiri words. Designed for spoken word recognition and voice command research.
Kashmiri Text Dataset Collection
Data and tools to collect Kashmiri text from various online sources and dictionaries. Includes word pronunciations, PDFs, HTML files, and CSV data.
Kashmiri Wikipedia
The Kashmiri-language Wikipedia (ks.wikipedia.org): encyclopaedic Kashmiri text in Perso-Arabic script, about 43,500 sentences in our 2026 extract.
kscp — Kashmiri Speech Corpus Processing
Tools for processing audio and text data from OpenSLR Kashmiri Data Corpus. Includes preprocessing pipelines, data loaders, and segmentation utilities.
Models 2
BLOOM-560M
Open multilingual LLM pretrained on ROOTS corpus (incl. Persian/Urdu). Used for zero-shot Kashmiri text classification. Effective for cross-lingual transfer to Kashmiri.
kashurai — Kashmiri Dataset Collection
Curated community collection grouping Kashmiri-specific LLMs, text datasets, and ASR models in one browsable hub. Great starting point for discovery.
Papers 8
600K-KS-OCR: A Synthetic Corpus for Kashmiri Script Recognition
Introduces a 602K-word synthetic OCR dataset for Kashmiri in three typefaces (Naskh, Nastaleeq, Nakash). Evaluates CRNN and TrOCR architectures for Perso-Arabic script.
bharatSetu: A 1M × 22 Bridge for Indic Translation
984,764 English sentences machine-translated into all 22 scheduled Indian languages, Kashmiri included, as one row-aligned table so any two columns form a translation pair. The authors state the data is machine-generated and not human-verified, and report no quality scores yet.
COILD: An Indic-Centric Parallel Corpus and Benchmark for Machine Translation Across Indian Languages
Paper describing COILD: over 1.16 million human-translated and human-verified sentence pairs across 20 Indian language pairs and eight domains, translated directly between Indian languages, including Hindi–Kashmiri.
KS-LIT-3M: A Curated Kashmiri Text Dataset for LLM Pretraining
Introduces a 3.1-million-word curated Kashmiri text dataset designed for pretraining LLMs. Addresses the scarcity of high-quality Kashmiri training data with CC-BY-4.0 licensing.
Deep Neural Architectures for Kashmiri-English Machine Translation
Introduces the first comprehensive NMT benchmark for Kashmiri with a 270K parallel corpus. Compares Encoder-Decoder, Attention-Enhanced, and Transformer architectures. Achieves BLEU-4 of 0.2965.
Building Kashmiri Sense Annotated Corpus and its Usage in Supervised Word Sense Disambiguation
A sense-annotated Kashmiri corpus for lexical-sample word sense disambiguation, with Kashmiri WordNet senses, used to train and compare supervised classifiers.
Tarjama: The Kashmiri Translator
Proposes a translator system based on ML algorithms and parallel corpora to bridge communication gaps for Kashmiri speakers in digital spaces.
Towards Building a Kashmiri Treebank: Setting up the Annotation Pipeline
First Kashmiri dependency treebank: 1,000 sentences (17,462 tokens) annotated with part-of-speech, chunk and dependency information, plus the first freely available dependency parsing pipeline for Kashmiri.
Research groups 2
LDC-IL — Linguistic Data Consortium for Indian Languages
India's national repository for language-technology resources, established in 2003 and fully government-funded. Distributes Kashmiri text and speech corpora.
TDIL Data Centre
India's national programme for building linguistic resources and language technology across scheduled languages, running since 1991. The distribution point for many government-funded Kashmiri resources.