Researcher
Haq Nawaz Malik
HNM Research; lists IIT Delhi on Hugging Face
The most prolific builder of open Kashmiri data. His releases cover pretraining text (KS-LIT-3M, KS-PRET-5M), synthetic OCR (Koshur Pixel and the SynthOCR-Gen generator), diacritic restoration, tokenizers, a byte-level language model, speech and dictionary data, and bharatSetu, a 22-language translation table that includes Kashmiri.
- 7
- Papers
- 17
- Datasets
- 5
- Models
- 2
- Tools
Focus
Papers 7
600K-KS-OCR: A Synthetic Corpus for Kashmiri Script Recognition
Introduces a 602K-word synthetic OCR dataset for Kashmiri in three typefaces (Naskh, Nastaleeq, Nakash). Evaluates CRNN and TrOCR architectures for Perso-Arabic script.
bharatSetu: A 1M × 22 Bridge for Indic Translation
984,764 English sentences machine-translated into all 22 scheduled Indian languages, Kashmiri included, as one row-aligned table so any two columns form a translation pair. The authors state the data is machine-generated and not human-verified, and report no quality scores yet.
Koshur Diacritizer: A Byte-Level Seq2Seq Model for Kashmiri Diacritic Restoration
Byte-level sequence-to-sequence model for restoring diacritics in Kashmiri text. Diacritic restoration is critical for Kashmiri because the language's ~16 vowel distinctions are carried by diacritics that are frequently omitted in written text.
Koshur Pixel: A Large-Scale Synthetic OCR Dataset for Kashmiri
First large-scale synthetic OCR dataset for Kashmiri: 613,078 image-text pairs generated from the KS-PRET-5M corpus using the SynthOCR-Gen framework. Spans multiple fonts and granularities from single words to full-page documents, with 25+ augmentation strategies emulating real-world document degradation.
KS-LIT-3M: A Curated Kashmiri Text Dataset for LLM Pretraining
Introduces a 3.1-million-word curated Kashmiri text dataset designed for pretraining LLMs. Addresses the scarcity of high-quality Kashmiri training data with CC-BY-4.0 licensing.
KS-PRET-5M: A 5 Million Word, 12 Million Token Kashmiri Pretraining Dataset
Successor to KS-LIT-3M. A 5-million-word, 12-million-token Kashmiri pretraining corpus recovered largely from professionally typeset InPage archives in Nastaliq script — the highest-quality stratum currently available for Kashmiri NLP.
SynthOCR-Gen: A Synthetic OCR Dataset Generator for Low-Resource Languages
The generation framework behind Koshur Pixel. Produces synthetic OCR training data for low-resource scripts, breaking the annotation bottleneck that blocks OCR development for languages without large labelled document collections.
Datasets 17
100 Shruk Speech-to-Text Dataset
Recordings of traditional Kashmiri shruks paired with Kashmiri-script transcriptions and thematic tags (99 samples), for training and evaluating Kashmiri ASR.
BharatSetu-22Indic-1M
The bharatSetu table on Hugging Face: 984,764 English sentences with machine translations in 22 Indian languages including Kashmiri. Machine-generated, not human-verified; access requires accepting the repository's conditions.
English–Kashmiri 1M Machine Translations (HNM)
About 985K English sentences with machine-translated Kashmiri, the Kashmiri column of bharatSetu. The card does not name the translation model or a licence; gated.
Kashmiri News Articles Text Dataset (HNM)
Kashmiri news article text released by HNM for language-model training. Access requires the author's approval.
Koshur Pixel — 613K Synthetic OCR Pairs
613,078 synthetic image-text pairs for Kashmiri OCR, spanning multiple fonts and granularities from individual words to full pages, with 25+ augmentation strategies simulating real document degradation.
KS-PRET-5M — 5M Word Kashmiri Pretraining Corpus
5 million words / 12 million tokens of Kashmiri text recovered from professionally typeset InPage Nastaliq archives. The largest and highest-fidelity Kashmiri pretraining corpus published to date, and the source corpus behind Koshur Pixel.
The Grierson Kashmiri Dictionary (digitised)
A digitised version of George Grierson's historical Kashmiri dictionary, released by HNM. Access requires the author's approval.
Kashmiri Text Corpus Cleaned (2025)
Cleaned and processed Kashmiri text dataset designed for linguistic research and model training. Preprocessed and deduplicated for quality.
KS-LIT-3M — 3.1 Million Word Pretraining Dataset
Meticulously cleaned 3.1-million-word (16.4M characters) Kashmiri text corpus specifically designed for pretraining LLMs from scratch. The largest open Kashmiri text resource.
40K Kashmiri Text-Image Dataset (OCR)
About 40,000 Kashmiri text images paired with their transcriptions, for training and testing OCR models. Released by HNM; the related 600K-KS-OCR corpus is described in its own paper.
Kashmiri Multilingual Dictionary
Multilingual dictionary dataset with entries in English, Kashmiri, Urdu, Chinese, and Turkish — including example sentences for cross-lingual research.
Kashmiri Poet Dataset — Shruks
1,552 Kashmiri shruks (8,283 lines, about 36K words), offered for classification, generation and translation experiments. Access is granted on request.
Kashmiri Text Corpus (HNM)
A 15 MB plain-text Kashmiri corpus of about 1.69 million words (57K unique), released with a character and word statistics report. Access is granted on request.
Kashmiri TTS Dataset (HNM)
Kashmiri speech with transcripts prepared for text-to-speech training.
Kashmiri-English Parallel Corpus 49K (HNM)
About 49,000 Kashmiri-English sentence pairs released by HNM (Haq Nawaz Malik). Access requires the author's approval; no accompanying paper found yet.
Kashmiri Sample Text Recognition (OCR)
5,000 samples of Kashmiri text images paired with text labels for OCR model training and testing.
Kashmiri Spoken Words Dataset
Processed audio data of 12 frequently spoken Kashmiri words. Designed for spoken word recognition and voice command research.
Models 5
Koshur Diacritizer
Byte-level sequence-to-sequence model that restores omitted diacritics in Kashmiri text — a necessary preprocessing step for TTS, and for any task where vowel distinctions carry meaning.
koshur-kouter ks-en v1 (HNM)
A Kashmiri→English translation model released by HNM.
ks_byte_lm — SpaceByte (HNM)
Byte-level SpaceByte-style causal language model trained from scratch on a Kashmiri pretraining corpus; Transformers-compatible release (trust_remote_code).
Kashmiri BERT (kashmiri-llm-bert-base)
BERT-base model trained specifically for the Kashmiri language. Useful for downstream tasks like text classification, NER, and feature extraction.
Kashur GPT v1 (HNM)
Small decoder-only transformer for generating Kashmiri text continuations from prompts, with a live demo on Spaces. Not intended for production use without further evaluation.
Tools 2
Kashmiri Tokenizers (HNM)
Kashmiri subword and word tokenizers (BPE, Unigram, WordPiece, word- and character-level) released by HNM.
Kashur Tesseract Training Data (HNM)
Kashmiri language data for training Tesseract OCR, with about 10K ground-truth training files (.tif, .box, .txt).
Profile 1
Worked with
- Nahfid Nissar
- Faizan Iqbal
- Kh Mohmad Shafi
- Tanveer Ahmad Reshi
Every work above is a record in the Kashmiri NLP resource hub, credited as published; profile details come from huggingface.co, arxiv.org, arxiv.org. Something missing or wrong? Submit it.