Jinghpaw · corpus in collection
Jinghpaw · ≈1.5M speakers · fine-tuning on a community-curated corpus.
The same thought, double the cost.
Latin orthography with tone marks — vocabularies fragment tone-bearing syllables.
A Latin script, still under-tokenized
Jinghpaw is written in a Latin-based orthography developed in the late 19th century. It looks familiar to a tokenizer trained on English — but the diacritics, tone marks, and syllable structure fragment into pieces the vocabulary never learned to keep together.
The corpus is in collection with community and church archives. Provenance is per-item, consent is revocable.
We work with open source models. Gemma-4 (and SEA-LION )is being used for Burmese, Karen, and Jinghpaw as well as; Llama-3.1-8B may be used for Rohingya, for byte-level fallback where Hanifi is unrepresented.
Community participation and consent for curation and capture. Provenance recorded and fair compensation provided.
Converting legacy encodings and non-standard scripts into universal digital formats (e.g., Zawgyi to Unicode) is an act of cultural and historic preservation. Working alongside local linguists and community members, we systematically standardize text to be machine-readable while ensuring cultural context, orthographic nuances, and historical integrity remain intact.
Adapting foundational base models to local linguistic realities through targeted, data-efficient techniques calibrated to each language’s structure and context. Training logs and loss curves are published directly to the public archive with complete technical transparency.
Community-annotated benchmarks. Evals and benchmarks designed with local community and experts. Annotators acknowledgements and compensation. Inter-annotator agreement reported alongside every score.
- Q01How to represent tone marks consistently across religious and secular writing.
- Q02Whether to include neighboring Kachin languages in a shared corpus or keep them distinct.
The corpus belongs to the communities that made it. Consent is per item and revocable. Revocation is honored in the weights, not just in the archive.
Model weights reflect the terms and governance frameworks chosen with the community.