Showing cs.CYShow all
2 papers · 1 filter
cs.CY2026
Tokenizations for Austronesian Language Models: study on languages in Indonesia Archipelago
Andhika Bernard Lumbantobing, Hokky Situngkir
Tokenization constitutes a fundamental stage in Large Language Model (LLM) processing; however, subword-based tokenization methods optimized on English-dominant corpora may produce…
cs.CY2026
Syllabic Agglutinative Tokenizations for Indonesian LLM: A Study from Gasing Literacy Learning System
H. Situngkir, A. B. Lumbantobing, Y. Surya
This paper presents a novel syllable-based tokenization approach for Indonesian large language models, inspired by the Gasing Literacy Learning System's pedagogical methodology. Dr…