4 papers
Arithmetic Pedagogy for Language Models
Andhika Bernard Lumbantobing, Hokky Situngkir
We investigate whether methods of human mathematics pedagogy can guide the training of language models toward arithmetic reasoning. Building on the GASING method -- an Indonesian p…
Adaptive Engram Memory System for Indonesian Language Model: Generative AI Based on TOBA LM for Batak and Minang Language
Hokky Situngkir, Kevin Siringoringo, Andhika Bernard Lumbantobing
This study presents TOBA-LM, a trilingual language model based on GPT-2 architecture with 1.2 billion parameters, trained on a corpus encompassing Indonesian, Batak, and Minangkaba…
Tokenizations for Austronesian Language Models: study on languages in Indonesia Archipelago
Andhika Bernard Lumbantobing, Hokky Situngkir
Tokenization constitutes a fundamental stage in Large Language Model (LLM) processing; however, subword-based tokenization methods optimized on English-dominant corpora may produce…
Syllabic Agglutinative Tokenizations for Indonesian LLM: A Study from Gasing Literacy Learning System
H. Situngkir, A. B. Lumbantobing, Y. Surya
This paper presents a novel syllable-based tokenization approach for Indonesian large language models, inspired by the Gasing Literacy Learning System's pedagogical methodology. Dr…