85 citations · 126 across the 13 of their papers we have counts for
3 papers · 1 filter
Native Multilingual Chain-of-Thought Reasoning in Low-Resource Southeast Asian Languages
Sean Gip Lim, William Chandra Tjhi, Hai Leong Chieu
Large Language Models have achieved substantial progress in reasoning capabilities. Yet in low-resource native settings, many suffer from cross-lingual collapse, reverting to Engli…
Tokenizer-Agnostic Engram Module
Jia Peng Lim, Hai Leong Chieu
Deepseek's Engram, a conditional memory module, was introduced to trade-off storage versus reasoning in large language models. However, the module relies on token-level -gram ha…
Spokes: Optimizing for Diverse Pretraining Data Selection
Clarence Lee, Yejin Choi, Luke Zettlemoyer +2
Diversity plays a critical role in data selection, improving performance under fixed data budgets by reducing redundancy and repetition. However, optimizing for diversity is inhere…