Showing cs.CLShow all
2 papers · 1 filter
cs.CL2026
Counting and Min-Cost Encoding for Tokenization in Large Language Models
Shuming Shi, Xiang Zhang, Hao Yu +7
Mainstream large language models rely on a tokenizer to encode text into a token sequence. Different tokenizers may yield token sequences of substantially different lengths for the…
cs.CL2026
BALTO: Balanced Token-Level Policy Optimization for Hallucination Mitigation
Ning Li, Zixuan Guo, Yan Xu +7
Hallucinations remain a major obstacle to deploying large language models (LLMs) in knowledge-intensive settings, where generated responses must be faithfully grounded in provided…