15 papers
Soft Token Alignment for Cross-Lingual Reasoning
Jiayi He, Jungsoo Park, Wei Xu +1
Multilingual large language models often produce inconsistent reasoning and answers for semantically equivalent prompts in different languages. Prior work suggests that intermediat…
Investigating and Alleviating Harm Amplification in LLM Interactions
Ruohao Guo, Wei Xu, Alan Ritter
Large language models (LLMs) can serve as helpful assistants, yet they can equally function as harm amplifiers that enable malicious users to achieve harmful outcomes beyond their…
Camellia: Benchmarking Cultural Biases in LLMs for Asian Languages
Tarek Naous, Anagha Savit, Carlos Rafael Catalan +17
As Large Language Models (LLMs) develop stronger multilingual capabilities, their sensitivity to culturally diverse entities becomes increasingly important. Prior work by Naous et…
Learning to Route Languages for Multilingual Policy Optimization
Geyang Guo, Hiromi Wakaki, Yuki Mitsufuji +2
Large language models~(LLMs) are trained on heterogeneous multilingual corpora, yet existing policy optimization methods often implicitly restrict each training question to a singl…
Distribution-Aware Reward: Reinforcement Learning over Predictive Distributions for LLM Regression
Jungsoo Park, Hyungjoo Chae, Ethan Mendes +4
Large language models can predict real-valued quantities from heterogeneous inputs such as text, code, and molecular strings, but most training objectives score each decoded floati…
GeoRC: A Benchmark for Geolocation Reasoning Chains
Mohit Talreja, Joshua Diao, Jim Thannikary James +6
Vision Language Models (VLMs) are good at recognizing the global location of a photograph -- their geolocation prediction accuracy rivals the best human experts. But many VLMs are…