7 papers
CurveRL: Principled Distribution-Aware Context Reweighting for LLM Reasoning
Ke Sun, Yizhou Zhao, Jiayi Xin +2
Context or prompt-level reweighting has emerged as a central algorithmic lever in Reinforcement Learning with Verified Rewards (RLVR) for improving the reasoning capability of larg…
UCS: Estimating Unseen Coverage for Improved In-Context Learning
Jiayi Xin, Xiang Li, Evan Qiang +4
In-context learning (ICL) performance depends critically on which demonstrations are placed in the prompt, yet most existing selectors prioritize heuristic notions of relevance or…
CAMEL: An ECG Language Model for Forecasting Cardiac Events
Neelay Velingker, Alaia Solko-Breslin, Mayank Keoliya +9
Electrocardiograms (ECG) are electrical recordings of the heart that are critical for diagnosing cardiovascular conditions. ECG language models (ELMs) have recently emerged as a pr…
The Impact of Language Mixing on Bilingual LLM Reasoning
Yihao Li, Jiayi Xin, Miranda Muqing Miao +2
Proficient multilingual speakers often intentionally switch languages in the middle of a conversation. Similarly, recent reasoning-focused bilingual large language models (LLMs) wi…
Evaluating the Unseen Capabilities: How Many Theorems Do LLMs Know?
Xiang Li, Jiayi Xin, Qi Long +1
Accurate evaluation of large language models (LLMs) is crucial for understanding their capabilities and guiding their development. However, current evaluations often inconsistently…
I2MoE: Interpretable Multimodal Interaction-aware Mixture-of-Experts
Jiayi Xin, Sukwon Yun, Jie Peng +4
Modality fusion is a cornerstone of multimodal learning, enabling information integration from diverse data sources. However, vanilla fusion methods are limited by (1) inability to…