5 papers
Beyond Correctness: Rewarding Faithful Reasoning in Retrieval-Augmented Generation
Zhichao Xu, Zongyu Wu, Yun Zhou +9
Inspired by the success of reinforcement learning (RL) in Large Language Model (LLM) training for domains like math and code, recent work has begun training LLMs to dynamically pla…
Diffusion Language Model Inference with Monte Carlo Tree Search
Zheng Huang, Kiran Ramnath, Yueyan Chen +8
Diffusion language models (DLMs) have recently emerged as a compelling alternative to autoregressive generation, offering parallel generation and improved global coherence. During…
Learning to Ideate for Machine Learning Engineering Agents
Yunxiang Zhang, Kang Zhou, Zhichao Xu +5
Existing machine learning engineering (MLE) agents struggle to iteratively optimize their implemented algorithms for effectiveness. To address this, we introduce MLE-Ideator, a dua…
CSPLADE: Learned Sparse Retrieval with Causal Language Models
Zhichao Xu, Aosong Feng, Yijun Tian +2
In recent years, dense retrieval has been the focus of information retrieval (IR) research. While effective, dense retrieval produces uninterpretable dense vectors, and suffers fro…
SLOT: Structuring the Output of Large Language Models
Darren Yow-Bang Wang, Zhengyuan Shen, Soumya Smruti Mishra +3
Structured outputs are essential for large language models (LLMs) in critical applications like agents and information extraction. Despite their capabilities, LLMs often generate o…