8 papers
Lean4AgenticRL: Advancing Agentic RL with Verifiable Multi-level Process Rewards
Ruida Wang, Gerald Friedland, Tong Zhang +1
Enhancing the agentic capabilities of Large Language Models (LLMs) to tackle complex software engineering (SWE) and general terminal-usage problems is a pressing challenge. Current…
MInTRL: Off-policy Intervention can boost On-policy RL
Mingyu Chen, Yefan Tao, Gerald Friedland +2
Reinforcement learning with verifiable rewards is typically performed on-policy, keeping training data close to the current policy but limiting learning to trajectories that the po…
Mitra-v2 Technical Report
Yefan Tao, Xiyuan Zhang, Xinyi Liu +13
We introduce Mitra-v2, a tabular foundation model that delivers state-of-the-art performance on real-world classification and regression problems, from credit-risk scoring and clin…
Cliff: Learning Process Rewards from the First Mistake
Peixuan Han, Runhui Wang, Ketan Ramaneti +3
Reinforcement learning with verifiable rewards (RLVR) has emerged as a powerful paradigm for large language model (LLM) post-training, but its reliance on coarse outcome rewards le…
Self-Aligned Reward: Towards Effective and Efficient Reasoners
Peixuan Han, Adit Krishnan, Gerald Friedland +2
Reinforcement learning with verifiable rewards has significantly advanced reasoning in large language models (LLMs), but such signals remain coarse, offering only binary correctnes…
Classifier Language Models: Unifying Sparse Finetuning and Adaptive Tokenization for Specialized Classification Tasks
Adit Krishnan, Chu Wang, Chris Kong
Semantic text classification requires the understanding of the contextual significance of specific tokens rather than surface-level patterns or keywords (as in rule-based or statis…
Declarative Data Pipeline for Large Scale ML Services
Yunzhao Yang, Runhui Wang, Xuanqing Liu +14
Modern distributed data processing systems struggle to balance performance, maintainability, and developer productivity when integrating machine learning at scale. These challenges…
Learning from Natural Language Explanations for Generalizable Entity Matching
Somin Wadhwa, Adit Krishnan, Runhui Wang +2
Entity matching is the task of linking records from different sources that refer to the same real-world entity. Past work has primarily treated entity linking as a standard supervi…