6 papers
UniRank: End-to-End Domain-Specific Reranking of Hybrid Text-Image Candidates
Yupei Yang, Lin Yang, Wanxi Deng +3
Reranking is a critical component in many information retrieval pipelines. Despite remarkable progress in text-only settings, multimodal reranking remains challenging, particularly…
Factored Causal Representation Learning for Robust Reward Modeling in RLHF
Yupei Yang, Lin Yang, Wanxi Deng +5
A reliable reward model is essential for aligning large language models with human preferences through reinforcement learning from human feedback. However, standard reward models a…
Let It Flow: Agentic Crafting on Rock and Roll, Building the ROME Model within an Open Agentic Learning Ecosystem
Weixun Wang, XiaoXiao Xu, Wanhe An +86
Agentic crafting requires LLMs to operate in real-world environments over multiple turns by taking actions, observing outcomes, and iteratively refining artifacts. Despite its impo…
Hallucination-Resistant Relation Extraction via Dependency-Aware Sentence Simplification and Two-tiered Hierarchical Refinement
Yupei Yang, Fan Feng, Lin Yang +5
Relation extraction (RE) enables the construction of structured knowledge for many downstream applications. While large language models (LLMs) have shown great promise in this task…
ShopSimulator: Evaluating and Exploring RL-Driven LLM Agent for Shopping Assistants
Pei Wang, Yanan Wu, Xiaoshuai Song +13
Large language model (LLM)-based agents are increasingly deployed in e-commerce shopping. To perform thorough, user-tailored product searches, agents should interpret personal pref…
Reinforcement Learning Optimization for Large-Scale Learning: An Efficient and User-Friendly Scaling Library
Weixun Wang, Shaopan Xiong, Gengru Chen +38
We introduce ROLL, an efficient, scalable, and user-friendly library designed for Reinforcement Learning Optimization for Large-scale Learning. ROLL caters to three primary user gr…