5 papers
Toward Latent Language Model Skills Steering and Optimization: An Empirical Study
Xunyi Jiang, Junda Wu, Yuxin Xiong +6
Skills, as a useful abstraction for the procedural capabilities of large language models (LLMs), capture how models perform structured, multi-step reasoning and program execution.…
F-GRPO: Factorized Group-Relative Policy Optimization for Unified Candidate Generation and Ranking
Rohan Surana, Gagan Mundada, Junda Wu +9
Traditional retrieval pipelines optimize utility through stages of candidate retrieval and reranking, where ranking operates over a predefined candidate set. Large Language Models…
Explainable Chain-of-Thought Reasoning: An Empirical Analysis on State-Aware Reasoning Dynamics
Sheldon Yu, Yuxin Xiong, Junda Wu +6
Recent advances in chain-of-thought (CoT) prompting have enabled large language models (LLMs) to perform multi-step reasoning. However, the explainability of such reasoning remains…
Exploring Rewriting Approaches for Different Conversational Tasks
Md Mehrab Tanjim, Ryan A. Rossi, Mike Rimer +9
Conversational assistants often require a question rewriting algorithm that leverages a subset of past interactions to provide a more meaningful (accurate) answer to the user's que…
Diversify-verify-adapt: Efficient and Robust Retrieval-Augmented Ambiguous Question Answering
Yeonjun In, Sungchul Kim, Ryan A. Rossi +4
The retrieval augmented generation (RAG) framework addresses an ambiguity in user queries in QA systems by retrieving passages that cover all plausible interpretations and generati…