4 papers
On the Intrinsic Limits of Transformer Image Embeddings in Non-Solvable Spatial Reasoning
Siyi Lyu, Quan Liu, Feng Yan
Vision Transformers (ViTs) excel in semantic recognition but exhibit systematic failures in spatial reasoning tasks such as mental rotation. While often attributed to data scale, t…
DARE-bench: Evaluating Modeling and Instruction Fidelity of LLMs in Data Science
Fan Shu, Yite Wang, Ruofan Wu +4
The fast-growing demands in using Large Language Models (LLMs) to tackle complex multi-step data science tasks create an emergent need for accurate benchmarking. There are two majo…
ComposeRAG: A Modular and Composable RAG for Corpus-Grounded Multi-Hop Question Answering
Ruofan Wu, Youngwon Lee, Fan Shu +5
Retrieval-Augmented Generation (RAG) systems are increasingly diverse, yet many suffer from monolithic designs that tightly couple core functions like query reformulation, retrieva…
Agentic Verification for Ambiguous Query Disambiguation
Youngwon Lee, Seung-won Hwang, Ruofan Wu +5
In this work, we tackle the challenge of disambiguating queries in retrieval-augmented generation (RAG) to diverse yet answerable interpretations. State-of-the-arts follow a Divers…