3 papers
cs.CL2025
Studying the Soupability of Documents in State Space Models
Yasaman Jafari, Zixian Wang, Leon Bergen +1
We investigate whether hidden states from Structured State Space Models (SSMs) can be merged post hoc to support downstream reasoning. Inspired by model souping, we study document…
cs.CL2025
Single-Pass Document Scanning for Question Answering
Weili Cao, Jianyou Wang, Youze Zheng +5
Handling extremely large documents for question answering is challenging: chunk-based embedding methods often lose track of important global context, while full-context transformer…
cs.LG2024
Adapting While Learning: Grounding LLMs for Scientific Problems with Intelligent Tool Usage Adaptation
Bohan Lyu, Yadi Cao, Duncan Watson-Parris +3
Large Language Models (LLMs) demonstrate promising capabilities in solving scientific problems but often suffer from the issue of hallucination. While integrating LLMs with tools c…