4 papers
Resolving Interference (RI): Disentangling Models for Improved Model Merging
Pratik Ramesh, George Stoica, Arun Iyer +2
Model merging has shown that multitask models can be created by directly combining the parameters of different models that are each specialized on tasks of interest. However, model…
Chow-Liu Ordering for Long-Context Reasoning in Chain-of-Agents
Naman Gupta, Vaibhav Singh, Arun Iyer +8
Sequential multi-agent reasoning frameworks such as Chain-of-Agents (CoA) handle long-context queries by decomposing inputs into chunks and processing them sequentially using LLM-b…
STACKFEED: Structured Textual Actor-Critic Knowledge Base Editing with FeedBack
Shashank Kirtania, Naman Gupta, Priyanshu Gupta +7
Large Language Models (LLMs) often generate incorrect or outdated information, especially in low-resource settings or when dealing with private data. To address this, Retrieval-Aug…
Steering LLMs for Formal Theorem Proving
Shashank Kirtania, Arun Iyer
Recent advances in automated theorem proving use Large Language Models (LLMs) to translate informal mathematical statements into formal proofs. However, informal cues are often amb…