7 papers
Cluster-R1: Large Reasoning Models Are Instruction-following Clustering Agents
Peijun Qing, Puneet Mathur, Nedim Lipka +5
General-purpose embedding models excel at recognizing semantic similarities but fail to capture the characteristics of texts specified by user instructions. In contrast, instructio…
Decomposition-Enhanced Training for Post-Hoc Attributions In Language Models
Sriram Balasubramanian, Samyadeep Basu, Koustava Goswami +6
Large language models (LLMs) are increasingly used for long-document question answering, where reliable attribution to sources is critical for trust. Existing post-hoc attribution…
A Survey on Long-Video Storytelling Generation: Architectures, Consistency, and Cinematic Quality
Mohamed Elmoghany, Ryan Rossi, Seunghyun Yoon +26
Despite the significant progress that has been made in video generative models, existing state-of-the-art methods can only produce videos lasting 5-16 seconds, often labeled "long-…
A Survey on Mechanistic Interpretability for Multi-Modal Foundation Models
Zihao Lin, Samyadeep Basu, Mohammad Beigi +18
The rise of foundation models has transformed machine learning research, prompting efforts to uncover their inner workings and develop more efficient and reliable applications for…
On Mechanistic Circuits for Extractive Question-Answering
Samyadeep Basu, Vlad Morariu, Zichao Wang +4
Large language models are increasingly used to process documents and facilitate question-answering on them. In our paper, we extract mechanistic circuits for this real-world langua…
Persona-SQ: A Personalized Suggested Question Generation Framework For Real-world Documents
Zihao Lin, Zichao Wang, Yuanting Pan +5
Suggested questions (SQs) provide an effective initial interface for users to engage with their documents in AI-powered reading applications. In practical reading sessions, users h…