8 papers
When Meaning Travels: A Granular Lens on Hybrid-MoE's Role in Idiomatic Understanding for Language Models
Sarmistha Das, Vaibhav Vishal, Shreyas Guha +3
In the contemporary epoch of multilingual education, learning idioms provides a fascinating gateway towards creativity, cultural values, historical context, and diverse perspective…
FIND: Toward Multimodal Financial Reasoning and Question Answering for Indic Languages
Sarmistha Das, Vaibhav Vishal, Syed Ibrahim Ahmad +2
Financial decision-making in multilingual settings demands accurate numerical reasoning grounded in diverse modalities, yet existing benchmarks largely overlook this high-stakes, r…
When Meaning Isn't Literal: Exploring Idiomatic Meaning Across Languages and Modalities
Sarmistha Das, Shreyas Guha, Suvrayan Bandyopadhyay +3
Idiomatic reasoning, deeply intertwined with metaphor and culture, remains a blind spot for contemporary language models, whose progress skews toward surface-level lexical and sema…
Talk, Snap, Complain: Validation-Aware Multimodal Expert Framework for Fine-Grained Customer Grievances
Rishu Kumar Singh, Navneet Shreya, Sarmistha Das +2
Existing approaches to complaint analysis largely rely on unimodal, short-form content such as tweets or product reviews. This work advances the field by leveraging multimodal, mul…
Fin-Ally: Pioneering the Development of an Advanced, Commonsense-Embedded Conversational AI for Money Matters
Sarmistha Das, Priya Mathur, Ishani Sharma +3
The exponential technological breakthrough of the FinTech industry has significantly enhanced user engagement through sophisticated advisory chatbots. However, large-scale fine-tun…
Unlocking Financial Insights: An advanced Multimodal Summarization with Multimodal Output Framework for Financial Advisory Videos
Sarmistha Das, R E Zera Marveen Lyngkhoi, Sriparna Saha +1
The dynamic propagation of social media has broadened the reach of financial advisory content through podcast videos, yet extracting insights from lengthy, multimodal segments (30-…