4 papers
HumanMCP: A Human-Like Query Dataset for Evaluating MCP Tool Retrieval Performance
Shubh Laddha, Lucas Changbencharoen, Win Kuptivej +3
Model Context Protocol (MCP) servers contain a collection of thousands of open-source standardized tools, linking LLMs to external systems; however, existing datasets and benchmark…
Decoding Fake Narratives in Spreading Hateful Stories: A Dual-Head RoBERTa Model with Multi-Task Learning
Yash Bhaskar, Sankalp Bahad, Parameswari Krishnamurthy
Social media platforms, while enabling global connectivity, have become hubs for the rapid spread of harmful content, including hate speech and fake narratives \cite{davidson2017au…
Yes-MT's Submission to the Low-Resource Indic Language Translation Shared Task in WMT 2024
Yash Bhaskar, Parameswari Krishnamurthy
This paper presents the systems submitted by the Yes-MT team for the Low-Resource Indic Language Translation Shared Task at WMT 2024 (Pakray et al., 2024), focusing on translating…
Crosslingual Optimized Metric for Translation Assessment of Indian Languages
Arafat Ahsan, Vandan Mujadia, Pruthwik Mishra +2
Automatic evaluation of translation remains a challenging task owing to the orthographic, morphological, syntactic and semantic richness and divergence observed across languages. S…