4 papers · 1 filter
Simulating Meaning, Nevermore! Introducing ICR: A Semiotic-Hermeneutic Metric for Evaluating Meaning in LLM Text Summaries
Natalie Perez, Sreyoshi Bhaduri, Aman Chadha
Meaning in human language is relational, context dependent, and emergent, arising from dynamic systems of signs rather than fixed word-concept mappings. In computational settings,…
IndicMMLU-Pro: Benchmarking Indic Large Language Models on Multi-Task Language Understanding
Sankalp KJ, Ashutosh Kumar, Laxmaan Balaji +4
Known by more than 1.5 billion people in the Indian subcontinent, Indic languages present unique challenges and opportunities for natural language processing (NLP) research due to…
Potential and Perils of Large Language Models as Judges of Unstructured Textual Data
Rewina Bedemariam, Natalie Perez, Sreyoshi Bhaduri +7
Rapid advancements in large language models have unlocked remarkable capabilities when it comes to processing and summarizing unstructured text data. This has implications for the…
Decoding the Diversity: A Review of the Indic AI Research Landscape
Sankalp KJ, Vinija Jain, Sreyoshi Bhaduri +2
This review paper provides a comprehensive overview of large language model (LLM) research directions within Indic languages. Indic languages are those spoken in the Indian subcont…