5 citations · 9 across the 23 of their papers we have counts for
9 papers · 1 filter
Whose Data, Whose Benchmark? A User-Centric Framework for Auditing Evaluation Resources
Mir Tafseer Nayeem, Davood Rafiei
Benchmarks shape how model capabilities are measured and interpreted, yet their scores can obscure whose conventions, contexts, and judgments define successful performance. We intr…
CineSubBench: Evaluating LLMs on Long-Form Narrative and Cultural Understanding from Multilingual Movie Subtitles
Mir Tafseer Nayeem, Susmoy Chakraborty, Davood Rafiei
Large language models are increasingly evaluated in specialized domains such as law, medicine, software engineering, and cybersecurity, yet film remains comparatively underexplored…
Who Gets a Token, and What Does It Carry? Unequal Name Support and Concept Access in Large Language Models
Mir Tafseer Nayeem, Davood Rafiei
Names are personal identifiers, but they also carry social meaning and are widely used to evaluate how language models treat different people. Such evaluations typically assume tha…
SurveyAgent-HKA: A multi-agent framework for scientific survey generation with LLMs and human knowledge augmentation
Tong Bao, Mir Tafseer Nayeem, Yi Zhao +2
Automatic scientific survey generation has become an important task in scientific document processing. The common approach of retrieving literature from a single source (e.g., arXi…
PARTAB: Partition-Aware Reasoning with Structured Evidence for Scalable Table Understanding
Md Mahadi Hasan Nahid, Davood Rafiei
Large Language Models (LLMs) have shown strong capabilities in table reasoning, but their effectiveness degrades as tables grow in size and complexity due to irrelevant context and…
EdgeLM: Edge Demonstrations for Language Models' Table Understanding
Soroush Omidvartehrani, Mohammadamin Habibollah, Mohammadreza Daviran +1
Large language models (LLMs) perform table-centric prediction through in-context learning, making demonstration selection critical to performance. Existing retrieval methods priori…
FlexSQL: Flexible Exploration and Execution Make Better Text-to-SQL Agents
Quang Hieu Pham, Yang He, Ping Nie +5
Text-to-SQL over large analytical databases requires navigating complex schemas, resolving ambiguous queries, and grounding decisions in actual data. Most current systems follow a…
SynSQL: Synthesizing Relational Databases for Robust Evaluation of Text-to-SQL Systems
Mohammadamin Habibollah, Davood Rafiei
Evaluating text-to-SQL systems remains largely fragile: correctness is typically judged by executing predicted and gold SQL queries on a single static database, even though the sam…
How Does "English (US)" Become the Default? Triangulating Structural Bias Towards American English Across the LLM Pipeline
Mir Tafseer Nayeem, Davood Rafiei
Large language models (LLMs) are increasingly embedded in educational, professional, and public infrastructure, yet widely used platforms expose "English (US)" as a primary English…