12 papers
Literal Lock-In: How Test Language Shifts Literal Attraction in Typed Decision Models on Bengali Idioms
Adib Sakhawat, Syed Rifat Raiyan
Decision models, non-generative scorers that report a probability over caller-supplied options and emit no text, are increasingly deployed as routers, classifiers and guardrails. B…
Evaluating Temporal Reasoning in Large Language Models: Event Temporal Relation Extraction with Allen's Interval Algebra, Logical Consistency, and Relative Time in Narratives
Adib Sakhawat, Fardeen Sadab, Tamjid Hasan Fahim +9
Understanding a narrative means knowing how every event relates in time to every other, yet large language models (LLMs) are mostly tested on isolated event pairs or coarse labels.…
Two Emojis of Difference: What Multilingual Affective Generation Benchmarks Actually Measure
Fardeen Sadab, Adib Sakhawat
We audit a multilingual affective generation benchmark eight instruction-tuned LLMs producing emoji summaries for 17,100 Bangla, English and Hindi sentences, with 6,960 human judge…
Aligned in Form, Not in Meaning: The Comprehension - Containment Decoupling of LLM Safety in Low-Resource Bangla Derogatory Speech
Shadab Bin Habib, A K M Ferdous Reza Habib, Subarno Neel +1
We audit five frontier large language models on native Bangla derogatory speech (gali) across six protocols to test a single hypothesis: Comprehension-Containment Decoupling. We pr…
BLAD: A Historically Contextualized, Multilingual Dataset of Bangladeshi Legal Acts (1799 to 2025)
Adib Sakhawat
We present the Bangladesh Legal Acts Dataset (BLAD), a curated collection of 1{,}484 legislative acts enacted between 1799 and 2025. Each act is represented with its full text, str…
LLM-Ideoplasticity: Measuring Ideological Plasticity in the Political Behavior of LLMs as a Context-Conditioned Distribution
Adib Sakhawat, Syed Rifat Raiyan, Tahsin Islam +3
We argue, with systematic empirical evidence, that a large language model's political ideology is not a fixed point, but a conditional distribution positionconte…
Hubness, Not Anisotropy, Drives Cross-Lingual Retrieval Asymmetry in Multilingual Embedding Models
Adib Sakhawat, Fardeen Sadab, Atik Shahriar
Multilingual embedding models are deployed under the assumption that cross-lingual retrieval is symmetric: if a query in language A retrieves its translation in language B, the rev…
Coordinates of Capability: A Unified MTMM-Geometric Framework for LLM Evaluation
Adib Sakhawat, Tahsin Islam, Takia Farhin +3
The evaluation of Large Language Models (LLMs) faces a critical challenge in construct validity, where fragmented benchmarks and ad hoc metrics frequently conflate method variance,…
AREG: Adversarial Resource Extraction Game for Evaluating Persuasion and Resistance in Large Language Models
Adib Sakhawat, Fardeen Sadab
Evaluating the social intelligence of Large Language Models (LLMs) increasingly requires moving beyond static text generation toward dynamic, adversarial interaction. We introduce…
When Words Don't Mean What They Say: Figurative Understanding in Bengali Idioms
Adib Sakhawat, Shamim Ara Parveen, Md Ruhul Amin +3
Figurative language understanding remains a significant challenge for Large Language Models (LLMs), especially for low-resource languages. To address this, we introduce a new idiom…
AIDG: A Formal Decomposition of Information Extraction and Containment Asymmetries in Multi-Turn LLM Dialogue
Adib Sakhawat, Fardeen Sadab, Rakin Shahriar
Multi-turn LLM evaluation is typically reported as a single win-rate scalar, conflating distinct capabilities. We introduce AIDG (Adversarial Information Deduction Game), formalizi…
Political Alignment in Large Language Models: A Multidimensional Audit of Psychometric Identity and Behavioral Bias
Adib Sakhawat, Tahsin Islam, Takia Farhin +3
As large language models (LLMs) are increasingly deployed, understanding how they express political positioning is important for evaluating alignment and downstream effects. We aud…