1 citations · 1 across the 13 of their papers we have counts for
16 papers
Overlap, Unique and Conflict: Can LLMs Extract What They Can Recognize?
Eftekhar Hossain, Santu Karmaker
Understanding multi-perspective alternative narratives requires identifying how their information agrees, conflicts, or differs across sources. Existing work on cross-text relation…
Evaluating Whether LLMs Can Reliably Connect the DOTs?
Eftekhar Hossain, John Salvador, Santu Karmaker
Access to real-world information is often noisy and fragmented. Constructing a coherent narrative from such fragments requires models to reconstruct missing spans within a broader…
TopoTuner: Topological Finetuning of Large Language Models
Abdulkadir Erol, Yash Mahajan, Vepaul Hariprashad +4
Full fine-tuning remains a strong way to adapt pretrained LLMs, but it updates all weights and can be expensive. LoRA reduces the number of trainable parameters, but it does not di…
Exploring LLMs for South Asian Music Understanding and Generation
Faria Binte Kader, Mohtasim Hadi Rafi, Shah Wasif Sajjad +1
Recent advancements in Large Language Models (LLMs) have shown promising results in music understanding and generation tasks. However, existing works remain confined to Western ton…
OmniToM: Benchmarking Theory of Mind in LLMs via Explicit Belief Modeling
Adam Bawatneh, Sagar Sapkota, Amrit Singh Bedi +2
Theory of Mind (ToM), the ability to infer others' knowledge, intentions, and emotions, is commonly evaluated in large language models (LLMs) using end-point question answering, wh…
The Path Not Taken: Duality in Reasoning about Program Execution
Eshgin Hasanov, Md Mahadi Hassan Sibat, Santu Karmaker +1
Large language models (LLMs) have shown remarkable capabilities across diverse coding tasks. However, their adoption requires a true understanding of program execution rather than…
FinTradeBench: A Financial Reasoning Benchmark for LLMs
Yogesh Agrawal, Aniruddha Dutta, Md Mahadi Hasan +2
Financial analysis requires reasoning over heterogeneous signals, including company fundamentals from regulatory filings and trading signals derived from market prices. However, ex…
The Critical Role of Aspects in Measuring Document Similarity
Eftekhar Hossain, Tarnika Hazra, Ahatesham Bhuiyan +1
We introduce ASPECTSIM, a simple and interpretable framework that requires conditioning document similarity on an explicitly specified aspect, which is different from the tradition…
Instructional Goal-Aligned Question Generation for Student Evaluation in Virtual Lab Settings: How Closely Do LLMs Actually Align?
R. Alexander Knipper, Indrani Dey, Souvika Sarkar +3
Virtual Labs offer valuable opportunities for hands-on, inquiry-based science learning, yet teachers often struggle to adapt them to fit their instructional goals. Third-party mate…
A Survey on Evaluation Metrics for Music Generation
Faria Binte Kader, Santu Karmaker
Despite significant advancements in music generation systems, the methodologies for evaluating generated music have not progressed as expected due to the complex nature of music, w…
Teaching an Old LLM Secure Coding: Localized Preference Optimization on Distilled Preferences
Mohammad Saqib Hasan, Saikat Chakraborty, Santu Karmaker +1
LLM generated code often contains security issues. We address two key challenges in improving secure code generation. First, obtaining high quality training data covering a broad s…
Large Language Models for IT Automation Tasks: Are We There Yet?
Md Mahadi Hassan, John Salvador, Akond Rahman +1
LLMs show promise in code generation, yet their effectiveness for IT automation tasks, particularly for tools like Ansible, remains understudied. Existing benchmarks rely primarily…
Multi-Party Conversational Agents: A Survey
Sagar Sapkota, Mohammad Saqib Hasan, Mubarak Shah +1
Multi-party Conversational Agents (MPCAs) are systems designed to engage in dialogue with more than two participants simultaneously. Unlike traditional two-party agents, designing…
LLM for Comparative Narrative Analysis
Leo Kampen, Carlos Rabat Villarreal, Louis Yu +2
In this paper, we conducted a Multi-Perspective Comparative Narrative Analysis (CNA) on three prominent LLMs: GPT-3.5, PaLM2, and Llama2. We applied identical prompts and evaluated…
Set-Theoretic Compositionality of Sentence Embeddings
Naman Bansal, Yash mahajan, Sanjeev Sinha +1
Sentence encoders play a pivotal role in various NLP tasks; hence, an accurate evaluation of their compositional properties is paramount. However, existing evaluation methods predo…
BanglaLlama: LLaMA for Bangla Language
Abdullah Khan Zehady, Shubhashis Roy Dipta, Naymul Islam +2
Bangla is a language spoken by approximately 240 million native speakers and around 300 million people worldwide. Despite being the 5th largest spoken language in the world, Bangla…