8 papers
Prompt Robustness Is Task-Dependent: Comparing Objective and Belief-Style Questions in LLM Evaluation
Sadia Kamal, Arefa Patwary, Anthony Marchiafava +2
Survey-style evaluations of large language models often treat a prompted response as a measure of a model's values or beliefs. This assumption is particularly fragile when response…
AdaptiSent: Context-Aware Adaptive Attention for Multimodal Aspect-Based Sentiment Analysis
S M Rafiuddin, Sadia Kamal, Mohammed Rakib +2
We introduce AdaptiSent, a new framework for Multimodal Aspect-Based Sentiment Analysis (MABSA) that uses adaptive cross-modal attention mechanisms to improve sentiment classificat…
A Detailed Factor Analysis for the Political Compass Test: Navigating Ideologies of Large Language Models
Sadia Kamal, Lalu Prasad Yadav Prakash, S M Rafiuddin +3
The Political Compass Test (PCT) and similar surveys are commonly used to assess political bias in auto-regressive LLMs. Our rigorous statistical experiments show that while change…
Exploiting Adaptive Contextual Masking for Aspect-Based Sentiment Analysis
S M Rafiuddin, Mohammed Rakib, Sadia Kamal +1
Aspect-Based Sentiment Analysis (ABSA) is a fine-grained linguistics problem that entails the extraction of multifaceted aspects, opinions, and sentiments from the given text. Both…
Modeling Political Orientation of Social Media Posts: An Extended Analysis
Sadia Kamal, Brenner Little, Jade Gullic +3
Developing machine learning models to characterize political polarization on online social media presents significant challenges. These challenges mainly stem from various factors…
Quantitative Analysis of Forecasting Models:In the Aspect of Online Political Bias
Srinath Sai Tripuraneni, Sadia Kamal, Arunkumar Bagavathi
Understanding and mitigating political bias in online social media platforms are crucial tasks to combat misinformation and echo chamber effects. However, characterizing political…
Learning Unbiased News Article Representations: A Knowledge-Infused Approach
Sadia Kamal, Jimmy Hartford, Jeremy Willis +1
Quantification of the political leaning of online news articles can aid in understanding the dynamics of political ideology in social groups and measures to mitigating them. Howeve…
A Machine Learning Pipeline to Examine Political Bias with Congressional Speeches
Prasad hajare, Sadia Kamal, Siddharth Krishnan +1
Computational methods to model political bias in social media involve several challenges due to heterogeneity, high-dimensional, multiple modalities, and the scale of the data. Pol…