6 papers
Hedonic Neurons: A Mechanistic Mapping of Latent Coalitions in Transformer MLPs
Tanya Chowdhury, Atharva Nijasure, Yair Zick +1
Fine-tuned Large Language Models (LLMs) encode rich task-specific features, but the form of these representations, especially within MLP layers, remains unclear. Empirical inspecti…
How Relevance Emerges: Interpreting LoRA Fine-Tuning in Reranking LLMs
Atharva Nijasure, Tanya Chowdhury, James Allan
We conduct a behavioral exploration of LoRA fine-tuned LLMs for Passage Reranking to understand how relevance signals are learned and deployed by Large Language Models. By fine-tun…
Probing Ranking LLMs: A Mechanistic Analysis for Information Retrieval
Tanya Chowdhury, Atharva Nijasure, James Allan
Transformer networks, particularly those achieving performance comparable to GPT models, are well known for their robust feature extraction abilities. However, the nature of these…
RankSHAP: Shapley Value Based Feature Attributions for Learning to Rank
Tanya Chowdhury, Yair Zick, James Allan
Numerous works propose post-hoc, model-agnostic explanations for learning to rank, focusing on ordering entities by their relevance to a query through feature attribution methods.…
Corpora Evaluation and System Bias Detection in Multi-document Summarization
Alvin Dey, Tanya Chowdhury, Yash Kumar Atri +1
Multi-document summarization (MDS) is the task of reflecting key points from any set of documents into a concise text paragraph. In the past, it has been used to aggregate news, tw…
CQASUMM: Building References for Community Question Answering Summarization Corpora
Tanya Chowdhury, Tanmoy Chakraborty
Community Question Answering forums such as Quora, Stackoverflow are rich knowledge resources, often catering to information on topics overlooked by major search engines. Answers s…