34 citations · 61 across the 11 of their papers we have counts for
12 papers
Loose Lips: Understanding Privacy Leakage in Agentic Dialogue
Soumya Sharma, Ayana Hussain, Heber Hwang Arcolezi +4
As LLM agents are increasingly deployed in high-stakes enterprise settings, understanding how they handle sensitive information in agentic dialogue has become critical. Privacy lea…
IDP-Bench: Benchmarking ability of LLMs to protect personal information in interdependent privacy contexts
Ayana Hussain, Soumya Sharma, Golnoosh Farnadi +3
Large language models (LLMs) are becoming widely deployed as personal AI assistants with access to sensitive user data, making privacy a major challenge for their design and evalua…
IDEAFix: Evaluation Framework for Creative Defixation Prompting in LLMs
F. Carichon, S. Sharma, M. Girard +2
Large language models (LLMs) are increasingly used for tasks involving creative problem solving and idea generation. However, there is a lack of consensus concerning their creative…
Robust Reward Modeling via Causal Rubrics
Pragya Srivastava, Harman Singh, Rahul Madhavan +9
Reward models (RMs) are fundamental to aligning Large Language Models (LLMs) via human feedback, yet they often suffer from reward hacking. They tend to latch on to superficial or…
FinRED: A Dataset for Relation Extraction in Financial Domain
Soumya Sharma, Tapas Nayak, Arusarka Bose +4
Relation extraction models trained on a source domain cannot be applied on a different target domain due to the mismatch between relation sets. In the current literature, there is…
Financial Numeric Extreme Labelling: A Dataset and Benchmarking for XBRL Tagging
Soumya Sharma, Subhendu Khatuya, Manjunath Hegde +3
The U.S. Securities and Exchange Commission (SEC) mandates all public companies to file periodic financial statements that should contain numerals annotated with a particular label…
ECTSum: A New Benchmark Dataset For Bullet Point Summarization of Long Earnings Call Transcripts
Rajdeep Mukherjee, Abhinav Bohra, Akash Banerjee +8
Despite tremendous progress in automatic summarization, state-of-the-art methods are predominantly trained to excel in summarizing short newswire articles, or documents with strong…
Realistic Data Augmentation Framework for Enhancing Tabular Reasoning
Dibyakanti Kumar, Vivek Gupta, Soumya Sharma +1
Existing approaches to constructing training data for Natural Language Inference (NLI) tasks, such as for semi-structured table reasoning, are either via crowdsourcing or fully aut…
A Generative Approach for Financial Causality Extraction
Tapas Nayak, Soumya Sharma, Yash Butala +3
Causality represents the foremost relation between events in financial documents such as financial news articles, financial reports. Each financial causality contains a cause span…
Sequence-Based Extractive Summarisation for Scientific Articles
Daniel Kershaw, Rob Koeling
This paper presents the results of research on supervised extractive text summarisation for scientific articles. We show that a simple sequential tagging model based only on the te…
Bayesian Optimization -- Multi-Armed Bandit Problem
Abhilash Nandy, Chandan Kumar, Deepak Mewada +1
In this report, we survey Bayesian Optimization methods focussed on the Multi-Armed Bandit Problem. We take the help of the paper "Portfolio Allocation for Bayesian Optimization".…
Incorporating Domain Knowledge into Medical NLI using Knowledge Graphs
Soumya Sharma, Bishal Santra, Abhik Jana +3
Recently, biomedical version of embeddings obtained from language models such as BioELMo have shown state-of-the-art results for the textual inference task in the medical domain. I…