4 papers
Benchmarking the Personalization Capabilities of Large Language Models
Ashutosh Srivastava, Siddharth Yedlapati, Vinay Aggarwal +4
Personalization is classically a two-party problem: a sender chooses what to say, and a receiver with independent objectives decides whether to act. A salesperson pitching the same…
MEMENTO: Leveraging Web as a Learning Signal for Low-Data Domains
Ashutosh Ojha, Vinay Aggarwal, Ashutosh Srivastava +3
Real-world tasks often lack large labeled datasets, motivating extensive work on learning in low-data regimes. Existing approaches such as few-shot prompting, instruction tuning, a…
Realizing LLMs' Causal Potential Requires Science-Grounded, Novel Benchmarks
Ashutosh Srivastava, Lokesh Nagalapatti, Gautam Jajoo +3
Recent claims of strong performance by Large Language Models (LLMs) on causal discovery are undermined by a key flaw: many evaluations rely on benchmarks likely included in pretrai…
Robust Root Cause Diagnosis using In-Distribution Interventions
Lokesh Nagalapatti, Ashutosh Srivastava, Sunita Sarawagi +1
Diagnosing the root cause of an anomaly in a complex interconnected system is a pressing problem in today's cloud services and industrial operations. We propose In-Distribution Int…