8 papers
Answering clinicians' questions over trial evidence tables with verifiable, feedback-driven language models
Manan Roy Choudhury, Suparno Roy Chowdhury, Swastik Sahoo +5
Systematic reviews condense clinical trials into evidence tables, yet clinicians can interrogate these tables only through database queries, and many questions concern attributes t…
SentryLine: Evidence-Grounded Question Answering over Evolving Documents in Oncology Care
Tampu Ravi Kumar, Gaurav Najpande, Muhammad Ali Khan +7
Oncology care operates at constant pressure of absorbing rapidly evolving evidence base in biomedicine. The American Society of Clinical Oncology (ASCO) addresses this through livi…
CIPHER: Benchmarking Cross-record Inference over Privacy-Hardened Evidence Records
Suparno Roy Chowdhury, Manan Roy Choudhury, Dhruv Madhwal +1
Reasoning over privacy-constrained records requires combining structured attributes with evidence from free-text narratives. We introduce CIPHER (Cross-record Inference over Privac…
SCOPE:Planning for Hybrid Querying over Clinical Trial Data
Suparno Roy Chowdhury, Manan Roy Choudhury, Tejas Anvekar +5
We study clinical trial table reasoning, where answers are not directly stored in visible cells but must be reasoned from semantic understanding through normalization, classificati…
FD-NL2SQL: Feedback-Driven Clinical NL2SQL that Improves with Use
Suparno Roy Chowdhury, Tejas Anvekar, Manan Roy Choudhury +5
Clinicians exploring oncology trial repositories often need ad-hoc, multi-constraint queries over biomarkers, endpoints, interventions, and time, yet writing SQL requires schema ex…
FinRule-Bench: A Benchmark for Joint Reasoning over Financial Tables and Principles
Arun Vignesh Malarkkan, Manan Roy Choudhury, Guangwei Zhang +4
Large language models (LLMs) are increasingly applied to financial analysis, yet their ability to audit structured financial statements under explicit accounting principles remains…
REaR: Retrieve, Expand and Refine for Effective Multitable Retrieval
Rishita Agarwal, Himanshu Singhal, Peter Baile Chen +3
Answering natural language queries over relational data often requires retrieving and reasoning over multiple tables, yet most retrievers optimize only for query-table relevance an…
Better Call CLAUSE: A Discrepancy Benchmark for Auditing LLMs Legal Reasoning Capabilities
Manan Roy Choudhury, Adithya Chandramouli, Mannan Anand +1
The rapid integration of large language models (LLMs) into high-stakes legal work has exposed a critical gap: no benchmark exists to systematically stress-test their reliability ag…