4 papers
Trace Integrity for LLM Data Agents: Auditing Structured-Data Computation Beyond Answer Accuracy in Real-World Systems
Srimonti Dutta, Akshata Kishore Moharir
Large language model (LLM) data agents answer structured-data questions by generating SQL, invoking tools, executing queries, and summarizing results. In operational settings, reli…
AgentRiskBOM: A Risk-Scoping Security Bill of Materials for Agentic AI Systems
Srimonti Dutta, Akshata Kishore Moharir
Agentic AI systems retrieve private context, invoke tools, write files, call external services, coordinate with other agents, and may act without human approval. Existing bill of m…
Mental Health AI Safety Claims Must Preserve Temporal Evidence
Srimonti Dutta, Ratna Kandala
The safety of mental health AI is often judged at the wrong temporal scale. Current evaluations typically score isolated responses, endpoint outcomes, or aggregate dialogue quality…
Stability vs. Manipulability: Evaluating Robustness Under Post-Decision Interaction in LLM Judges
Srimonti Dutta, Akshata Kishore Moharir
LLM-as-judge evaluation is widely used in benchmarking pipelines, where model outputs are compared and ranked using automated evaluators. These pipelines typically assume that judg…