1 citations · 1 across the 7 of their papers we have counts for
3 papers · 1 filter
GAICo: A Deployed and Extensible Framework for Evaluating Diverse and Multimodal Generative AI Outputs
Nitin Gupta, Pallav Koppisetti, Kausik Lakkaraju +1
The rapid proliferation of Generative AI (GenAI) into diverse, high-stakes domains necessitates robust and reproducible evaluation methods. However, practitioners often resort to a…
FABLE: A Novel Data-Flow Analysis Benchmark on Procedural Text for Large Language Model Evaluation
Vishal Pallagani, Nitin Gupta, John Aydin +1
Understanding how data moves, transforms, and persists, known as data flow, is fundamental to reasoning in procedural tasks. Despite their fluency in natural and programming langua…
SafeChat: A Framework for Building Trustworthy Collaborative Assistants and a Case Study of its Usefulness
Biplav Srivastava, Kausik Lakkaraju, Nitin Gupta +3
Collaborative assistants, or chatbots, are data-driven decision support systems that enable natural interaction for task completion. While they can meet critical needs in modern so…