1 citations · 1 across the 3 of their papers we have counts for
4 papers
Continual Learning Bench: Evaluating Frontier AI Systems in Real-World Stateful Environments
Parth Asawa, Christopher M. Glaze, Gabriel Orlanski +7
Continual learning, the ability of AI systems to improve through sequential experience, has attracted substantial interest, but no high-quality benchmark exists to evaluate it. We…
Benchmarking Agents in Insurance Underwriting Environments
Amanda Dsouza, Ramya Ramakrishnan, Charles Dickens +2
As AI agents integrate into enterprise applications, their evaluation demands benchmarks that reflect the complexity of real-world operations. Instead, existing benchmarks overemph…
Workflow-Guided Response Generation for Task-Oriented Dialogue
Do June Min, Paloma Sodhi, Ramya Ramakrishnan
Task-oriented dialogue (TOD) systems aim to achieve specific goals through interactive dialogue. Such tasks usually involve following specific workflows, i.e. executing a sequence…
Multi-Step Dialogue Workflow Action Prediction
Ramya Ramakrishnan, Ethan R. Elenberg, Hashan Narangodage +1
In task-oriented dialogue, a system often needs to follow a sequence of actions, called a workflow, that complies with a set of guidelines in order to complete a task. In this pape…