5 citations · 5 across the 7 of their papers we have counts for
7 papers
Total Cost of Agency: Exact Attribution of Memory Injection Cost in Multi-Agent LLM Workflows
Vivek Kumar Singh, Preeti Priyam, Gautam Bhowmick
Every node in a multi-agent large language model (LLM) workflow retrieves context from memory and injects it into its prompt, where those injected tokens are billed as input tokens…
ChurnBench: A Drift-Aware Benchmark Demonstrating That Refresh Scheduling, Not Cache Age, Governs Staleness in Agentic AI
Vivek Kumar Singh, Preeti Priyam, Gautam Bhowmick
In production, agentic systems answer questions over data that lives in several places and keeps changing: licenses are reassigned, users offboarded, prices changed, contracts rene…
An Empirical Study of Automating Agent Evaluation
Kang Zhou, Sangmin Woo, Haibo Ding +15
Agent evaluation requires assessing complex multi-step behaviors involving tool use and intermediate reasoning, making it costly and expertise-intensive. A natural question arises:…
Current Trends and Future Directions for Sexual Health Conversational Agents (CAs) for Youth: A Scoping Review
Jinkyung Katie Park, Vivek Singh, Pamela Wisniewski
Conversational Agents (CAs, chatbots) are systems with the ability to interact with users using natural human dialogue. While much of the research on CAs for sexual health has focu…
Collaborative Human-AI Risk Annotation: Co-Annotating Online Incivility with CHAIRA
Jinkyung Katie Park, Rahul Dev Ellezhuthil, Pamela Wisniewski +1
Collaborative human-AI annotation is a promising approach for various tasks with large-scale and complex data. Tools and methods to support effective human-AI collaboration for dat…
Leveraging Large Language Models (LLMs) to Support Collaborative Human-AI Online Risk Data Annotation
Jinkyung Park, Pamela Wisniewski, Vivek Singh
In this position paper, we discuss the potential for leveraging LLMs as interactive research tools to facilitate collaboration between human coders and AI to effectively annotate o…
Toward Safe Evolution of Artificial Intelligence (AI) based Conversational Agents to Support Adolescent Mental and Sexual Health Knowledge Discovery
Jinkyung Park, Vivek Singh, Pamela Wisniewski
Following the recent release of various Artificial Intelligence (AI) based Conversation Agents (CAs), adolescents are increasingly using CAs for interactive knowledge discovery on…