7 papers
Auditing Escalation Reliability in Healthcare LLM Agents: A Perturbation-Controlled Benchmark of Workflow-State Failures
Zihao Zheng, Junyi Yao, Baichuan Li +1
Trustworthy biomedical AI requires reliable action selection when evidence is missing, stale, conflicting, or late, not only accurate answers on static inputs. We instantiate an ep…
Engineering Reliable Commit Gates for Agentic AI: Cost-Aware Verification Portfolios under Common-Mode Data Failures
Zihao Zheng, Baichuan Li, Junyi Yao +1
Agentic systems commit state-changing actions, but additional verifiers can inherit the same upstream fault. We present VP-CONTROL, a runtime-assurance design and deterministic ben…
Toward Workflow-Aware Benchmarking for Healthcare NLP Agents
Junyi Yao, Baichuan Li, Zihao Zheng +1
Large language model (LLM) agents are increasingly proposed for healthcare tasks such as clinical documentation, evidence retrieval, patient messaging, and care coordination. Yet m…
Reliable Financial Named Entity Recognition Under Domain Shift: Confidence Estimation and Selective Prediction
Zihao Zheng, Baichuan Li, Junyi Yao +1
Financial AI systems often train information extractors on one textual register and deploy them across filings, news, and user-generated content, and standard F1 scores do not indi…
Remember, Verify, or Ask? Evaluating Memory Decisions at Reuse Time
Baichuan Li, Junyi Yao, Zihao Zheng
Persistent memory can personalize an LLM agent, but an incorrect durable update can silently distort future behavior. We study the memory-clarification boundary: whether interactio…
Beyond Helpfulness: A Teaching-over-Solving Diagnostic for Measuring Educational Impact in LLM Tutors
Junyi Yao, Zihao Zheng, Baichuan Li
Large language models are increasingly proposed as educational tutors, yet stronger task-solving ability does not necessarily imply stronger learning support. Motivated by recent c…
The Jaseci Programming Paradigm and Runtime Stack: Building Scale-out Production Applications Easy and Fast
Jason Mars, Yiping Kang, Roland Daynauth +4
Today's production scale-out applications include many sub-application components, such as storage backends, logging infrastructure and AI models. These components have drastically…