4 papers · 1 filter
RAGStress: A controlled benchmark for evaluating retrieval-augmented generation under knowledge-base degradation
Shiqi Yang, Jiekai Ma, Gaoyuan Du
Retrieval-Augmented Generation (RAG) is typically evaluated under the implicit assumption that the underlying knowledge base (KB) is clean, leaving the behaviour of RAG systems und…
From Accuracy to Auditability: A Survey of Determinism in Financial AI Systems
Ruizhe Zhou, Xiaoyang Liu, Gaoyuan Du +4
Deploying machine learning in regulated financial environments -- credit risk, fraud detection, and anti-money laundering -- exposes critical vulnerabilities in algorithmic reprodu…
A Framework for Assessing AI Agent Decisions and Outcomes in AutoML Pipelines
Gaoyuan Du, Amit Ahlawat, Xiaoyang Liu +1
Agent-based AutoML systems rely on large language models to make complex, multi-stage decisions across data processing, model selection, and evaluation. However, existing evaluatio…
Cross-Modal Memory Compression for Efficient Multi-Agent Debate
Jing Wu, Yue Sun, Tianpei Xie +7
Multi-agent debate can improve reasoning quality and reduce hallucinations, but it incurs rapidly growing context as debate rounds and agent count increase. Retaining full textual…