4 papers
Locate, Judge, Read: Role-Specialized Tool Agents over a Knowledge-Point Index for Open-Domain Multimodal Document QA
Wenlin Lin, Fanzhe Wei
Question answering over large heterogeneous document collections requires first finding the right passages and then reading them, yet current retrieval-augmented agents give one mo…
Pricing the Risk of Runtime Compression: Anytime-Valid Admission and a Served-Output Law for Compressed Serving State
Fanzhe Wei, Li Liu
Runtime compression of serving state trades quality for capacity with no priced guarantee: systems adapt precision on load signals with no soundness statement, and certified approa…
Runtime Observability for Heterogeneous Attention Memory
Fanzhe Wei, Li Liu, Ziyang Wang +1
Modern models no longer keep a plain KV cache: latent caches, learned sparse selectors and recurrent states each carry the model's memory in a different form, and each fails differ…
WitCert: Sound Runtime Risk Observability and Gating for KV-Cache Quantization
Fanzhe Wei, Li Liu, Ziyang Wang +1
KV-cache quantization is validated today by offline benchmark averages; a deployed system cannot tell whether compression is damaging the request it is serving right now. We give i…