Showing 2026Show all
2 papers · 1 filter
cs.DC2026
Ekka: Automated Diagnosis of Silent Errors in LLM Inference
Yile Gu, Zhen Zhang, Shaowei Zhu +4
LLM serving frameworks are quickly evolving with a complex software stack and a vast number of optimizations. The rapid development process can introduce silent errors where output…
cs.DB2026
CACTUSDB: Unlock Co-Optimization Opportunities for SQL and AI/ML Inferences
Lixi Zhou, Kanchan Chowdhury, Lulu Xie +5
There is a growing demand for supporting inference queries that combine Structured Query Language (SQL) and Artificial Intelligence / Machine Learning (AI/ML) model inferences in d…