3 papers
cs.DB2025
Vortex: Hosting ML Inference and Knowledge Retrieval Services With Tight Latency and Throughput Requirements
Yuting Yang, Tiancheng Yuan, Jamal Hashim +6
There is growing interest in deploying ML inference and knowledge retrieval as services that could support both interactive queries by end users and more demanding request flows th…
cs.AI2024
AI-Based Teat Shape and Skin Condition Prediction for Dairy Management
Yuexing Hao, Tiancheng Yuan, Yuting Yang +4
Dairy owners spend significant effort to keep their animals healthy. There is good reason to hope that technologies such as computer vision and artificial intelligence (AI) could r…
cs.DC2023
Keep Your Friends Close: Leveraging Affinity Groups to Accelerate AI Inference Workflows
Thiago Garrett, Weijia Song, Roman Vitenberg +1
AI inference workflows are typically structured as a pipeline or graph of AI programs triggered by events. As events occur, the AIs perform inference or classification tasks under…