8 citations · 8 across the 2 of their papers we have counts for
3 papers
Kalypso: Relational LLM Serving
Hojae Son, Md Ashraful Islam, Huy Gia Cao +2
Large language models are increasingly used as semantic operators for filtering, extracting, ranking, joining, and transforming unstructured data. Existing semantic query processin…
WildFit: Autonomous In-situ Model Adaptation for Resource-Constrained IoT Systems
Mohammad Mehdi Rastikerdar, Jin Huang, Hui Guan +1
Resource-constrained IoT devices increasingly rely on deep learning models, however, these models experience significant accuracy drops due to domain shifts when encountering varia…
Loki: A System for Serving ML Inference Pipelines with Hardware and Accuracy Scaling
Sohaib Ahmad, Hui Guan, Ramesh K. Sitaraman
The rapid adoption of machine learning (ML) has underscored the importance of serving ML models with high throughput and resource efficiency. Traditional approaches to managing inc…