3 papers
cs.DB2025
FeatInsight: An Online ML Feature Management System on 4Paradigm Sage-Studio Platform
Xin Tong, Xuanhe Zhou, Bingsheng He +6
Feature management is essential for many online machine learning applications and can often become the performance bottleneck (e.g., taking up to 70% of the overall latency in sale…
cs.LG2025
LogQuant: Log-Distributed 2-Bit Quantization of KV Cache with Superior Accuracy Preservation
Han Chen, Zicong Jiang, Zining Zhang +4
We introduce LogQuant, a groundbreaking 2-bit quantization technique for KV Cache in large language model (LLM) inference, delivering substantial memory savings while preserving su…
cs.DB2025
OpenMLDB: A Real-Time Relational Data Feature Computation System for Online ML
Xuanhe Zhou, Wei Zhou, Liguo Qi +7
Efficient and consistent feature computation is crucial for a wide range of online ML applications. Typically, feature computation is divided into two distinct phases, i.e., offlin…