16 citations · 67 across the 16 of their papers we have counts for
16 papers
TensorHub: Scalable and Elastic Weight Transfer for LLM RL Training
Chenhao Ye, Huaizheng Zhang, Mingcong Han +11
Modern LLM reinforcement learning (RL) workloads require a high-performance weight transfer system to scale training across heterogeneous compute resources. However, efficiently tr…
PRIOR: Personalized Prior for Reactivating the Information Overlooked in Federated Learning
Mingjia Shi, Yuhao Zhou, Kai Wang +4
Classical federated learning (FL) enables training machine learning models without sharing data for privacy preservation, but heterogeneous data characteristic degrades the perform…
DataCI: A Platform for Data-Centric AI on Streaming Data
Huaizheng Zhang, Yizheng Huang, Yuanming Li
We introduce DataCI, a comprehensive open-source platform designed specifically for data-centric AI in dynamic streaming data settings. DataCI provides 1) an infrastructure with ri…
MIGPerf: A Comprehensive Benchmark for Deep Learning Training and Inference Workloads on Multi-Instance GPUs
Huaizheng Zhang, Yuanming Li, Wencong Xiao +7
New architecture GPUs like A100 are now equipped with multi-instance GPU (MIG) technology, which allows the GPU to be partitioned into multiple small, isolated instances. This tech…
Spatial-Temporal Federated Learning for Lifelong Person Re-identification on Distributed Edges
Lei Zhang, Guanyu Gao, Huaizheng Zhang
Data drift is a thorny challenge when deploying person re-identification (ReID) models into real-world devices, where the data distribution is significantly different from that of…
Active-Learning-as-a-Service: An Automatic and Efficient MLOps System for Data-Centric AI
Yizheng Huang, Huaizheng Zhang, Yuanming Li +2
The success of today's AI applications requires not only model training (Model-centric) but also data engineering (Data-centric). In data-centric AI, active learning (AL) plays a v…
ModelCI-e: Enabling Continual Learning in Deep Learning Serving Systems
Yizheng Huang, Huaizheng Zhang, Yonggang Wen +2
MLOps is about taking experimental ML models to production, i.e., serving the models to actual users. Unfortunately, existing ML serving systems do not adequately handle the dynami…
ModelPS: An Interactive and Collaborative Platform for Editing Pre-trained Models at Scale
Yuanming Li, Huaizheng Zhang, Shanshan Jiang +3
AI engineering has emerged as a crucial discipline to democratize deep neural network (DNN) models among software developers with a diverse background. In particular, altering thes…
A Serverless Cloud-Fog Platform for DNN-Based Video Analytics with Incremental Learning
Huaizheng Zhang, Meng Shen, Yizheng Huang +4
DNN-based video analytics have empowered many new applications (e.g., automated retail). Meanwhile, the proliferation of fog devices provides developers with more design options to…
InferBench: Understanding Deep Learning Inference Serving with an Automatic Benchmarking System
Huaizheng Zhang, Yizheng Huang, Yonggang Wen +2
Deep learning (DL) models have become core modules for many applications. However, deploying these models without careful performance benchmarking that considers both hardware and…
Hysia: Serving DNN-Based Video-to-Retail Applications in Cloud
Huaizheng Zhang, Yuanming Li, Qiming Ai +4
Combining \underline{v}ideo streaming and online \underline{r}etailing (V2R) has been a growing trend recently. In this paper, we provide practitioners and researchers in multimedi…
MLModelCI: An Automatic Cloud Platform for Efficient MLaaS
Huaizheng Zhang, Yuanming Li, Yizheng Huang +3
MLModelCI provides multimedia researchers and developers with a one-stop platform for efficient machine learning (ML) services. The system leverages DevOps techniques to optimize,…
Look, Read and Feel: Benchmarking Ads Understanding with Multimodal Multitask Learning
Huaizheng Zhang, Yong Luo, Qiming Ai +1
Given the massive market of advertising and the sharply increasing online multimedia content (such as videos), it is now fashionable to promote advertisements (ads) together with t…
Content-Aware Personalised Rate Adaptation for Adaptive Streaming via Deep Video Analysis
Guanyu Gao, Linsen Dong, Huaizheng Zhang +2
Adaptive bitrate (ABR) streaming is the de facto solution for achieving smooth viewing experiences under unstable network conditions. However, most of the existing rate adaptation…
ResumeNet: A Learning-based Framework for Automatic Resume Quality Assessment
Yong Luo, Huaizheng Zhang, Yongjie Wang +2
Recruitment of appropriate people for certain positions is critical for any companies or organizations. Manually screening to select appropriate candidates from large amounts of re…
DeepQoE: A unified Framework for Learning to Predict Video QoE
Huaizheng Zhang, Han Hu, Guanyu Gao +2
Motivated by the prowess of deep learning (DL) based techniques in prediction, generalization, and representation learning, we develop a novel framework called DeepQoE to predict v…