2 papers
cs.DC2025
EcoServe: Designing Carbon-Aware AI Inference Systems
Yueying Li, Zhanqiu Hu, Esha Choukse +3
The rapid increase in LLM ubiquity and scale levies unprecedented demands on computing infrastructure. These demands not only incur large compute and memory resources but also sign…
cs.CR2024
Efficient Privacy-Preserving Machine Learning with Lightweight Trusted Hardware
Pengzhi Huang, Thang Hoang, Yueying Li +2
In this paper, we propose a new secure machine learning inference platform assisted by a small dedicated security processor, which will be easier to protect and deploy compared to…