2 papers
cs.DC2025
AIBrix: Towards Scalable, Cost-Effective Large Language Model Inference Infrastructure
The AIBrix Team, Jiaxin Shan, Varun Gupta +24
We introduce AIBrix, a cloud-native, open-source framework designed to optimize and simplify large-scale LLM deployment in cloud environments. Unlike traditional cloud-native stack…
cs.LG2025
GPU Memory Usage Optimization for Backward Propagation in Deep Network Training
Ding-Yong Hong, Tzu-Hsien Tsai, Ning Wang +2
In modern Deep Learning, it has been a trend to design larger Deep Neural Networks (DNNs) for the execution of more complex tasks and better accuracy. On the other hand, Convolutio…