2 papers
cs.DC2024
SYMPHONY: Improving Memory Management for LLM Inference Workloads
Saurabh Agarwal, Anyong Mao, Aditya Akella +1
Large Language Models (LLMs) are increasingly being deployed in applications such as chatbots, code editors, and conversational agents. A key feature of LLMs is their ability to en…
cs.CV2023
Fast Sparse 3D Convolution Network with VDB
Fangjun Zhou, Anyong Mao, Eftychios Sifakis
We proposed a new Convolution Neural Network implementation optimized for sparse 3D data inference. This implementation uses NanoVDB as the data structure to store the sparse tenso…