3 papers
cs.DC2025
TD-Pipe: Temporally-Disaggregated Pipeline Parallelism Architecture for High-Throughput LLM Inference
Hongbin Zhang, Taosheng Wei, Zhenyi Zheng +3
As the model size continuously increases, pipeline parallelism shows great promise in throughput-oriented LLM inference due to its low demand on communications. However, imbalanced…
cs.CV2024
Stable Diffusion Segmentation for Biomedical Images with Single-step Reverse Process
Tianyu Lin, Zhiguang Chen, Zhonghao Yan +2
Diffusion models have demonstrated their effectiveness across various generative tasks. However, when applied to medical image segmentation, these models encounter several challeng…
cs.DB2024
DumpKV: Learning based lifetime aware garbage collection for key value separation in LSM-tree
Zhutao Zhuang, Xinqi Zeng, Zhiguang Chen
Key\-value separation is used in LSM\-tree to stored large value in separate log files to reduce write amplification, but requires garbage collection to garbage collect invalid val…