OnlineCache: Learning Dynamic Caching Policies with Error Correction for Efficient Diffusion Inference

Zhikang Xie, Xichen Ye, Yifan Wu +5

Diffusion models have revolutionized generative tasks but incur high latency due to iterative denoising. While cache-based strategies accelerate inference by reusing intermediate f…