ICaRus: Identical Cache Reuse for Efficient Multi Model Inference

Sunghyeon Woo, Jaeeun Kil, Hoseung Kim +9

Multi model inference has recently emerged as a prominent paradigm, particularly in the development of agentic AI systems. However, in such scenarios, each model must maintain its…