Technology solutions targeting the performance of gen-AI inference in resource constrained platforms

Joyjit Kundu, Joshua Klein, Aakash Patel +1

The rise of generative AI workloads, particularly language model inference, is intensifying on/off-chip memory pressure. Multimodal inputs such as video streams or images and downs…