TriGen: NPU Architecture for End-to-End Acceleration of Large Language Models based on SW-HW Co-Design

Jonghun Lee, Junghoon Lee, Hyeonjin Kim +5

Recent studies have extensively explored NPU architectures for accelerating AI inference in on-device environments, which are inherently resource-constrained. Meanwhile, transforme…