Context-Driven Performance Modeling for Causal Inference Operators on Neural Processing Units

Neelesh Gupta, Rakshith Jayanth, Dhruv Parikh +1

The proliferation of large language models has driven demand for long-context inference on resource-constrained edge platforms. However, deploying these models on Neural Processing…