Exact Finite Attention Responses From RoPE Derivatives

Julie Huang, Maggie Chlon, Gregory Gutin +1

We derive exact local responses for attention interventions, allowing candidate edits to be scored from a cached baseline and one backward pass. The starting point is the RoPE deri…