most citedSPECTRE: An FFT-Based Efficient Drop-In Replacement to Self-Attention for Long Contexts

1 citations · 1 across the 1 of their papers we have counts for

collaborators

1 paper

cs.LG2025★ 1 cited

SPECTRE: An FFT-Based Efficient Drop-In Replacement to Self-Attention for Long Contexts

Jacob Fein-Ashley, Neelesh Gupta, Rajgopal Kannan +1

Long-context transformers face significant efficiency challenges due to the quadratic cost of self-attention. However, many modern applications-from multi-turn dialogue to high-res…