Double-Take: Improving Capacity, Binding, and Selectivity In Long-Context Within Bidirectional Memory

Vakul Raghavan, Utkarsh Grover, Mingyang Mao +2

Processing a long sequence does not guarantee that distant information remains usable. As context grows, a fixed-size memory must retain many associations, connect information acro…