activity
20232026
most citedHow Do Transformers Learn In-Context Beyond Simple Functions? A Case Study on Learning with Representations

2 citations · 2 across the 12 of their papers we have counts for

collaborators
Showing cs.CLShow all

1 paper · 1 filter

cs.CL2026

Erase-then-Delta Attention: Decoupling Erase and Write Addresses in Delta-Rule Linear Attention

Xiao Li, Chengruidong Zhang, Hao Luo +15

Delta-rule linear attention improves recurrent memory updates by correcting what is already stored at the current write address before writing new content. However, the active corr…