2 citations · 5 across the 6 of their papers we have counts for
1 paper · 1 filter
Nadav Schneider, Itamar Zimerman, Eliya Nachmani
Sequence models like Transformers and RNNs often overallocate attention to irrelevant context, leading to noisy intermediate representations. This degrades LLM capabilities by prom…