2 citations · 2 across the 6 of their papers we have counts for
Showing 2025Show all
2 papers · 1 filter
cs.CL2025
DINT Transformer
Yueyang Cang, Yuhang Liu, Xiaoteng Zhang +2
DIFF Transformer addresses the issue of irrelevant context interference by introducing a differential attention mechanism that enhances the robustness of local attention. However,…
cs.LG2025
Shared DIFF Transformer
Yueyang Cang, Yuhang Liu, Xiaoteng Zhang +2
DIFF Transformer improves attention allocation by enhancing focus on relevant context while suppressing noise. It introduces a differential attention mechanism that calculates the…