1 paper · 1 filter
Xiaoyu Chen, Ruichen Wang, Jieming Di +21
Modeling of long history data suffers from long-context window attention dilution, system efficiency and catastrophic forgetting problems, where naive linear scaling approach like…