4 papers
EchoPress: Query-Agnostic KV Cache Pruning via Virtual Context Reconstruction
Jiawei Lin, Saibo Geng, Thomas Bourgeat
KV cache pruning reduces long-context inference memory usage by evicting less important key-value pairs. KVzip estimates importance through context reconstruction: prompting a mode…
SystolicAttention: Fusing FlashAttention within a Single Systolic Array
Jiawei Lin, Yuanlong Li, Guokai Chen +1
Transformer models rely heavily on the scaled dot-product attention (SDPA) operation, typically implemented as FlashAttention. Characterized by its frequent interleaving of matrix…
A probabilistic Hadwiger-Nelson problem
Thomas Bourgeat, Marc Heinrich, Paul Melotti +1
If you color a table using k colors, and throw a needle randomly on it, for some proper definition, you get a certain probability that the endpoints will fall on different colors.…
New Algorithmic Approaches to Point Constellation Recognition
Thomas Bourgeat, Julien Bringer, Herve Chabanne +7
Point constellation recognition is a common problem with many pattern matching applications. Whilst useful in many contexts, this work is mainly motivated by fingerprint matching.…