adaptive computation 1attention mechanisms 1efficient inference 1transformers 1vector quantization 1
From the 1 of 2 linked papers with an AI index.
2 papers
cs.LG2026
AVQ-Attention: Adaptive Vector-Quantized Attention
Winfried van den dool, Patrick Forré, Amir Habibian +2
The paper introduces Adaptive Vector-Quantized (AVQ) Attention, which dynamically allocates codebook capacity to the most important regions of the key space, preserving O(MN) compl…
cs.LG2025
Adaptive Mesh-Quantization for Neural PDE Solvers
Winfried van den Dool, Maksim Zhdanov, Yuki M. Asano +1
Physical systems commonly exhibit spatially varying complexity, presenting a significant challenge for neural PDE solvers. While Graph Neural Networks can handle the irregular mesh…