5 citations · 5 across the 4 of their papers we have counts for
5 papers
FLASHSWIN: Unlocking Large Windows and Dense Tokens in Swin Vision Transformers with Memory Efficient Attention
Tushar Kataria, Gerald Sabin, Ponnuswamy Sadayappan +1
High-resolution vision backbones have long been forced to trade away local token density to afford larger receptive fields. Hierarchical Swin transformers impose this compromise be…
Fast Algorithms for Scheduling Many-body Correlation Functions on Accelerators
Oguz Selvitopi, Emin Ozturk, Jie Chen +3
Computation of correlation functions is a key operation in Lattice quantum chromodynamics (LQCD) simulations to extract nuclear physics observables. These functions involve many bi…
Optimizing Data Distribution and Kernel Performance for Efficient Training of Chemistry Foundation Models: A Case Study with MACE
Jesun Firoz, Franco Pellegrini, Mario Geiger +17
Chemistry Foundation Models (CFMs) that leverage Graph Neural Networks (GNNs) operating on 3D molecular graph structures are becoming indispensable tools for computational chemists…
TopV: Compatible Token Pruning with Inference Time Optimization for Fast and Low-Memory Multimodal Vision Language Model
Cheng Yang, Yang Sui, Jinqi Xiao +8
Vision-Language Models (VLMs) demand substantial computational resources during inference, largely due to the extensive visual input tokens for representing visual information. Pre…
What Operations can be Performed Directly on Compressed Arrays, and with What Error?
Tripti Agarwal, Harvey Dam, Dorra Ben Khalifa +3
In response to the rapidly escalating costs of computing with large matrices and tensors caused by data movement, several lossy compression methods have been developed to significa…