273 citations · 751 across the 44 of their papers we have counts for
4 papers · 2 filters
RelFlexformer: Efficient Attention 3D-Transformers for Integrable Relative Positional Encodings
Byeongchan Kim, Arijit Sehanobish, Avinava Dubey +2
We present a new class of efficient attention mechanisms applying universal 3D Relative Positional Encoding (RPE) methods given by arbitrary integrable modulation functions . Th…
Inference-time Unlearning Using Conformal Prediction
Somnath Basu Roy Chowdhury, Rahul Kidambi, Avinava Dubey +4
Machine unlearning is the process of efficiently removing specific information from a trained machine learning model without retraining from scratch. Existing unlearning methods, w…
EUGens: Efficient, Unified, and General Dense Layers
Sang Min Kim, Byeongchan Kim, Arijit Sehanobish +7
Efficient neural networks are essential for scaling machine learning models to real-time applications and resource-constrained environments. Fully-connected feedforward layers (FFL…
SWING: Unlocking Implicit Graph Representations for Graph Random Features
Alessandro Manenti, Avinava Dubey, Arijit Sehanobish +2
We propose SWING: Space Walks for Implicit Network Graphs, a new class of algorithms for computations involving Graph Random Features on graphs given by implicit representations (i…