3 papers
cs.LG2025
LL-ViT: Edge Deployable Vision Transformers with Look Up Table Neurons
Shashank Nag, Alan T. L. Bacellar, Zachary Susskind +9
Vision Transformers have been tremendously successful in computer vision tasks. However, their large computational, memory, and energy demands are a challenge for edge inference on…
cs.LG2025
Differentiable Weightless Neural Networks
Alan T. L. Bacellar, Zachary Susskind, Mauricio Breternitz +4
We introduce the Differentiable Weightless Neural Network (DWN), a model based on interconnected lookup tables. Training of DWNs is enabled by a novel Extended Finite Difference te…
cs.LG2024
Shrinking the Giant : Quasi-Weightless Transformers for Low Energy Inference
Shashank Nag, Alan T. L. Bacellar, Zachary Susskind +9
Transformers are set to become ubiquitous with applications ranging from chatbots and educational assistants to visual recognition and remote sensing. However, their increasing com…