4 papers
Alice's Adventures in a Differentiable Wonderland -- Volume I, A Tour of the Land
Simone Scardapane
Neural networks surround us, in the form of large language models, speech transcription systems, molecular discovery algorithms, robotics, and much more. Stripped of anything else,…
NACHOS: Neural Architecture Search for Hardware Constrained Early Exit Neural Networks
Matteo Gambella, Jary Pomponi, Simone Scardapane +1
Early Exit Neural Networks (EENNs) endow astandard Deep Neural Network (DNN) with Early Exit Classifiers (EECs), to provide predictions at intermediate points of the processing whe…
Hypergraph Neural Networks through the Lens of Message Passing: A Common Perspective to Homophily and Architecture Design
Lev Telyatnikov, Maria Sofia Bucarelli, Guillermo Bernardez +3
Most of the current hypergraph learning methodologies and benchmarking datasets in the hypergraph realm are obtained by lifting procedures from their graph analogs, leading to over…
Adaptive Computation Modules: Granular Conditional Computation For Efficient Inference
Bartosz Wójcik, Alessio Devoto, Karol Pustelnik +2
While transformer models have been highly successful, they are computationally inefficient. We observe that for each layer, the full width of the layer may be needed only for a sma…