Showing cs.LGShow all
3 papers · 1 filter
cs.LG2025
Universal Properties of Activation Sparsity in Modern Large Language Models
Filip Szatkowski, Patryk Będkowski, Alessio Devoto +5
Activation sparsity is an intriguing property of deep neural networks that has been extensively studied in ReLU-based models, due to its advantages for efficiency, robustness, and…
cs.LG2025
Adaptive Semantic Token Communication for Transformer-based Edge Inference
Alessio Devoto, Jary Pomponi, Mattia Merluzzi +2
This paper presents an adaptive framework for edge inference based on a dynamically configurable transformer-powered deep joint source channel coding (DJSCC) architecture. Motivate…
cs.LG2024
Goal-oriented Communications based on Recursive Early Exit Neural Networks
Jary Pomponi, Mattia Merluzzi, Alessio Devoto +3
This paper presents a novel framework for goal-oriented semantic communications leveraging recursive early exit models. The proposed approach is built on two key components. First,…