10 citations · 38 across the 45 of their papers we have counts for
3 papers · 2 filters
Universal Properties of Activation Sparsity in Modern Large Language Models
Filip Szatkowski, Patryk Będkowski, Alessio Devoto +5
Activation sparsity is an intriguing property of deep neural networks that has been extensively studied in ReLU-based models, due to its advantages for efficiency, robustness, and…
Neurosymbolic Reasoning Shortcuts under the Independence Assumption
Emile van Krieken, Pasquale Minervini, Edoardo Ponti +1
The ubiquitous independence assumption among symbolic concepts in neurosymbolic (NeSy) predictors is a convenient simplification: NeSy predictors use it to speed up probabilistic r…
Neurosymbolic Diffusion Models
Emile van Krieken, Pasquale Minervini, Edoardo Ponti +1
Neurosymbolic (NeSy) predictors combine neural perception with symbolic reasoning to solve tasks like visual reasoning. However, standard NeSy predictors assume conditional indepen…