8 citations · 21 across the 17 of their papers we have counts for
3 papers · 1 filter
All or None: Identifiable Linear Properties of Next-token Predictors in Language Modeling
Emanuele Marconato, Sébastien Lachapelle, Sebastian Weichwald +1
We analyze identifiability as a possible explanation for the ubiquity of linear properties across language models, such as the vector difference between the representations of "eas…
A Neuro-Symbolic Benchmark Suite for Concept Quality and Reasoning Shortcuts
Samuele Bortolotti, Emanuele Marconato, Tommaso Carraro +5
The advent of powerful neural classifiers has increased interest in problems that require both learning and reasoning. These problems are critical for understanding important prope…
BEARS Make Neuro-Symbolic Models Aware of their Reasoning Shortcuts
Emanuele Marconato, Samuele Bortolotti, Emile van Krieken +3
Neuro-Symbolic (NeSy) predictors that conform to symbolic knowledge - encoding, e.g., safety constraints - can be affected by Reasoning Shortcuts (RSs): They learn concepts consist…