65 citations · 143 across the 21 of their papers we have counts for
Showing 2024Show all
2 papers · 1 filter
cs.IT2024
Polynomial Freiman-Ruzsa, Reed-Muller codes and Shannon capacity
Emmanuel Abbe, Colin Sandon, Vladyslav Shashkov +1
In 1948, Shannon used a probabilistic argument to show the existence of codes achieving a maximal rate defined by the channel capacity. In 1954, Muller and Reed introduced a simple…
cs.LG2024
How Far Can Transformers Reason? The Globality Barrier and Inductive Scratchpad
Emmanuel Abbe, Samy Bengio, Aryo Lotfi +2
Can Transformers predict new syllogisms by composing established ones? More generally, what type of targets can be learned by such models from scratch? Recent works show that Trans…