1 citations · 1 across the 7 of their papers we have counts for
5 papers · 1 filter
Lattice Deduction Transformers
Liam Davis, Leopold Haller, Alberto Alfarano +1
We introduce the Lattice Deduction Transformer (LDT), a recurrent transformer that approximates logically sound deduction by projecting its latent state through a lattice between f…
On the origin of neural scaling laws: from random graphs to natural language
Maissam Barkeshli, Alberto Alfarano, Andrey Gromov
Scaling laws have played a major role in the modern AI revolution, providing practitioners predictive power over how the model performance will improve with increasing data, comput…
TAPAS: Datasets for Learning the Learning with Errors Problem
Eshika Saxena, Alberto Alfarano, François Charton +2
AI-powered attacks on Learning with Errors (LWE), an important hard math problem in post-quantum cryptography, rival or outperform "classical" attacks on LWE under certain paramete…
Global Lyapunov functions: a long-standing open problem in mathematics, with symbolic transformers
Alberto Alfarano, François Charton, Amaury Hayat
Despite their spectacular progress, language models still struggle on complex reasoning tasks, such as advanced mathematics. We consider a long-standing open problem in mathematics…
Making Hard Problems Easier with Custom Data Distributions and Loss Regularization: A Case Study in Modular Arithmetic
Eshika Saxena, Alberto Alfarano, François Charton +3
Recent work showed that ML-based attacks on Learning with Errors (LWE), a hard problem used in post-quantum cryptography, outperform classical algebraic attacks in certain settings…