9 citations · 9 across the 2 of their papers we have counts for
3 papers
cs.LG2022
What is my math transformer doing? -- Three results on interpretability and generalization
François Charton
This paper investigates the failure cases and out-of-distribution behavior of transformers trained on matrix inversion and eigenvalue decomposition. I show that incorrect model pre…
cs.LG2022★ 9 cited
End-to-end symbolic regression with transformers
Pierre-Alexandre Kamienny, Stéphane d'Ascoli, Guillaume Lample +1
Symbolic regression, the task of predicting the mathematical expression of a function from the observation of its values, is a difficult task which usually involves a two-step proc…
cs.LG2020
Learning advanced mathematical computations from examples
François Charton, Amaury Hayat, Guillaume Lample
Using transformers over large generated datasets, we train models to learn mathematical properties of differential systems, such as local stability, behavior at infinity and contro…