Showing 2024Show all
3 papers · 1 filter
stat.ML2024
Attention layers provably solve single-location regression
Pierre Marion, Raphaël Berthier, Gérard Biau +1
Attention-based models, such as Transformer, excel across various tasks but lack a comprehensive theoretical understanding, especially regarding token-wise sparsity and internal li…
stat.ML2024
Physics-informed kernel learning
Nathan Doumèche, Francis Bach, Gérard Biau +1
Physics-informed machine learning typically integrates physical priors into the learning process by minimizing a loss function that includes both a data-driven term and a partial d…
cs.AI2024
Physics-informed machine learning as a kernel method
Nathan Doumèche, Francis Bach, Gérard Biau +1
Physics-informed machine learning combines the expressiveness of data-based approaches with the interpretability of physical models. In this context, we consider a general regressi…