Showing 2024 · stat.MLShow all
2 papers · 2 filters
stat.ML2024
Attention layers provably solve single-location regression
Pierre Marion, Raphaël Berthier, Gérard Biau +1
Attention-based models, such as Transformer, excel across various tasks but lack a comprehensive theoretical understanding, especially regarding token-wise sparsity and internal li…
stat.ML2024
Physics-informed kernel learning
Nathan Doumèche, Francis Bach, Gérard Biau +1
Physics-informed machine learning typically integrates physical priors into the learning process by minimizing a loss function that includes both a data-driven term and a partial d…