3 papers
cs.LG2025
Domain-Decomposed Graph Neural Network Surrogate Modeling for Ice Sheets
Adrienne M. Propp, Mauro Perego, Eric C. Cyr +5
Accurate yet efficient surrogate models are essential for large-scale simulations of partial differential equations (PDEs), particularly for uncertainty quantification (UQ) tasks t…
cs.LG2025
Deriving Transformer Architectures as Implicit Multinomial Regression
Jonas A. Actor, Anthony Gruber, Eric C. Cyr
While attention has been empirically shown to improve model performance, it lacks a rigorous mathematical justification. This short paper establishes a novel connection between att…
cs.LG2025
Leveraging KANs for Expedient Training of Multichannel MLPs via Preconditioning and Geometric Refinement
Jonas A. Actor, Graham Harper, Ben Southworth +1
Multilayer perceptrons (MLPs) are a workhorse machine learning architecture, used in a variety of modern deep learning frameworks. However, recently Kolmogorov-Arnold Networks (KAN…