40 citations · 42 across the 12 of their papers we have counts for
4 papers · 1 filter
Deriving Transformer Architectures as Implicit Multinomial Regression
Jonas A. Actor, Anthony Gruber, Eric C. Cyr
While attention has been empirically shown to improve model performance, it lacks a rigorous mathematical justification. This short paper establishes a novel connection between att…
Discovery of Probabilistic Dirichlet-to-Neumann Maps on Graphs
Adrienne M. Propp, Jonas A. Actor, Elise Walker +3
Dirichlet-to-Neumann maps enable the coupling of multiphysics simulations across computational subdomains by ensuring continuity of state variables and fluxes at artificial interfa…
Leveraging KANs for Expedient Training of Multichannel MLPs via Preconditioning and Geometric Refinement
Jonas A. Actor, Graham Harper, Ben Southworth +1
Multilayer perceptrons (MLPs) are a workhorse machine learning architecture, used in a variety of modern deep learning frameworks. However, recently Kolmogorov-Arnold Networks (KAN…
Mixture of neural operator experts for learning boundary conditions and model selection
Dwyer Deighan, Jonas A. Actor, Ravi G. Patel
While Fourier-based neural operators are best suited to learning mappings between functions on periodic domains, several works have introduced techniques for incorporating non triv…