2 citations · 3 across the 6 of their papers we have counts for
3 papers · 1 filter
What Does It Mean to Be a Transformer? Insights from a Theoretical Hessian Analysis
Weronika Ormaniec, Felix Dangel, Sidak Pal Singh
The Transformer architecture has inarguably revolutionized deep learning, overtaking classical architectures like multi-layer perceptrons (MLPs) and convolutional neural networks (…
Standardizing Structural Causal Models
Weronika Ormaniec, Scott Sussex, Lars Lorch +2
Synthetic datasets generated by structural causal models (SCMs) are commonly used for benchmarking causal structure learning algorithms. However, the variances and pairwise correla…
Transition Constrained Bayesian Optimization via Markov Decision Processes
Jose Pablo Folch, Calvin Tsay, Robert M Lee +6
Bayesian optimization is a methodology to optimize black-box functions. Traditionally, it focuses on the setting where you can arbitrarily query the search space. However, many rea…