133 citations · 570 across the 37 of their papers we have counts for
3 papers · 1 filter
xVal: A Continuous Numerical Tokenization for Scientific Language Models
Siavash Golkar, Mariel Pettee, Michael Eickenberg +11
Due in part to their discontinuous and discrete default encodings for numbers, Large Language Models (LLMs) have not yet been commonly used to process numerically-dense scientific…
An online algorithm for contrastive Principal Component Analysis
Siavash Golkar, David Lipshutz, Tiberiu Tesileanu +1
Finding informative low-dimensional representations that can be computed efficiently in large datasets is an important problem in data analysis. Recently, contrastive Principal Com…
Backdrop: Stochastic Backpropagation
Siavash Golkar, Kyle Cranmer
We introduce backdrop, a flexible and simple-to-implement method, intuitively described as dropout acting only along the backpropagation pipeline. Backdrop is implemented via one o…