1 citations · 1 across the 7 of their papers we have counts for
Showing cs.LGShow all
3 papers · 1 filter
cs.LG2026
On the Value of Tokeniser Pretraining in Physics Foundation Models
Hadi Sotoudeh, Payel Mukhopadhyay, Ruben Ohana +4
We investigate the impact of tokeniser pretraining on the accuracy and efficiency of physics emulation. Modern high-resolution simulations produce vast volumes of data spanning div…
cs.LG2025
Transformers as Unrolled Inference in Probabilistic Laplacian Eigenmaps: An Interpretation and Potential Improvements
Aditya Ravuri, Neil D. Lawrence
We propose a probabilistic interpretation of transformers as unrolled inference steps assuming a probabilistic Laplacian Eigenmaps model from the ProbDR framework. Our derivation s…
cs.LG2025
Protein Language Model Zero-Shot Fitness Predictions are Improved by Inference-only Dropout
Aditya Ravuri, Neil D. Lawrence
Protein Language Models (PLMs) such as ESM2 have been shown to be capable of zero-shot prediction of critical scalar properties of proteins (fitness). In this work, we show that in…