1 citations · 2 across the 5 of their papers we have counts for
5 papers
Scaling LLM Pre-training with Vocabulary Curriculum
Fangyuan Yu
Modern language models rely on static vocabularies, fixed before pretraining, in contrast to the adaptive vocabulary acquisition observed in human language learning. To bridge this…
Iterative Graph Alignment
Fangyuan Yu, Hardeep Singh Arora, Matt Johnson
By compressing diverse narratives, LLMs go beyond memorization, achieving intelligence by capturing generalizable causal relationships. However, they suffer from local 'representat…
Multilevel Ensemble Kalman-Bucy Filters
Neil K. Chada, Ajay Jasra, Fangyuan Yu
In this article we consider the linear filtering problem in continuous-time. We develop and apply multilevel Monte Carlo (MLMC) strategies for ensemble Kalman-Bucy filters (EnKBFs)…
Unbiased Filtering of a Class of Partially Observed Diffusions
Ajay Jasra, Kody Law, Fangyuan Yu
In this article we consider a Monte Carlo-based method to filter partially observed diffusions observed at regular and discrete times. Given access only to Euler discretizations of…
Multilevel Particle Filters for the Non-Linear Filtering Problem in Continuous Time
Ajay Jasra, Fangyuan Yu, Jeremy Heng
In the following article we consider the numerical approximation of the non-linear filter in continuous-time, where the observations and signal follow diffusion processes. Given ac…