Showing cs.LGShow all
2 papers · 1 filter
cs.LG2026
Correcting Stochastic Update Bias in Preconditioned Language Model Optimizers
Nikhil Nayak, Julia White, Urchade Zaratiana +7
Preconditioned optimizers are central to language model training, but their stochastic update rules are usually treated as direct approximations to population preconditioned descen…
cs.LG2024
Nearest Neighbour Score Estimators for Diffusion Generative Models
Matthew Niedoba, Dylan Green, Saeid Naderiparizi +9
Score function estimation is the cornerstone of both training and sampling from diffusion generative models. Despite this fact, the most commonly used estimators are either biased…