1 citations · 1 across the 13 of their papers we have counts for
6 papers · 1 filter
Sampling from Flow Language Models via Marginal-Conditioned Bridges
Iskander Azangulov, Leo Zhang
Flow Language Models (FLMs) are a recently introduced class of language models which adapt continuous flow matching for one-hot encoded token sequences. Their denoisers have a spec…
Orthogonal Self-Attention
Leo Zhang, James Martens
Softmax Self-Attention (SSA) is a key component of Transformer architectures. However, when utilised within skipless architectures, which aim to improve representation learning, re…
Yuan3.0 Ultra: A Trillion-Parameter Enterprise-Oriented MoE LLM
YuanLab. ai, :, Shawn Wu +25
We introduce Yuan3.0 Ultra, an open-source Mixture-of-Experts (MoE) large language model featuring 68.8B activated parameters and 1010B total parameters, specially designed to enha…
SigmaDock: Untwisting Molecular Docking With Fragment-Based SE(3) Diffusion
Alvaro Prat, Leo Zhang, Charlotte M. Deane +2
Determining the binding pose of a ligand to a protein, known as molecular docking, is a fundamental task in drug discovery. Generative approaches promise faster, improved, and more…
SymDiff: Equivariant Diffusion via Stochastic Symmetrisation
Leo Zhang, Kianoosh Ashouritaklimi, Yee Whye Teh +1
We propose SymDiff, a method for constructing equivariant diffusion models using the framework of stochastic symmetrisation. SymDiff resembles a learned data augmentation that is d…
Metric Flow Matching for Smooth Interpolations on the Data Manifold
Kacper Kapuśniak, Peter Potaptchik, Teodora Reu +5
Matching objectives underpin the success of modern generative models and rely on constructing conditional paths that transform a source distribution into a target distribution. Des…