4 papers
E-MoE: Enhanced Mixture-of-Experts for Non-Factorized Diffusion Language Models
Arseny Ivanov, Alexander Kolesov, Alexander Korotin +2
Masked diffusion models (MDMs) generate sequences by progressively unmasking several tokens per denoising step, but their reverse process is typically factorized over positions, li…
TUBE: Tangent Upper Bound on Evidence for Discrete Diffusion Language Models
Arseny Ivanov, Sergei Kholkin, Vladislav Gromadskii +3
Log-likelihood is a standard metric for evaluating generative models. Unfortunately, in contrast to autoregressive models (ARMs), discrete diffusion models generally do not admit e…
Time-Correlated Video Bridge Matching
Viacheslav Vasilev, Arseny Ivanov, Nikita Gushchin +2
Bridge Matching (BM) learns a stochastic transport between two data distributions and is therefore a natural tool for data-to-data tasks such as video frame interpolation, image-to…
GCT-TTE: Graph Convolutional Transformer for Travel Time Estimation
Vladimir Mashurov, Vaagn Chopurian, Vadim Porvatov +2
This paper introduces a new transformer-based model for the problem of travel time estimation. The key feature of the proposed GCT-TTE architecture is the utilization of different…