4 papers · 1 filter
On Powerful Ways to Generate: Autoregression, Diffusion, and Beyond
Chenxiao Yang, Cai Zhou, David Wipf +1
Diffusion language models have recently emerged as a competitive alternative to autoregressive language models. Beyond next-token generation, they are more efficient and flexible b…
Transformers from Diffusion: A Unified Framework for Neural Message Passing
Qitian Wu, David Wipf, Junchi Yan
Learning representations for structured data with certain geometries (e.g., observed or unobserved) is a fundamental challenge, wherein message passing neural networks (MPNNs) have…
SGFormer: Single-Layer Graph Transformers with Approximation-Free Linear Complexity
Qitian Wu, Kai Yang, Hengrui Zhang +2
Learning representations on large graphs is a long-standing challenge due to the inter-dependence nature. Transformers recently have shown promising performance on small graphs tha…
How Graph Neural Networks Learn: Lessons from Training Dynamics
Chenxiao Yang, Qitian Wu, David Wipf +2
A long-standing goal in deep learning has been to characterize the learning behavior of black-box models in a more interpretable manner. For graph neural networks (GNNs), considera…