895 citations · 1.4k across the 15 of their papers we have counts for
6 papers · 1 filter
Score-based Continuous-time Discrete Diffusion Models
Haoran Sun, Lijun Yu, Bo Dai +2
Score-based modeling through stochastic differential equations (SDEs) has provided a new perspective on diffusion models, and demonstrated superior performance on continuous data.…
Optimal Scaling for Locally Balanced Proposals in Discrete Spaces
Haoran Sun, Hanjun Dai, Dale Schuurmans
Optimal scaling has been well studied for Metropolis-Hastings (M-H) algorithms in continuous spaces, but a similar understanding has been lacking in discrete spaces. Recently, a fa…
A Molecular Multimodal Foundation Model Associating Molecule Graphs with Natural Language
Bing Su, Dazhao Du, Zhao Yang +6
Although artificial intelligence (AI) has made significant progress in understanding molecules in a wide range of fields, existing models generally acquire the single cognitive abi…
Annealed Training for Combinatorial Optimization on Graphs
Haoran Sun, Etash K. Guha, Hanjun Dai
The hardness of combinatorial optimization (CO) problems hinders collecting solutions for supervised learning. However, learning neural networks for CO problems is notoriously diff…
Discrete Langevin Sampler via Wasserstein Gradient Flow
Haoran Sun, Hanjun Dai, Bo Dai +2
It is known that gradient-based MCMC samplers for continuous spaces, such as Langevin Monte Carlo (LMC), can be derived as particle versions of a gradient flow that minimizes KL di…
Distributed Training with Heterogeneous Data: Bridging Median- and Mean-Based Algorithms
Xiangyi Chen, Tiancong Chen, Haoran Sun +2
Recently, there is a growing interest in the study of median-based algorithms for distributed non-convex optimization. Two prominent such algorithms include signSGD with majority v…