307 citations · 1.8k across the 219 of their papers we have counts for
52 papers · 1 filter
MixupE: Understanding and Improving Mixup from Directional Derivative Perspective
Yingtian Zou, Vikas Verma, Sarthak Mittal +6
Mixup is a popular data augmentation technique for training deep neural networks where additional samples are generated by linearly interpolating pairs of inputs and their labels.…
Posterior samples of source galaxies in strong gravitational lenses with score-based priors
Alexandre Adam, Adam Coogan, Nikolay Malkin +4
Inferring accurate posteriors for high-dimensional representations of the brightness of gravitationally-lensed sources is a major challenge, in part due to the difficulties of accu…
A General Purpose Neural Architecture for Geospatial Systems
Nasim Rahaman, Martin Weiss, Frederik Träuble +6
Geospatial Information Systems are used by researchers and Humanitarian Assistance and Disaster Response (HADR) practitioners to support a wide variety of important applications. H…
Consistent Training via Energy-Based GFlowNets for Modeling Discrete Joint Distributions
Chanakya Ekbote, Moksh Jain, Payel Das +1
Generative Flow Networks (GFlowNets) have demonstrated significant performance improvements for generating diverse discrete objects given a reward function , indicating t…
Synergies between Disentanglement and Sparsity: Generalization and Identifiability in Multi-Task Learning
Sébastien Lachapelle, Tristan Deleu, Divyat Mahajan +4
Although disentangled representations are often said to be beneficial for downstream tasks, current empirical and theoretical understanding is limited. In this work, we provide evi…
PhAST: Physics-Aware, Scalable, and Task-specific GNNs for Accelerated Catalyst Design
Alexandre Duval, Victor Schmidt, Santiago Miret +3
Mitigating the climate crisis requires a rapid transition towards lower-carbon energy. Catalyst materials play a crucial role in the electrochemical reactions involved in numerous…
Bayesian learning of Causal Structure and Mechanisms with GFlowNets and Variational Bayes
Mizu Nishikawa-Toomey, Tristan Deleu, Jithendaraa Subramanian +2
Bayesian causal structure learning aims to learn a posterior distribution over directed acyclic graphs (DAGs), and the mechanisms that define the relationship between parent and ch…
Discrete Factorial Representations as an Abstraction for Goal Conditioned Reinforcement Learning
Riashat Islam, Hongyu Zang, Anirudh Goyal +6
Goal-conditioned reinforcement learning (RL) is a promising direction for training agents that are capable of solving multiple tasks and reach a diverse set of objectives. How to \…
FL Games: A Federated Learning Framework for Distribution Shifts
Sharut Gupta, Kartik Ahuja, Mohammad Havaei +2
Federated learning aims to train predictive models for data that is distributed across clients, under the orchestration of a server. However, participating clients typically each h…
Neural Attentive Circuits
Nasim Rahaman, Martin Weiss, Francesco Locatello +5
Recent work has seen the development of general purpose neural architectures that can be trained to perform tasks across diverse data modalities. General purpose models typically m…
Robust and Controllable Object-Centric Learning through Energy-based Models
Ruixiang Zhang, Tong Che, Boris Ivanovic +4
Humans are remarkably good at understanding and reasoning about complex visual scenes. The capability to decompose low-level observations into discrete objects allows us to build a…
MAgNet: Mesh Agnostic Neural PDE Solver
Oussama Boussif, Dan Assouline, Loubna Benabbou +1
The computational complexity of classical numerical methods for solving Partial Differential Equations (PDE) scales significantly as the resolution increases. As an important examp…
Generative Augmented Flow Networks
Ling Pan, Dinghuai Zhang, Aaron Courville +2
The Generative Flow Network is a probabilistic framework where an agent learns a stochastic policy for object generation, such that the probability of generating an object is propo…
GFlowOut: Dropout with Generative Flow Networks
Dianbo Liu, Moksh Jain, Bonaventure Dossou +10
Bayesian Inference offers principled tools to tackle many critical problems with modern neural networks such as poor calibration and generalization, and data inefficiency. However,…
Multi-Objective GFlowNets
Moksh Jain, Sharath Chandra Raparthy, Alex Hernandez-Garcia +4
We study the problem of generating diverse candidates in the context of Multi-Objective Optimization. In many applications of machine learning such as drug discovery and material d…
Toward Next-Generation Artificial Intelligence: Catalyzing the NeuroAI Revolution
Anthony Zador, Sean Escola, Blake Richards +24
Neuroscience has long been an essential driver of progress in artificial intelligence (AI). We propose that to accelerate progress in AI, we must invest in fundamental research in…
Contrastive Retrospection: honing in on critical steps for rapid learning and generalization in RL
Chen Sun, Wannan Yang, Thomas Jiralerspong +4
In real life, success is often contingent upon multiple critical steps that are distant in time from each other and from the final reward. These critical steps are challenging to i…
Stateful active facilitator: Coordination and Environmental Heterogeneity in Cooperative Multi-Agent Reinforcement Learning
Dianbo Liu, Vedant Shah, Oussama Boussif +6
In cooperative multi-agent reinforcement learning, a team of agents works together to achieve a common goal. Different environments or tasks may require varying degrees of coordina…
Latent State Marginalization as a Low-cost Approach for Improving Exploration
Dinghuai Zhang, Aaron Courville, Yoshua Bengio +3
While the maximum entropy (MaxEnt) reinforcement learning (RL) framework -- often touted for its exploration and robustness capabilities -- is usually motivated from a probabilisti…
GFlowNets and variational inference
Esmeralda S. Whitammer, Salem Lahlou, Tristan Deleu +5
This paper builds bridges between two families of probabilistic algorithms: (hierarchical) variational inference (VI), which is typically used to model distributions over continuou…
Predictive Inference with Feature Conformal Prediction
Jiaye Teng, Chuan Wen, Dinghuai Zhang +3
Conformal prediction is a distribution-free technique for establishing valid prediction intervals. Although conventionally people conduct conformal prediction in the output space,…
Graph-Based Active Machine Learning Method for Diverse and Novel Antimicrobial Peptides Generation and Selection
Bonaventure F. P. Dossou, Dianbo Liu, Xu Ji +5
As antibiotic-resistant bacterial strains are rapidly spreading worldwide, infections caused by these strains are emerging as a global crisis causing the death of millions of peopl…
Designing Biological Sequences via Meta-Reinforcement Learning and Bayesian Optimization
Leo Feng, Padideh Nouri, Aneri Muni +2
The ability to accelerate the design of biological sequences can have a substantial impact on the progress of the medical field. The problem can be framed as a global optimization…
Learning GFlowNets from partial episodes for improved convergence and stability
Kanika Madan, Jarrid Rector-Brooks, Maksym Korablyov +6
Generative flow networks (GFlowNets) are a family of algorithms for training a sequential sampler of discrete objects under an unnormalized target density and have been successfull…