activity
20202026
most citedThe Optimal Noise in Noise-Contrastive Learning Is Not What You Think

2 citations · 3 across the 11 of their papers we have counts for

collaborators

12 papers

cs.LG2026

Few-Step Boltzmann Generators via Scalable Likelihood Flow Maps

RuiKang OuYang, Hanlin Yu, Xinyue Ai +7

Recent progress in flow-based generative modeling has led to models that output high-quality samples while using only a small number of function evaluations. However, at present, t…

cs.LG2025

Multi-View Causal Discovery without Non-Gaussianity: Identifiability and Algorithms

Ambroise Heurtebise, Omar Chehab, Pierre Ablin +2

Causal discovery is a difficult problem that typically relies on strong assumptions on the data-generating model, such as non-Gaussianity. In practice, many modern applications pro…

cs.LG2025

Density Ratio Estimation with Conditional Probability Paths

Hanlin Yu, Arto Klami, Aapo Hyvärinen +2

Density ratio estimation in high dimensions can be reframed as integrating a certain quantity, the time score, over probability paths which interpolate between the two densities. I…

cs.LG2025

MVICAD2: Multi-View Independent Component Analysis with Delays and Dilations

Ambroise Heurtebise, Omar Chehab, Pierre Ablin +1

Machine learning techniques in multi-view settings face significant challenges, particularly when integrating heterogeneous data, aligning feature spaces, and managing view-specifi…

stat.CO2025

Sampling from multi-modal distributions with polynomial query complexity in fixed dimension via reverse diffusion

Adrien Vacher, Omar Chehab, Anna Korba

Even in low dimensions, sampling from multi-modal distributions is challenging. We provide the first sampling algorithm for a broad class of distributions -- including all Gaussian…

stat.ML2024

Provable Convergence and Limitations of Geometric Tempering for Langevin Dynamics

Omar Chehab, Anna Korba, Austin Stromme +1

Geometric tempering is a popular approach to sampling from challenging multi-modal probability distributions by instead sampling from a sequence of distributions which interpolate,…

stat.ML2024

A Practical Diffusion Path for Sampling

Omar Chehab, Anna Korba

Diffusion models are state-of-the-art methods in generative modeling when samples from a target probability distribution are available, and can be efficiently sampled, using score…

stat.ML2023

Provable benefits of annealing for estimating normalizing constants: Importance Sampling, Noise-Contrastive Estimation, and beyond

Omar Chehab, Aapo Hyvarinen, Andrej Risteski

Recent research has developed several Monte Carlo methods for estimating the normalization constant (partition function) based on the idea of annealing. This means sampling success…

stat.ML2023

Optimizing the Noise in Self-Supervised Learning: from Importance Sampling to Noise-Contrastive Estimation

Omar Chehab, Alexandre Gramfort, Aapo Hyvarinen

Self-supervised learning is an increasingly popular approach to unsupervised learning, achieving state-of-the-art results. A prevalent approach consists in contrasting data points…

stat.ML2022★ 2 cited

The Optimal Noise in Noise-Contrastive Learning Is Not What You Think

Omar Chehab, Alexandre Gramfort, Aapo Hyvarinen

Learning a parametric model of a data distribution is a well-known statistical problem that has seen renewed interest as it is brought to scale in deep learning. Framing the proble…

q-bio.NC2021★ 1 cited

Deep Recurrent Encoder: A scalable end-to-end network to model brain signals

Omar Chehab, Alexandre Defossez, Jean-Christophe Loiseau +2

Understanding how the brain responds to sensory inputs is challenging: brain recordings are partial, noisy, and high dimensional; they vary across sessions and subjects and they ca…

stat.ML2020

Uncovering the structure of clinical EEG signals with self-supervised learning

Hubert Banville, Omar Chehab, Aapo Hyvärinen +2

Objective. Supervised learning paradigms are often limited by the amount of labeled data that is available. This phenomenon is particularly problematic in clinically-relevant data,…