activity
20202022
most citedTight Mutual Information Estimation With Contrastive Fenchel-Legendre Optimization

10 citations · 27 across the 7 of their papers we have counts for

collaborators

7 papers

cs.CV2022★ 1 cited

Toward Sustainable Continual Learning: Detection and Knowledge Repurposing of Similar Tasks

Sijia Wang, Yoojin Choi, Junya Chen +2

Most existing works on continual learning (CL) focus on overcoming the catastrophic forgetting (CF) problem, with dynamic models and replay methods performing exceptionally well. H…

cs.LG2021★ 1 cited

Finite-Time Consensus Learning for Decentralized Optimization with Nonlinear Gossiping

Junya Chen, Sijia Wang, Lawrence Carin +1

Distributed learning has become an integral tool for scaling up machine learning and addressing the growing need for data privacy. Although more robust to the network topology, dec…

cs.LG2021★ 3 cited

Variational Inference with Holder Bounds

Junya Chen, Danni Lu, Zidi Xiu +3

The recent introduction of thermodynamic integration techniques has provided a new framework for understanding and improving variational inference (VI). In this work, we present a…

stat.ML2021★ 9 cited

Simpler, Faster, Stronger: Breaking The log-K Curse On Contrastive Learners With FlatNCE

Junya Chen, Zhe Gan, Xuan Li +10

InfoNCE-based contrastive representation learners, such as SimCLR, have been tremendously successful in recent years. However, these contrastive schemes are notoriously resource de…

stat.ML2021★ 10 cited

Tight Mutual Information Estimation With Contrastive Fenchel-Legendre Optimization

Qing Guo, Junya Chen, Dong Wang +6

Successful applications of InfoNCE and its variants have popularized the use of contrastive variational mutual information (MI) estimators in machine learning. While featuring supe…

cs.CV2020★ 3 cited

Supercharging Imbalanced Data Learning With Energy-based Contrastive Representation Transfer

Zidi Xiu, Junya Chen, Ricardo Henao +3

Dealing with severe class imbalance poses a major challenge for real-world applications, especially when the accurate classification and generalization of minority classes is of pr…

stat.ML2020

GO Hessian for Expectation-Based Objectives

Yulai Cong, Miaoyun Zhao, Jianqiao Li +2

An unbiased low-variance gradient estimator, termed GO gradient, was proposed recently for expectation-based objectives $\mathbb{E}_{q_{\boldsymbolγ}(\boldsymbol{y})} [f(\boldsymbo…