activity
20202026
most citedLearning Diverse and Discriminative Representations via the Principle of Maximal Coding Rate Reduction

58 citations · 140 across the 15 of their papers we have counts for

collaborators
Showing cs.LGShow all

8 papers · 1 filter

cs.LG2025

Conformal Information Pursuit for Interactively Guiding Large Language Models

Kwan Ho Ryan Chan, Yuyan Ge, Edgar Dobriban +2

A significant use case of instruction-finetuned Large Language Models (LLMs) is to solve question-answering tasks interactively. In this setting, an LLM agent is tasked with making…

cs.LG2023

Variational Information Pursuit with Large Language and Multimodal Models for Interpretable Predictions

Kwan Ho Ryan Chan, Aditya Chattopadhyay, Benjamin David Haeffele +1

Variational Information Pursuit (V-IP) is a framework for making interpretable predictions by design by sequentially selecting a short chain of task-relevant, user-defined and inte…

cs.LG2023

Variational Information Pursuit for Interpretable Predictions

Aditya Chattopadhyay, Kwan Ho Ryan Chan, Benjamin D. Haeffele +2

There is a growing interest in the machine learning community in developing predictive algorithms that are "interpretable by design". Towards this end, recent work proposes to make…

cs.LG2023

Unsupervised Manifold Linearizing and Clustering

Tianjiao Ding, Shengbang Tong, Kwan Ho Ryan Chan +3

We consider the problem of simultaneously clustering and learning a linear representation of data lying close to a union of low-dimensional manifolds, a fundamental task in machine…

cs.LG2022

Efficient Maximal Coding Rate Reduction by Variational Forms

Christina Baek, Ziyang Wu, Kwan Ho Ryan Chan +3

The principle of Maximal Coding Rate Reduction (MCR) has recently been proposed as a training objective for learning discriminative low-dimensional structures intrinsic to high…

cs.LG2021★ 54 cited

ReduNet: A White-box Deep Network from the Principle of Maximizing Rate Reduction

Kwan Ho Ryan Chan, Yaodong Yu, Chong You +3

This work attempts to provide a plausible theoretical framework that aims to interpret modern deep (convolutional) networks from the principles of data compression and discriminati…

cs.LG2020★ 9 cited

Deep Networks from the Principle of Rate Reduction

Kwan Ho Ryan Chan, Yaodong Yu, Chong You +3

This work attempts to interpret modern deep (convolutional) networks from the principles of rate reduction and (shift) invariant classification. We show that the basic iterative gr…

cs.LG2020★ 58 cited

Learning Diverse and Discriminative Representations via the Principle of Maximal Coding Rate Reduction

Yaodong Yu, Kwan Ho Ryan Chan, Chong You +2

To learn intrinsic low-dimensional structures from high-dimensional data that most discriminate between classes, we propose the principle of Maximal Coding Rate Reduction ($\text{M…