2 citations · 2 across the 12 of their papers we have counts for
8 papers · 1 filter
Requential Coding: Pushing the Limits of Model Compression with Self-Generated Training Data
Shikai Qiu, Marc Finzi, Yujia Zheng +2
Compression is fundamental to intelligence. A model that can represent its training data as a short code has discovered regularities that enable generalization. Large neural networ…
MoRe: Modular Representations for Principled Continual Representation Learning on Sequential Data
Jiaqi Sun, Boyang Sun, Rasmy M. H. +2
Continual learning requires models to adapt to new data while preserving previously acquired knowledge. At its core, this challenge can be viewed as principled one-step adaptation:…
SEDGE: Structural Extrapolated Data Generation
Kun Zhang, Jiaqi Sun, Yiqing Li +3
This paper aims to address the challenge of data generation beyond the training data and proposes a framework for Structural Extrapolated Data GEneration (SEDGE) based on suitable…
From Generalist to Specialist Representation
Yujia Zheng, Fan Feng, Yuke Li +3
Given a generalist model, learning a task-relevant specialist representation is fundamental for downstream applications. Identifiability, the asymptotic guarantee of recovering the…
Learning by Analogy: A Causal Framework for Composition Generalization
Lingjing Kong, Shaoan Xie, Yang Jiao +6
Compositional generalization -- the ability to understand and generate novel combinations of learned concepts -- enables models to extend their capabilities beyond limited experien…
Beyond the Black Box: Identifiable Interpretation and Control in Generative Models via Causal Minimality
Lingjing Kong, Shaoan Xie, Guangyi Chen +4
Deep generative models, while revolutionizing fields like image and text generation, largely operate as opaque ``black boxes'', hindering human understanding, control, and alignmen…
CausalVerse: Benchmarking Causal Representation Learning with Configurable High-Fidelity Simulations
Guangyi Chen, Yunlong Deng, Peiyuan Zhu +4
Causal Representation Learning (CRL) aims to uncover the data-generating process and identify the underlying causal variables and relations, whose evaluation remains inherently cha…
Should Bias be Eliminated? A General Framework to Use Bias for OOD Generalization
Yan Li, Yunlong Deng, Zijian Li +4
Most approaches to out-of-distribution (OOD) generalization learn domain-invariant representations by discarding contextual bias. In this paper, we raise a critical question: Shoul…