22 papers
Hessian Rank Constraint for Learning Structure of Nonlinear Latent Variable Models
Zijian Li, Ruichu Cai, Feng Xie +7
Uncovering latent variables and their causal relations from observed data is a fundamental yet challenging problem. Existing methods often rely on restrictive assumptions, such as…
ChorusTIC: Training-Free Multivariate Time Series Classification via Chorus In-Context Learning
Juntao Fang, Shifeng Xie, Ruichu Cai +6
Time series classification underpins applications in healthcare, sensing, and industrial monitoring. Although time series foundation models support forecasting and transferable rep…
CausalGame: Benchmarking Causal Thinking of LLM Agents in Games
Zhenhao Chen, Yongqiang Chen, Chenxi Liu +7
Building AI Scientist agents with Large Language Models (LLMs) has recently attracted growing attention. Since scientific discovery fundamentally relies on uncovering causal relati…
MoVA: Learning Asymmetric Dual Projections for Modular Long Video-Text Alignment
Peiyuan Zhu, Shaoan Xie, Zijian Li +5
Contrastive pre-training has propelled video-text alignment, yet models often inherit the critical limitations of their image-text predecessors like CLIP, resulting in entangled re…
Ada-Diffuser: Latent-Aware Adaptive Diffusion for Decision-Making
Fan Feng, Selena Ge, Minghao Fu +6
Recent work has framed decision-making as a sequence modeling problem using generative models such as diffusion models. Although promising, these approaches often overlook latent f…
A General Representation-Based Approach to Multi-Source Domain Adaptation
Ignavier Ng, Yan Li, Zijian Li +3
A central problem in unsupervised domain adaptation is determining what to transfer from labeled source domains to an unlabeled target domain. To handle high-dimensional observatio…
Diverse Dictionary Learning
Yujia Zheng, Zijian Li, Shunxing Fan +2
Given only observational data , where both the latent variables and the generating process are unknown, recovering is ill-posed without additional assumptions…
Thought Communication in Multiagent Collaboration
Yujia Zheng, Zhuokai Zhao, Zijian Li +4
Natural language has long enabled human cooperation, but its lossy, ambiguous, and indirect nature limits the potential of collective intelligence. While machines are not subject t…
Towards Identifiability of Hierarchical Temporal Causal Representation Learning
Zijian Li, Minghao Fu, Junxian Huang +5
Modeling hierarchical latent dynamics behind time series data is critical for capturing temporal dependencies across multiple levels of abstraction in real-world tasks. However, ex…
Online Time Series Forecasting with Theoretical Guarantees
Zijian Li, Changze Zhou, Minghao Fu +6
This paper is concerned with online time series forecasting, where unknown distribution shifts occur over time, i.e., latent variables influence the mapping from historical to futu…
CausalVerse: Benchmarking Causal Representation Learning with Configurable High-Fidelity Simulations
Guangyi Chen, Yunlong Deng, Peiyuan Zhu +4
Causal Representation Learning (CRL) aims to uncover the data-generating process and identify the underlying causal variables and relations, whose evaluation remains inherently cha…
LLM Interpretability with Identifiable Temporal-Instantaneous Representation
Xiangchen Song, Jiaqi Sun, Zijian Li +2
Despite Large Language Models' remarkable capabilities, understanding their internal representations remains challenging. Mechanistic interpretability tools such as sparse autoenco…
Should Bias be Eliminated? A General Framework to Use Bias for OOD Generalization
Yan Li, Yunlong Deng, Zijian Li +4
Most approaches to out-of-distribution (OOD) generalization learn domain-invariant representations by discarding contextual bias. In this paper, we raise a critical question: Shoul…
An Identifiable Cost-Aware Causal Decision-Making Framework Using Counterfactual Reasoning
Ruichu Cai, Xi Chen, Jie Qiao +5
Decision making under abnormal conditions is a critical process that involves evaluating the current state and determining the optimal action to restore the system to a normal stat…
Synergy Between Sufficient Changes and Sparse Mixing Procedure for Disentangled Representation Learning
Zijian Li, Shunxing Fan, Yujia Zheng +6
Disentangled representation learning aims to uncover latent variables underlying the observed data, and generally speaking, rather strong assumptions are needed to ensure identifia…
Controllable Video Generation with Provable Disentanglement
Yifan Shen, Peiyuan Zhu, Zijian Li +6
Controllable video generation remains a significant challenge, despite recent advances in generating high-quality and consistent videos. Most existing methods for controlling video…
Learning General Causal Structures with Hidden Dynamic Process for Climate Analysis
Minghao Fu, Biwei Huang, Zijian Li +5
Understanding climate dynamics requires going beyond correlations in observational data to uncover the underlying causal process. Latent drivers such as atmospheric processes play…
Causal Representation Learning from Multimodal Biomedical Observations
Yuewen Sun, Lingjing Kong, Guangyi Chen +10
Prevalent in biomedical applications (e.g., human phenotype research), multimodal datasets can provide valuable insights into the underlying physiological mechanisms. However, curr…
Causal Temporal Representation Learning with Nonstationary Sparse Transition
Xiangchen Song, Zijian Li, Guangyi Chen +4
Causal Temporal Representation Learning (Ctrl) methods aim to identify the temporal causal dynamics of complex nonstationary temporal sequences. Despite the success of existing Ctr…
Learning Discrete Latent Variable Structures with Tensor Rank Conditions
Zhengming Chen, Ruichu Cai, Feng Xie +5
Unobserved discrete data are ubiquitous in many scientific disciplines, and how to learn the causal structure of these latent variables is crucial for uncovering data patterns. Mos…
From Orthogonality to Dependency: Learning Disentangled Representation for Multi-Modal Time-Series Sensing Signals
Ruichu Cai, Zhifang Jiang, Zijian Li +6
Existing methods for multi-modal time series representation learning aim to disentangle the modality-shared and modality-specific latent variables. Although achieving notable perfo…
On the Identification of Temporally Causal Representation with Instantaneous Dependence
Zijian Li, Yifan Shen, Kaitao Zheng +5
Temporally causal representation learning aims to identify the latent causal process from time series observations, but most methods require the assumption that the latent causal p…