5 papers
MoRe: Modular Representations for Principled Continual Representation Learning on Sequential Data
Jiaqi Sun, Boyang Sun, Rasmy M. H. +2
Continual learning requires models to adapt to new data while preserving previously acquired knowledge. At its core, this challenge can be viewed as principled one-step adaptation:…
SEDGE: Structural Extrapolated Data Generation
Kun Zhang, Jiaqi Sun, Yiqing Li +3
This paper aims to address the challenge of data generation beyond the training data and proposes a framework for Structural Extrapolated Data GEneration (SEDGE) based on suitable…
Score-based Greedy Search for Structure Identification of Partially Observed Linear Causal Models
Xinshuai Dong, Ignavier Ng, Haoyue Dai +4
Identifying the structure of a partially observed causal system is essential to various scientific fields. Recent advances have focused on constraint-based causal discovery to solv…
LLM Interpretability with Identifiable Temporal-Instantaneous Representation
Xiangchen Song, Jiaqi Sun, Zijian Li +2
Despite Large Language Models' remarkable capabilities, understanding their internal representations remains challenging. Mechanistic interpretability tools such as sparse autoenco…
Type Information-Assisted Self-Supervised Knowledge Graph Denoising
Jiaqi Sun, Yujia Zheng, Xinshuai Dong +2
Knowledge graphs serve as critical resources supporting intelligent systems, but they can be noisy due to imperfect automatic generation processes. Existing approaches to noise det…