4 papers
Muon-OGD: Muon-based Spectral Orthogonal Gradient Projection for LLM Continual Learning
Binghang Lu, Zheyuan Deng, Runyu Zhang +6
A central challenge in continual learning for large language models (LLMs) is catastrophic forgetting, where adapting to new tasks can substantially degrade performance on previous…
Bridging Theory and Practice: Statistical Inference for Latent Space Models of Networks
Yuang Tian, Jiajin Sun, Yinqiu He
Latent space models have been widely adopted in modeling network data. Developing statistical inference for estimated model parameters enables quantifying associated uncertainty an…
Efficient Analysis of Latent Spaces in Heterogeneous Networks
Yuang Tian, Jiajin Sun, Yinqiu He
This work proposes a unified framework for efficient estimation under latent space modeling of heterogeneous networks. We consider a class of latent space models that decompose lat…
Semiparametric Modeling and Analysis for Longitudinal Network Data
Yinqiu He, Jiajin Sun, Yuang Tian +2
We introduce a semiparametric latent space model for analyzing longitudinal network data. The model consists of a static latent space component and a time-varying node-specific bas…