4 papers
Empowering VLMs for Few-Shot Multimodal Time Series Classification via Tailored Agentic Reasoning
Lin Li, Jiawei Huang, Qihao Quan +7
In this paper, we propose the first VL gentic easoning framework for few-hot multimo…
Towards Understanding Continual Factual Knowledge Acquisition of Language Models: From Theory to Algorithm
Haoyu Wang, Yifan Shang, Zhongxiang Sun +3
Continual Pre-Training (CPT) is essential for enabling Language Models (LMs) to integrate new knowledge without erasing old. While classical CPT techniques like data replay have be…
WaveMoE: A Wavelet-Enhanced Mixture-of-Experts Foundation Model for Time Series Forecasting
Shunyu Wu, Jiawei Huang, Weibin Feng +6
Time series foundation models (TSFMs) have recently achieved remarkable success in universal forecasting by leveraging large-scale pretraining on diverse time series data. Compleme…
Analytic Subspace Routing: How Recursive Least Squares Works in Continual Learning of Large Language Model
Kai Tong, Kang Pan, Xiao Zhang +5
Large Language Models (LLMs) possess encompassing capabilities that can process diverse language-related tasks. However, finetuning on LLMs will diminish this general skills and co…