283 citations · 817 across the 58 of their papers we have counts for
59 papers
RACE: Residual-Aware Test-Time Adaptation for Neighbor-Rich Time-Series Foundation Model Forecasting
Hao-Nan Shi, Tong Wu, Chen-Cong Sun +3
Time-series foundation models (TSFMs) perform strongly across forecasting tasks, but their per-series inference is ill-suited to neighbor-rich forecasting, where each query has acc…
Revisiting Nearest Neighbor for Tabular Data: A Deep Tabular Baseline Two Decades Later
Han-Jia Ye, Huai-Hong Yin, De-Chuan Zhan +1
The widespread enthusiasm for deep learning has recently expanded into the domain of tabular data. Recognizing that the advancement in deep tabular methods is often inspired by cla…
A Closer Look at Deep Learning Methods on Tabular Datasets
Han-Jia Ye, Si-Yang Liu, Hao-Run Cai +2
Tabular data is prevalent across diverse domains in machine learning. With the rapid progress of deep tabular prediction methods, especially pretrained (foundation) models, there i…
Wings: Learning Multimodal LLMs without Text-only Forgetting
Yi-Kai Zhang, Shiyin Lu, Yang Li +7
Multimodal large language models (MLLMs), initiated with a trained LLM, first align images with text and then fine-tune on multimodal mixed inputs. However, the MLLM catastrophical…
Parrot: Multilingual Visual Instruction Tuning
Hai-Long Sun, Da-Wei Zhou, Yang Li +8
The rapid development of Multimodal Large Language Models (MLLMs), such as GPT-4o, marks a significant step toward artificial general intelligence. Existing methods typically align…
TV100: A TV Series Dataset that Pre-Trained CLIP Has Not Seen
Da-Wei Zhou, Zhi-Hong Qi, Han-Jia Ye +1
The era of pre-trained models has ushered in a wealth of new insights for the machine learning community. Among the myriad of questions that arise, one of paramount importance is:…
Expandable Subspace Ensemble for Pre-Trained Model-Based Class-Incremental Learning
Da-Wei Zhou, Hai-Long Sun, Han-Jia Ye +1
Class-Incremental Learning (CIL) requires a learning system to continually learn new classes without forgetting. Despite the strong performance of Pre-Trained Models (PTMs) in CIL,…
Bridge the Modality and Capability Gaps in Vision-Language Model Selection
Chao Yi, Yu-Hang He, De-Chuan Zhan +1
Vision Language Models (VLMs) excel in zero-shot image classification by pairing images with textual category names. The expanding variety of Pre-Trained VLMs enhances the likeliho…
Continual Learning with Pre-Trained Models: A Survey
Da-Wei Zhou, Hai-Long Sun, Jingyi Ning +2
Nowadays, real-world applications often face streaming data, which requires the learning system to absorb new knowledge as data evolves. Continual Learning (CL) aims to achieve thi…
Few-Shot Class-Incremental Learning via Training-Free Prototype Calibration
Qi-Wei Wang, Da-Wei Zhou, Yi-Kai Zhang +2
Real-world scenarios are usually accompanied by continuously appearing classes with scare labeled samples, which require the machine learning model to incrementally learn new class…
Learning Robust Precipitation Forecaster by Temporal Frame Interpolation
Lu Han, Xu-Yang Chen, Han-Jia Ye +1
Recent advances in deep learning have significantly elevated weather prediction models. However, these models often falter in real-world scenarios due to their sensitivity to spati…
Rethinking Pre-Training in Tabular Data: A Neighborhood Embedding Perspective
Han-Jia Ye, Qi-Le Zhou, Huai-Hong Yin +2
Pre-training is prevalent in deep learning for vision and text data, leveraging knowledge from other datasets to enhance downstream tasks. However, for tabular data, the inherent h…
Unlocking the Transferability of Tokens in Deep Models for Tabular Data
Qi-Le Zhou, Han-Jia Ye, Le-Ye Wang +1
Fine-tuning a pre-trained deep neural network has become a successful paradigm in various machine learning tasks. However, such a paradigm becomes particularly challenging with tab…
PILOT: A Pre-Trained Model-Based Continual Learning Toolbox
Hai-Long Sun, Da-Wei Zhou, De-Chuan Zhan +1
While traditional machine learning can effectively tackle a wide range of problems, it primarily operates within a closed-world setting, which presents limitations when dealing wit…
ZhiJian: A Unifying and Rapidly Deployable Toolbox for Pre-trained Model Reuse
Yi-Kai Zhang, Lu Ren, Chao Yi +3
The rapid expansion of foundation pre-trained models and their fine-tuned counterparts has significantly contributed to the advancement of machine learning. Leveraging pre-trained…
Streaming CTR Prediction: Rethinking Recommendation Task for Real-World Streaming Data
Qi-Wei Wang, Hongyu Lu, Yu Chen +4
The Click-Through Rate (CTR) prediction task is critical in industrial recommender systems, where models are usually deployed on dynamic streaming data in practical applications. S…
SeMAIL: Eliminating Distractors in Visual Imitation via Separated Models
Shenghua Wan, Yucen Wang, Minghao Shao +2
Model-based imitation learning (MBIL) is a popular reinforcement learning method that improves sample efficiency on high-dimension input sources, such as images and videos. Followi…
Model Spider: Learning to Rank Pre-Trained Models Efficiently
Yi-Kai Zhang, Ting-Ji Huang, Yao-Xiang Ding +2
Figuring out which Pre-Trained Model (PTM) from a model zoo fits the target task is essential to take advantage of plentiful model resources. With the availability of numerous hete…
Beyond Probability Partitions: Calibrating Neural Networks with Semantic Aware Grouping
Jia-Qi Yang, De-Chuan Zhan, Le Gan
Research has shown that deep networks tend to be overly optimistic about their predictions, leading to an underestimation of prediction errors. Due to the limited nature of data, e…
IDToolkit: A Toolkit for Benchmarking and Developing Inverse Design Algorithms in Nanophotonics
Jia-Qi Yang, Yucheng Xu, Jia-Lei Shen +3
Aiding humans with scientific designs is one of the most exciting of artificial intelligence (AI) and machine learning (ML), due to their potential for the discovery of new drugs,…
MrTF: Model Refinery for Transductive Federated Learning
Xin-Chun Li, Yang Yang, De-Chuan Zhan
We consider a real-world scenario in which a newly-established pilot project needs to make inferences for newly-collected data with the help of other parties under privacy protecti…
Learning without Forgetting for Vision-Language Models
Da-Wei Zhou, Yuanhan Zhang, Yan Wang +4
Class-Incremental Learning (CIL) or continual learning is a desired capability in the real world, which requires a learning system to adapt to new tasks without forgetting former o…
Preserving Locality in Vision Transformers for Class Incremental Learning
Bowen Zheng, Da-Wei Zhou, Han-Jia Ye +1
Learning new classes without forgetting is crucial for real-world applications for a classification model. Vision Transformers (ViT) recently achieve remarkable performance in Clas…
The Capacity and Robustness Trade-off: Revisiting the Channel Independent Strategy for Multivariate Time Series Forecasting
Lu Han, Han-Jia Ye, De-Chuan Zhan
Multivariate time series data comprises various channels of variables. The multivariate forecasting models need to capture the relationship between the channels to accurately predi…