66 citations · 111 across the 17 of their papers we have counts for
8 papers · 1 filter
A Survey on Self-Improving Test-Time Intelligence: Feedback-Driven Adapting, Learning, and Scaling at Inference
Shuaicheng Niu, Guohao Chen, Yaofo Chen +14
The ability of AI systems to improve their behavior during deployment is becoming increasingly important. As inference moves beyond the static execution of a fixed trained model, a…
LoKiFormer: Locality-aware Attention with Decoupled Knowledge Memory for Efficient Large Language Model Pretraining
Qiuwu Chen, Zimo Liu, Yuchen Li +8
Large language models (LLMs) have achieved remarkable breakthroughs across various applications. However, their architectures remain inefficient in pretraining due to two main limi…
Adapt in the Wild: Test-Time Entropy Minimization with Sharpness and Feature Regularization
Shuaicheng Niu, Guohao Chen, Deyu Chen +7
Test-time adaptation (TTA) may fail to improve or even harm the model performance when test data have: 1) mixed distribution shifts, 2) small batch sizes, 3) online imbalanced labe…
Learning to Generate Gradients for Test-Time Adaptation via Test-Time Training Layers
Qi Deng, Shuaicheng Niu, Ronghao Zhang +4
Test-time adaptation (TTA) aims to fine-tune a trained model online using unlabeled testing data to adapt to new environments or out-of-distribution data, demonstrating broad appli…
Uncertainty-Calibrated Test-Time Model Adaptation without Forgetting
Mingkui Tan, Guohao Chen, Jiaxiang Wu +4
Test-time adaptation (TTA) seeks to tackle potential distribution shifts between training and test data by adapting a given model w.r.t. any test sample. Although recent TTA has sh…
Pareto-aware Neural Architecture Generation for Diverse Computational Budgets
Yong Guo, Yaofo Chen, Yin Zheng +5
Designing feasible and effective architectures under diverse computational budgets, incurred by different applications/devices, is essential for deploying deep models in real-world…