Showing 2023Show all
3 papers · 1 filter
cs.LG2023
ZO-AdaMU Optimizer: Adapting Perturbation by the Momentum and Uncertainty in Zeroth-order Optimization
Shuoran Jiang, Qingcai Chen, Youchen Pan +5
Lowering the memory requirement in full-parameter training on large models has become a hot research area. MeZO fine-tunes the large language models (LLMs) by just forward passes i…
cs.CL2023
TDeLTA: A Light-weight and Robust Table Detection Method based on Learning Text Arrangement
Yang Fan, Xiangping Wu, Qingcai Chen +4
The diversity of tables makes table detection a great challenge, leading to existing models becoming more tedious and complex. Despite achieving high performance, they often overfi…
cs.LG2023
Confounder Balancing in Adversarial Domain Adaptation for Pre-Trained Large Models Fine-Tuning
Shuoran Jiang, Qingcai Chen, Yang Xiang +2
The excellent generalization, contextual learning, and emergence abilities in the pre-trained large models (PLMs) handle specific tasks without direct training data, making them th…