3 papers
cs.LG2026
Nora: Normalized Orthogonal Row Alignment for Scalable Matrix Optimizer
Jinghui Yuan, Jiaxuan Zou, Shuo Wang +2
Matrix-based optimizers have demonstrated immense potential in training Large Language Models (LLMs), however, designing an ideal optimizer remains a formidable challenge. A superi…
cs.LG2024
A Margin-Maximizing Fine-Grained Ensemble Method
Jinghui Yuan, Hao Chen, Renwei Luo +1
Ensemble learning has achieved remarkable success in machine learning, but its reliance on numerous base learners limits its application in resource-constrained environments. This…
cs.CV2024
Embedded Multi-label Feature Selection via Orthogonal Regression
Xueyuan Xu, Fulin Wei, Tianyuan Jia +3
In the last decade, embedded multi-label feature selection methods, incorporating the search for feature subsets into model optimization, have attracted considerable attention in a…