Showing cs.LGShow all
2 papers · 1 filter
cs.LG2026
Beyond Student: An Asymmetric Network for Neural Network Inheritance
Yiyun Zhou, Jingwei Shi, Mingjing Xu +2
Knowledge Distillation (KD) has emerged as a powerful technique for model compression, enabling lightweight student networks to benefit from the performance of redundant teacher ne…
cs.LG2024
PSMGD: Periodic Stochastic Multi-Gradient Descent for Fast Multi-Objective Optimization
Mingjing Xu, Peizhong Ju, Jia Liu +1
Multi-objective optimization (MOO) lies at the core of many machine learning (ML) applications that involve multiple, potentially conflicting objectives (e.g., multi-task learning,…