On the Query Strategies for Efficient Online Active Distillation

Michele Boldo, Enrico Martini, Mirco De Marchi +2

Deep Learning (DL) requires lots of time and data, resulting in high computational demands. Recently, researchers employ Active Learning (AL) and online distillation to enhance tra…