Prioritized Training on Points that are Learnable, Worth Learning, and Not Yet Learnt

Sören Mindermann, Jan Brauner, Muhammed Razzak +8

Training on web-scale data can take months. But most computation and time is wasted on redundant and noisy points that are already learnt or not learnable. To accelerate training,…