2 papers
cs.LG2026
What do near-optimal learning rate schedules look like?
Hiroki Naganuma, Atish Agarwala, Priya Kasimbeg +1
A basic unanswered question in neural network training is: what is the best learning rate schedule shape for a given workload? The choice of learning rate schedule is a key factor…
stat.ML2024
Geometric Insights into Focal Loss: Reducing Curvature for Enhanced Model Calibration
Masanari Kimura, Hiroki Naganuma
The key factor in implementing machine learning algorithms in decision-making situations is not only the accuracy of the model but also its confidence level. The confidence level o…