4 papers
Consistently Informative Soft-Label Temperature for Knowledge Distillation
Hoang-Chau Luong, Nghia Van Vo, Kaiqi Zhao +1
Knowledge distillation (KD) transfers knowledge from a high-capacity teacher to a compact student by matching their predictive distributions, with temperature scaling serving as a…
Inexact DC Algorithms in Hilbert Spaces with Applications to PDE-Constrained Optimization
P. D. Khanh, V. V. H. Khoa, B. S. Mordukhovich +2
In this paper, we design and apply novel inexact adaptive algorithms to deal with minimizing difference-of-convex (DC) functions in Hilbert spaces. We first introduce I-ADCA, an in…
Nonsmooth Newton methods with effective subspaces for polyhedral regularization
Tran T. A. Nghia, Nghia V. Vo, Khoa V. H. Vu
We propose several new nonsmooth Newton methods for solving convex composite optimization problems with polyhedral regularizers, while avoiding the computation of complicated secon…
Stable Recovery of Regularized Linear Inverse Problems
Tran T. A. Nghia, Huy N. Pham, Nghia V. Vo
Recovering a low-complexity signal from its noisy observations by regularization methods is a cornerstone of inverse problems and compressed sensing. Stable recovery ensures that t…