T. H. Nguyen

most citedAsymptotic behaviour of learning rates in Armijo's condition

5 citations · 5 across the 1 of their papers we have counts for

collaborators

2 papers

math.OC2020★ 5 cited

Asymptotic behaviour of learning rates in Armijo's condition

Tuyen Trung Truong, Tuan Hang Nguyen

Fix a constant $0 < α < 1$ . For a $C^{1}$ function $f : R^{k} \to R$ , a point $x$ and a positive number $δ > 0$ , we say that Armijo's condition is satisfied if $f(x-δ\…

math.OC2018

Backtracking gradient descent method for general $C^{1}$ functions, with applications to Deep Learning

Tuyen Trung Truong, Tuan Hang Nguyen

While Standard gradient descent is one very popular optimisation method, its convergence cannot be proven beyond the class of functions whose gradient is globally Lipschitz continu…

Asymptotic behaviour of learning rates in Armijo's condition

Backtracking gradient descent method for general C1 functions, with applications to Deep Learning

Backtracking gradient descent method for general $C^{1}$ functions, with applications to Deep Learning