T. H. Nguyen

most citedAsymptotic behaviour of learning rates in Armijo's condition

5 citations · 7 across the 3 of their papers we have counts for

collaborators

3 papers

math.OC2020★ 5 cited

Asymptotic behaviour of learning rates in Armijo's condition

Tuyen Trung Truong, Tuan Hang Nguyen

Fix a constant $0 < α < 1$ . For a $C^{1}$ function $f : R^{k} \to R$ , a point $x$ and a positive number $δ > 0$ , we say that Armijo's condition is satisfied if $f(x-δ\…

math.OC2020★ 2 cited

A fast and simple modification of Newton's method helping to avoid saddle points

Tuyen Trung Truong, Tat Dat To, Tuan Hang Nguyen +3

We propose in this paper New Q-Newton's method. The update rule is very simple conceptually, for example $x_{n + 1} = x_{n} - w_{n}$ where $w_{n} = p r_{A_{n}, +} (v_{n}) - p r_{A_{n}, -} (v_{n})$ , with $A_n=\n…

math.OC2018

Backtracking gradient descent method for general $C^{1}$ functions, with applications to Deep Learning

Tuyen Trung Truong, Tuan Hang Nguyen

While Standard gradient descent is one very popular optimisation method, its convergence cannot be proven beyond the class of functions whose gradient is globally Lipschitz continu…

Asymptotic behaviour of learning rates in Armijo's condition

A fast and simple modification of Newton's method helping to avoid saddle points

Backtracking gradient descent method for general C1 functions, with applications to Deep Learning

Backtracking gradient descent method for general $C^{1}$ functions, with applications to Deep Learning