3 papers
cs.LG2026
Weak Convergence Analysis of Online Neural Actor-Critic Algorithms
Samuel Chun-Hei Lam, Justin Sirignano, Ziheng Wang
We prove that a single-layer neural network trained with the online actor critic algorithm converges in distribution to a random ordinary differential equation (ODE) as the number…
cs.LG2026
Kernel Limit for a Class of Recurrent Neural Networks Trained on Ergodic Data Sequences
Samuel Chun-Hei Lam, Justin Sirignano, Konstantinos Spiliopoulos
Mathematical methods are developed to characterize the asymptotics of recurrent neural networks (RNN) as the number of hidden units, data samples in the sequence, hidden state upda…
cs.LG2025
Convergence Analysis of Real-time Recurrent Learning (RTRL) for a class of Recurrent Neural Networks
Samuel Chun-Hei Lam, Justin Sirignano, Konstantinos Spiliopoulos
Recurrent neural networks (RNNs) are commonly trained with the truncated backpropagation-through-time (TBPTT) algorithm. For the purposes of computational tractability, the TBPTT a…