37 citations · 47 across the 3 of their papers we have counts for
3 papers
On 1/n neural representation and robustness
Josue Nassar, Piotr Aleksander Sokol, SueYeon Chung +2
Understanding the nature of representation in neural networks is a goal shared by neuroscience and machine learning. It is therefore exciting that both fields converge not only on…
Gated recurrent units viewed through the lens of continuous time dynamical systems
Ian D. Jordan, Piotr Aleksander Sokol, Il Memming Park
Gated recurrent units (GRUs) are specialized memory elements for building recurrent neural networks. Despite their incredible success on various tasks, including extracting dynamic…
Information Geometry of Orthogonal Initializations and Training
Piotr A. Sokol, Il Memming Park
Recently mean field theory has been successfully used to analyze properties of wide, random neural networks. It gave rise to a prescriptive theory for initializing feed-forward neu…