2 papers
cond-mat.dis-nn2024
Geometric Dynamics of Signal Propagation Predict Trainability of Transformers
Aditya Cowsik, Tamra Nebabu, Xiao-Liang Qi +1
We investigate forward signal propagation and gradient back propagation in deep, randomly initialized transformers, yielding simple necessary and sufficient conditions on initializ…
quant-ph2023
Engineering entanglement geometry via spacetime-modulated measurements
Aditya Cowsik, Matteo Ippoliti, Xiao-Liang Qi
We introduce a general approach to realize quantum states with holographic entanglement structure via monitored dynamics. Starting from random unitary circuits in dimensions,…