Understanding Recurrent Neural State Using Memory Signatures

Skanda Koppula, Khe Chai Sim, Kean Chin

We demonstrate a network visualization technique to analyze the recurrent state inside the LSTMs/GRUs used commonly in language and acoustic models. Interpreting intermediate state…