Quantifying Memory Utilization with Effective State-Size

Rom N. Parnichkun, Neehal Tumma, Armin W. Thomas +6

The need to develop a general framework for architecture analysis is becoming increasingly important, given the expanding design space of sequence models. To this end, we draw insi…