81 citations · 88 across the 3 of their papers we have counts for
3 papers · 1 filter
Simplified State Space Layers for Sequence Modeling
Jimmy T. H. Smith, Andrew Warrington, Scott W. Linderman
Models using structured state space sequence (S4) layers have achieved state-of-the-art performance on long-range sequence modeling tasks. An S4 layer combines linear state space m…
Reverse engineering recurrent neural networks with Jacobian switching linear dynamical systems
Jimmy T. H. Smith, Scott W. Linderman, David Sussillo
Recurrent neural networks (RNNs) are powerful models for processing time-series data, but it remains challenging to understand how they function. Improving this understanding is of…
All-Action Policy Gradient Methods: A Numerical Integration Approach
Benjamin Petit, Loren Amdahl-Culleton, Yao Liu +2
While often stated as an instance of the likelihood ratio trick [Rubinstein, 1989], the original policy gradient theorem [Sutton, 1999] involves an integral over the action space.…