activity
20202024
most citedAdding Recurrence to Pretrained Transformers for Improved Efficiency and Context Size

4 citations · 4 across the 6 of their papers we have counts for

collaborators
Showing 2021Show all

1 paper · 1 filter

cs.CL2021

Reconsidering the Past: Optimizing Hidden States in Language Models

Davis Yoshida, Kevin Gimpel

We present Hidden-State Optimization (HSO), a gradient-based method for improving the performance of transformer language models at inference time. Similar to dynamic evaluation (K…