activity
20192025
most citedBeyond the Imitation Game: Quantifying and extrapolating the capabilities of language models

565 citations · 923 across the 10 of their papers we have counts for

collaborators
Showing 2025Show all

1 paper · 1 filter

cs.LG2025

Fishers for Free? Approximating the Fisher Information Matrix by Recycling the Squared Gradient Accumulator

YuXin Li, Felix Dangel, Derek Tam +1

The diagonal of a model's Fisher Information Matrix (the "Fisher diagonal") has frequently been used as a way to measure parameter sensitivity. Typically, the Fisher diagonal is es…