1 paper · 1 filter
Alex Nguyen, Kenneth A. Norman, Gautam Reddy
Larger transformers can memorize more data, with a capacity (in bits) that scales roughly linearly with the number of parameters. Counterintuitively, larger models also memorize fa…