1 citations · 1 across the 3 of their papers we have counts for
1 paper · 1 filter
Joao V. Cavalcanti, Ashia C. Wilson
Post-training quantization pipelines routinely leave the softmax output layer in high precision. Yet in small LLMs with modern vocabularies, the head holds 15--30\% of all paramete…