Showing cs.LGShow all
2 papers · 1 filter
cs.LG2026
A Unified Revisit of Temperature in Classification-Based Knowledge Distillation
Logan Frank, Jim Davis
A central idea of knowledge distillation is to expose relational structure embedded in the teacher's weights for the student to learn, which is often facilitated using a temperatur…
cs.LG2025
Assessing the Potential for Catastrophic Failure in Dynamic Post-Training Quantization
Logan Frank, Paul Ardis
Post-training quantization (PTQ) has recently emerged as an effective tool for reducing the computational complexity and memory usage of a neural network by representing its weight…