2 papers
cs.LG2026
On the Architectural Complexity of Neural Networks
Nicholas J. Cooper, François G. Meyer, Michael L. Roberts +3
We introduce a unified theoretical framework for the rigorous analysis and systematic construction of deep neural networks (DNNs). This framework addresses a gap in existing theory…
cs.CV2025
Logit-Based Losses Limit the Effectiveness of Feature Knowledge Distillation
Nicholas Cooper, Lijun Chen, Sailesh Dwivedy +1
Knowledge distillation (KD) methods can transfer knowledge of a parameter-heavy teacher model to a light-weight student model. The status quo for feature KD methods is to utilize l…