Structural Dropout for Model Width Compression

Julian Knodt

Existing ML models are known to be highly over-parametrized, and use significantly more resources than required for a given task. Prior work has explored compressing models offline…