ReLU Code Space: A Basis for Rating Network Quality Besides Accuracy

Natalia Shepeleva, Werner Zellinger, Michal Lewandowski +1

We propose a new metric space of ReLU activation codes equipped with a truncated Hamming distance which establishes an isometry between its elements and polyhedral bodies in the in…