DNNs May Determine Major Properties of Their Outputs Early, with Timing Possibly Driven by Bias

Song Park, Sanghyuk Chun, Byeongho Heo +1

This paper argues that deep neural networks (DNNs) mostly determine their outputs during the early stages of inference, where biases inherent in the model play a crucial role in sh…