FlexAct: Why Learn when you can Pick?

Ramnath Kumar, Kyle Ritscher, Junmin Judy +2

Learning activation functions has emerged as a promising direction in deep learning, allowing networks to adapt activation mechanisms to task-specific demands. In this work, we int…