LogAvgExp Provides a Principled and Performant Global Pooling Operator

Scott C. Lowe, Thomas Trappenberg, Sageev Oore

We seek to improve the pooling operation in neural networks, by applying a more theoretically justified operator. We demonstrate that LogSumExp provides a natural OR operator for l…