most citedBeyond BatchNorm: Towards a Unified Understanding of Normalization in Deep Learning

14 citations · 14 across the 2 of their papers we have counts for

collaborators

5 papers

cs.LG202114 cited

Beyond BatchNorm: Towards a Unified Understanding of Normalization in Deep Learning

Ekdeep Singh Lubana, Robert P. Dick, Hidenori Tanaka

Inspired by BatchNorm, there has been an explosion of normalization layers in deep learning. Recent works have identified a multitude of beneficial properties in BatchNorm to expla…

cs.CV2021

A Reinforcement-Learning-Based Energy-Efficient Framework for Multi-Task Video Analytics Pipeline

Yingying Zhao, Mingzhi Dong, Yujiang Wang +7

Deep-learning-based video processing has yielded transformative results in recent years. However, the video analytics pipeline is energy-intensive due to high data rates and relian…

cs.CV2021

MemX: An Attention-Aware Smart Eyewear System for Personalized Moment Auto-capture

Yuhu Chang, Yingying Zhao, Mingzhi Dong +7

This work presents MemX: a biologically-inspired attention-aware eyewear system developed with the goal of pursuing the long-awaited vision of a personalized visual Memex. MemX cap…

cs.CV2021

HVAQ: A High-Resolution Vision-Based Air Quality Dataset

Zuohui Chen, Tony Zhang, Zhuangzhi Chen +3

Air pollutants, such as particulate matter, negatively impact human health. Most existing pollution monitoring techniques use stationary sensors, which are typically sparsely deplo…

cs.CV2020

OrthoReg: Robust Network Pruning Using Orthonormality Regularization

Ekdeep Singh Lubana, Puja Trivedi, Conrad Hougen +2

Network pruning in Convolutional Neural Networks (CNNs) has been extensively investigated in recent years. To determine the impact of pruning a group of filters on a network's accu…