PatchBatch: a Batch Augmented Loss for Optical Flow
arXiv:1512.01815
Abstract
We propose a new pipeline for optical flow computation, based on Deep Learning techniques. We suggest using a Siamese CNN to independently, and in parallel, compute the descriptors of both images. The learned descriptors are then compared efficiently using the L2 norm and do not require network processing of patch pairs. The success of the method is based on an innovative loss function that computes higher moments of the loss distributions for each training batch. Combined with an Approximate Nearest Neighbor patch matching method and a flow interpolation technique, state of the art performance is obtained on the most challenging and competitive optical flow benchmarks.
CVPR 2016
References in corpus (8)
- Very Deep Convolutional Networks for Large-Scale Image Recognition
- ADADELTA: An Adaptive Learning Rate Method
- FitNets: Hints for Thin Deep Nets
- Computing the Stereo Matching Cost with a Convolutional Neural Network
- FlowNet: Learning Optical Flow with Convolutional Networks
- Learning to Compare Image Patches via Convolutional Neural Networks
- EpicFlow: Edge-Preserving Interpolation of Correspondences for Optical Flow
- DeepMatching: Hierarchical Deformable Dense Matching