A Real-Time Region Tracking Algorithm Tailored to Endoscopic Video with Open-Source Implementation

Abstract

With a video data source, such as multispectral video acquired during administration of fluorescent tracers, extraction of time-resolved data typically requires the compensation of motion. While this can be done manually, which is arduous, or using off-the-shelf object tracking software, which often yields unsatisfactory performance, we present an algorithm which is simple and performant. Most importantly, we provide an open-source implementation, with an easy-to-use interface for researchers not inclined to write their own code, as well as Python modules that can be used programmatically.

Submitted to MICCAI 2022. Code can be found at https://github.com/IBM/optflow-region-tracker