4 papers
BEAST3D: Animal behavioral analysis and neural encoding from multi-view video via Gaussian splatting
Yanchen Wang, Lenny Aharon, Wangshu Zhu +7
Multi-view video recordings are increasingly used to capture the 3D movements of animals in experimental settings, yet extracting rich 3D representations from these recordings rema…
Animal behavioral analysis and neural encoding with transformer-based self-supervised pretraining
Yanchen Wang, Han Yu, Ari Blau +5
The brain can only be fully understood through the lens of the behavior it generates -- a guiding principle in modern neuroscience research that nevertheless presents significant t…
An uncertainty-aware framework for data-efficient multi-view animal pose estimation
Lenny Aharon, Keemin Lee, Karan Sikka +4
Multi-view pose estimation is essential for quantifying animal behavior in scientific research, yet current methods struggle to achieve accurate tracking with limited labeled data…
A study of animal action segmentation algorithms across supervised, unsupervised, and semi-supervised learning paradigms
Ari Blau, Evan S Schaffer, Neeli Mishra +4
Action segmentation of behavioral videos is the process of labeling each frame as belonging to one or more discrete classes, and is a crucial component of many studies that investi…