4 papers
BehaviorVLM: Unified Finetuning-Free Behavioral Understanding with Vision-Language Reasoning
Jingyang Ke, Weihan Li, Amartya Pradhan +2
Understanding freely moving animal behavior is central to neuroscience, where pose estimation and behavioral understanding form the foundation for linking neural activity to natura…
Learning When to Look: On-Demand Keypoint-Video Fusion for Animal Behavior Analysis
Weihan Li, Jingyang Ke, Yule Wang +2
Understanding animal behavior from video is essential for neuroscience research. Modern laboratories typically collect two complementary data streams: skeletal keypoints from pose…
Learning Task-Agnostic Motifs to Capture the Continuous Nature of Animal Behavior
Jiyi Wang, Jingyang Ke, Bo Dai +1
Animals flexibly recombine a finite set of core motor motifs to meet diverse task demands, but existing behavior segmentation methods oversimplify this process by imposing discrete…
Inverse Reinforcement Learning with Switching Rewards and History Dependency for Characterizing Animal Behaviors
Jingyang Ke, Feiyang Wu, Jiyi Wang +2
Traditional approaches to studying decision-making in neuroscience focus on simplified behavioral tasks where animals perform repetitive, stereotyped actions to receive explicit re…