14 papers
WildHSR: Metric Feed-Forward 4D People-Scene Reconstruction from a 3D Foundation Model
Jerrin Bright, John Zelek
3D foundation models recover video cameras and geometry in one forward pass, but some of the strongest are up to scale. Joint people-scene reconstruction then requires two missing…
CoGS: Compositional Dynamic Human-Object Scenes Gaussian Splatting from Monocular Video
Jerrin Bright, John Zelek
Reconstructing dynamic human--object interaction scenes from monocular video is difficult because the human, manipulated object, and background obey different motion models while s…
Interpretable Pre-Release Baseball Pitch Type Anticipation from Broadcast 3D Kinematics
Jerrin Bright, Michelle Lu, John Zelek
How much can a pitcher's body reveal about the upcoming pitch? We study this question at scale by classifying eight pitch types from monocular 3D pose sequences, without access to…
Scalable Injury-Risk Screening in Baseball Pitching From Broadcast Video
Jerrin Bright, Justin Mende, John Zelek
Injury prediction in pitching depends on precise biomechanical signals, yet gold-standard measurements come from expensive, stadium-installed multi-camera systems that are unavaila…
Avatar4D: Synthesizing Domain-Specific 4D Humans for Real-World Pose Estimation
Jerrin Bright, Zhibo Wang, Dmytro Klepachevskyi +4
We present Avatar4D, a real-world transferable pipeline for generating customizable synthetic human motion datasets tailored to domain-specific applications. Unlike prior works, wh…
DreamPose3D: Hallucinative Diffusion with Prompt Learning for 3D Human Pose Estimation
Jerrin Bright, Yuhao Chen, John S. Zelek
Accurate 3D human pose estimation remains a critical yet unresolved challenge, requiring both temporal coherence across frames and fine-grained modeling of joint relationships. How…
Ice Hockey Puck Localization Using Contextual Cues
Liam Salass, Jerrin Bright, Amir Nazemi +3
Puck detection in ice hockey broadcast videos poses significant challenges due to the puck's small size, frequent occlusions, motion blur, broadcast artifacts, and scale inconsiste…
Gen4D: Synthesizing Humans and Scenes in the Wild
Jerrin Bright, Zhibo Wang, Yuhao Chen +3
Lack of input data for in-the-wild activities often results in low performance across various computer vision tasks. This challenge is particularly pronounced in uncommon human-cen…
SportMamba: Adaptive Non-Linear Multi-Object Tracking with State Space Models for Team Sports
Dheeraj Khanna, Jerrin Bright, Yuhao Chen +1
Multi-object tracking (MOT) in team sports is particularly challenging due to the fast-paced motion and frequent occlusions resulting in motion blur and identity switches, respecti…
PitcherNet: Powering the Moneyball Evolution in Baseball Video Analytics
Jerrin Bright, Bavesh Balaji, Yuhao Chen +2
In the high-stakes world of baseball, every nuance of a pitcher's mechanics holds the key to maximizing performance and minimizing runs. Traditional analysis methods often rely on…
Domain-Guided Masked Autoencoders for Unique Player Identification
Bavesh Balaji, Jerrin Bright, Sirisha Rambhatla +4
Unique player identification is a fundamental module in vision-driven sports analytics. Identifying players from broadcast videos can aid with various downstream tasks such as play…
Distribution and Depth-Aware Transformers for 3D Human Mesh Recovery
Jerrin Bright, Bavesh Balaji, Harish Prakash +3
Precise Human Mesh Recovery (HMR) with in-the-wild data is a formidable challenge and is often hindered by depth ambiguities and reduced precision. Existing works resort to either…
Jersey Number Recognition using Keyframe Identification from Low-Resolution Broadcast Videos
Bavesh Balaji, Jerrin Bright, Harish Prakash +3
Player identification is a crucial component in vision-driven soccer analytics, enabling various downstream tasks such as player assessment, in-game analysis, and broadcast product…
Mitigating Motion Blur for Robust 3D Baseball Player Pose Modeling for Pitch Analysis
Jerrin Bright, Yuhao Chen, John Zelek
Using videos to analyze pitchers in baseball can play a vital role in strategizing and injury prevention. Computer vision-based pose analysis offers a time-efficient and cost-effec…