1 citations · 1 across the 12 of their papers we have counts for
12 papers · 1 filter
MotionBlind: Probing the Illusion of Motion Understanding in Video-LLMs
Dhairya Bhatia, Bishoy Galoaa, Oliver Fritsche +7
Video large language models (Video-LLMs) are increasingly used as the perceptual front end of world models, a role that assumes they can read motion: how fast something moves, whic…
PanoWorld: Geometry-Consistent Panoramic Video World Modeling
Le Jiang, Xiangyu Bai, Bishoy Galoaa +7
We present PanoWorld, a panoramic video world model that generates geometry-consistent 360 video from a single image and a caption. Existing panoramic video methods optimi…
HORNet: Task-Guided Frame Selection for Video Question Answering with Vision-Language Models
Xiangyu Bai, Bishoy Galoaa, Sarah Ostadabbas
Video question answering (VQA) with vision-language models (VLMs) depends critically on which frames are selected from the input video, yet most systems rely on uniform or heuristi…
Motion-o: Trajectory-Grounded Video Reasoning
Bishoy Galoaa, Shayda Moezzi, Xiangyu Bai +1
Recent video reasoning models increasingly produce spatio-temporal evidence chains that localize objects at specific timestamps. While these traces improve interpretability by grou…
UniTrack: Differentiable Graph Representation Learning for Multi-Object Tracking
Bishoy Galoaa, Xiangyu Bai, Utsav Nandi +3
We present UniTrack, a plug-and-play graph-theoretic loss function designed to significantly enhance multi-object tracking (MOT) performance by directly optimizing tracking-specifi…
Structure Over Scale: Learning Visual Reasoning from Pedagogical Video
Bishoy Galoaa, Xiangyu Bai, Sarah Ostadabbas
State-of-the-art vision-language models (VLMs) score impressively on video benchmarks yet stumble on basic visual reasoning tasks involving spatial relations, navigation, and objec…
K-Track: Kalman-Enhanced Tracking for Accelerating Deep Point Trackers on Edge Devices
Bishoy Galoaa, Pau Closas, Sarah Ostadabbas
Point tracking in video sequences is a foundational capability for real-world computer vision applications, including robotics, autonomous systems, augmented reality, and video ana…
Lang2Motion: Bridging Language and Motion through Joint Embedding Spaces
Bishoy Galoaa, Xiangyu Bai, Sarah Ostadabbas
We present Lang2Motion, a framework for language-guided point trajectory generation by aligning motion manifolds with joint embedding spaces. Unlike prior work focusing on human mo…
MoReGen: Multi-Agent Motion-Reasoning Engine for Code-based Text-to-Video Synthesis
Xiangyu Bai, He Liang, Bishoy Galoaa +4
While text-to-video (T2V) generation has achieved remarkable progress in photorealism, generating intent-aligned videos that faithfully obey physics principles remains a core chall…
Look Around and Pay Attention: Multi-camera Point Tracking Reimagined with Transformers
Bishoy Galoaa, Xiangyu Bai, Shayda Moezzi +4
This paper presents LAPA (Look Around and Pay Attention), a novel end-to-end transformer-based architecture for multi-camera point tracking that integrates appearance-based matchin…
Track and Caption Any Motion: Open-Vocabulary Spatiotemporal Captioning via Trajectory-Conditioned Generation
Bishoy Galoaa, Sarah Ostadabbas
We present TCAM (Track and Caption Any Motion), a generative framework that watches video without a text query or region prompt and produces open-vocabulary captions, temporal inte…
Multiple Toddler Tracking in Indoor Videos
Somaieh Amraee, Bishoy Galoaa, Matthew Goodwin +2
Multiple toddler tracking (MTT) involves identifying and differentiating toddlers in video footage. While conventional multi-object tracking (MOT) algorithms are adept at tracking…