372 citations · 849 across the 97 of their papers we have counts for
50 papers · 1 filter
FreeCHROMA: Generative Chroma Keying from Unaligned Background References
Jiayi Wu, Tianfu Wang, Rui Zhao +6
In film production, chroma keying composites an approved foreground performance into a new environment, but conventional workflows require coordinated background plates and dedicat…
WaterGen: Decoupling Scene and Medium in Underwater Image Generation
Jiayi Wu, Tianfu Wang, Tianyi Xiong +6
Underwater computer vision tasks, such as detection, restoration, and segmentation, are limited by the scarcity of large-scale and diverse training data. We introduce WaterGen, a m…
Real2SAM2Real: Generative 3D Caches as Complementary Context for Video Diffusion
Jiayi Wu, Haoming Cai, Cornelia Fermuller +2
Video Diffusion Models (VDMs) synthesize high-quality videos, but precise camera and motion control remains challenging when large viewpoint shifts, changing occlusions, or complex…
FEEL (Force-Enhanced Egocentric Learning): A Dataset for Physical Action Understanding
Eadom Dessalene, Botao He, Michael Maynord +5
We introduce FEEL (Force-Enhanced Egocentric Learning), the first large-scale dataset pairing force measurements gathered from custom piezoresistive gloves with egocentric video. O…
Odometry Without Correspondence from Inertially Constrained Ruled Surfaces
Chenqi Zhu, Levi Burner, Yiannis Aloimonos
Visual odometry techniques typically rely on feature extraction from a sequence of images and subsequent computation of optical flow. This point-to-point correspondence between two…
EREBUS: End-to-end Robust Event Based Underwater Simulation
Hitesh Kyatham, Arjun Suresh, Aadi Palnitkar +1
The underwater domain presents a vast array of challenges for roboticists and computer vision researchers alike, such as poor lighting conditions and high dynamic range scenes. In…
From Inpainting to Layer Decomposition: Repurposing Generative Inpainting Models for Image Layer Decomposition
Jingxi Chen, Yixiao Zhang, Xiaoye Qian +4
Images can be viewed as layered compositions, foreground objects over background, with potential occlusions. This layered representation enables independent editing of elements, of…
First Frame Is the Place to Go for Video Content Customization
Jingxi Chen, Zongxia Li, Zhichao Liu +6
What role does the first frame play in video generation models? Traditionally, it's viewed as the spatial-temporal starting point of a video, merely a seed for subsequent animation…
ControlTac: Scaling Tactile Data with Physically Controlled Tactile Image Generation
Dongyu Luo, Kelin Yu, Amir-Hossein Shahidzadeh +3
Vision-based tactile sensing is widely used in perception, reconstruction, and robotic manipulation, yet collecting large-scale tactile data remains costly due to diverse sensor-ob…
Future Aspects in Human Action Recognition: Exploring Emerging Techniques and Ethical Influences
Antonios Gasteratos, Stavros N. Moutsis, Konstantinos A. Tsintotas +1
Visual-based human action recognition can be found in various application fields, e.g., surveillance systems, sports analytics, medical assistive technologies, or human-robot inter…
Learning Normal Flow Directly From Event Neighborhoods
Dehao Yuan, Levi Burner, Jiayi Wu +4
Event-based motion field estimation is an important task. However, current optical flow methods face challenges: learning-based approaches, often frame-based and relying on CNNs, l…
Repurposing Pre-trained Video Diffusion Models for Event-based Video Interpolation
Jingxi Chen, Brandon Y. Feng, Haoming Cai +6
Video Frame Interpolation aims to recover realistic missing frames between observed frames, generating a high-frame-rate video from a low-frame-rate video. However, without additio…
Exploring Emerging Trends and Research Opportunities in Visual Place Recognition
Antonios Gasteratos, Konstantinos A. Tsintotas, Tobias Fischer +2
Visual-based recognition, e.g., image classification, object detection, etc., is a long-standing challenge in computer vision and robotics communities. Concerning the roboticists,…
ODYSSEE: Oyster Detection Yielded by Sensor Systems on Edge Electronics
Xiaomin Lin, Vivek Mange, Arjun Suresh +11
Oysters are a vital keystone species in coastal ecosystems, providing significant economic, environmental, and cultural benefits. As the importance of oysters grows, so does the re…
Embodiment: Self-Supervised Depth Estimation Based on Camera Models
Jinchang Zhang, Praveen Kumar Reddy, Xue-Iuan Wong +2
Depth estimation is a critical topic for robotics and vision-related tasks. In monocular depth estimation, in comparison with supervised learning that requires expensive ground tru…
CodedEvents: Optimal Point-Spread-Function Engineering for 3D-Tracking with Event Cameras
Sachin Shah, Matthew Albert Chan, Haoming Cai +5
Point-spread-function (PSF) engineering is a well-established computational imaging technique that uses phase masks and other optical elements to embed extra information (e.g., dep…
Diving Deep into the Motion Representation of Video-Text Models
Chinmaya Devaraj, Cornelia Fermuller, Yiannis Aloimonos
Videos are more informative than images because they capture the dynamics of the scene. By representing motion in videos, we can capture dynamic activities. In this work, we introd…
Event3DGS: Event-Based 3D Gaussian Splatting for High-Speed Robot Egomotion
Tianyi Xiong, Jiayi Wu, Botao He +4
By combining differentiable rendering with explicit point-based scene representations, 3D Gaussian Splatting (3DGS) has demonstrated breakthrough 3D reconstruction capabilities. Ho…
A Linear Time and Space Local Point Cloud Geometry Encoder via Vectorized Kernel Mixture (VecKM)
Dehao Yuan, Cornelia Fermüller, Tahseen Rabbani +2
We propose VecKM, a local point cloud geometry encoder that is descriptive and efficient to compute. VecKM leverages a unique approach by vectorizing a kernel mixture to represent…
TimeRewind: Rewinding Time with Image-and-Events Video Diffusion
Jingxi Chen, Brandon Y. Feng, Haoming Cai +4
This paper addresses the novel challenge of ``rewinding'' time from a single captured image to recover the fleeting moments missed just before the shutter button is pressed. This p…
MARVIS: Motion & Geometry Aware Real and Virtual Image Segmentation
Jiayi Wu, Xiaomin Lin, Shahriar Negahdaripour +2
Tasks such as autonomous navigation, 3D reconstruction, and object recognition near the water surfaces are crucial in marine robotics applications. However, challenges arise due to…
LEAP: LLM-Generation of Egocentric Action Programs
Eadom Dessalene, Michael Maynord, Cornelia Fermüller +1
We introduce LEAP (illustrated in Figure 1), a novel method for generating video-grounded action programs through use of a Large Language Model (LLM). These action programs represe…
Decodable and Sample Invariant Continuous Object Encoder
Dehao Yuan, Furong Huang, Cornelia Fermüller +1
We propose Hyper-Dimensional Function Encoding (HDFE). Given samples of a continuous object (e.g. a function), HDFE produces an explicit vector representation of the given object,…
Whale Detection Enhancement through Synthetic Satellite Images
Akshaj Gaur, Cheng Liu, Xiaomin Lin +2
With a number of marine populations in rapid decline, collecting and analyzing data about marine populations has become increasingly important to develop effective conservation pol…