6 papers
Egocentric Event-Based Vision for Ping Pong Ball Trajectory Prediction
Ivan Alberico, Marco Cannici, Giovanni Cioffi +1
In this paper, we present a real-time egocentric trajectory prediction system for table tennis using event cameras. Unlike standard cameras, which suffer from high latency and moti…
Reading in the Dark with Foveated Event Vision
Carl Brander, Giovanni Cioffi, Nico Messikommer +1
Current smart glasses equipped with RGB cameras struggle to perceive the environment in low-light and high-speed motion scenarios due to motion blur and the limited dynamic range o…
Perturbed State Space Feature Encoders for Optical Flow with Event Cameras
Gokul Raju Govinda Raju, Nikola Zubić, Marco Cannici +1
With their motion-responsive nature, event-based cameras offer significant advantages over traditional cameras for optical flow estimation. While deep learning has improved upon tr…
LiDAR Registration with Visual Foundation Models
Niclas Vödisch, Giovanni Cioffi, Marco Cannici +2
LiDAR registration is a fundamental task in robotic mapping and localization. A critical component of aligning two point clouds is identifying robust point correspondences using po…
GEM: A Generalizable Ego-Vision Multimodal World Model for Fine-Grained Ego-Motion, Object Dynamics, and Scene Composition Control
Mariam Hassan, Sebastian Stapf, Ahmad Rahimi +17
We present GEM, a Generalizable Ego-vision Multimodal world model that predicts future frames using a reference frame, sparse features, human poses, and ego-trajectories. Hence, ou…
Monocular Event-Based Vision for Obstacle Avoidance with a Quadrotor
Anish Bhattacharya, Marco Cannici, Nishanth Rao +4
We present the first static-obstacle avoidance method for quadrotors using just an onboard, monocular event camera. Quadrotors are capable of fast and agile flight in cluttered env…