RayTran: 3D pose estimation and shape reconstruction of multiple objects from videos with ray-traced transformers

Michał J. Tyszkiewicz, Kevis-Kokitsi Maninis, Stefan Popov +1

We propose a transformer-based neural network architecture for multi-object 3D reconstruction from RGB videos. It relies on two alternative ways to represent its knowledge: as a gl…