22 citations · 40 across the 11 of their papers we have counts for
11 papers
HandMvNet: Real-Time 3D Hand Pose Estimation Using Multi-View Cross-Attention Fusion
Muhammad Asad Ali, Nadia Robertini, Didier Stricker
In this work, we present HandMvNet, one of the first real-time method designed to estimate 3D hand motion and shape from multi-view camera images. Unlike previous monocular approac…
MoTE: Mixture of Task Experts for Multi-Task Video Understanding
Muhammad Asad Ali, Umar Khan, Nadia Robertini +1
Procedural video-language models must solve heterogeneous tasks from the same visual evidence, including action recognition, forecasting, and procedure prediction. Dense transforme…
GHOST: Fast Category-agnostic Hand-Object Interaction Reconstruction from RGB Videos using Gaussian Splatting
Ahmed Tawfik Aboukhadra, Marcel Rogge, Nadia Robertini +4
Understanding realistic hand-object interactions from monocular RGB videos is essential for AR/VR, robotics, and embodied AI. Existing methods rely on category-specific templates o…
Fast-HaMeR: Boosting Hand Mesh Reconstruction using Knowledge Distillation
Hunain Ahmed Jillani, Ahmed Tawfik Aboukhadra, Ahmed Elhayek +3
Fast and accurate 3D hand reconstruction is essential for real-time applications in VR/AR, human-computer interaction, robotics, and healthcare. Most state-of-the-art methods rely…
SurgeoNet: Realtime 3D Pose Estimation of Articulated Surgical Instruments from Stereo Images using a Synthetically-trained Network
Ahmed Tawfik Aboukhadra, Nadia Robertini, Jameel Malik +3
Surgery monitoring in Mixed Reality (MR) environments has recently received substantial focus due to its importance in image-based decisions, skill assessment, and robot-assisted s…
ShapeGraFormer: GraFormer-Based Network for Hand-Object Reconstruction from a Single Depth Map
Ahmed Tawfik Aboukhadra, Jameel Malik, Nadia Robertini +2
3D reconstruction of hand-object manipulations is important for emulating human actions. Most methods dealing with challenging object manipulation scenarios, focus on hands reconst…
THOR-Net: End-to-end Graformer-based Realistic Two Hands and Object Reconstruction with Self-supervision
Ahmed Tawfik Aboukhadra, Jameel Malik, Ahmed Elhayek +2
Realistic reconstruction of two hands interacting with objects is a new and challenging problem that is essential for building personalized Virtual and Augmented Reality environmen…
Model-based Outdoor Performance Capture
Nadia Robertini, Dan Casas, Helge Rhodin +2
We propose a new model-based method to accurately reconstruct human performances captured outdoors in a multi-camera setup. Starting from a template of the actor model, we introduc…
General Automatic Human Shape and Motion Capture Using Volumetric Contour Cues
Helge Rhodin, Nadia Robertini, Dan Casas +3
Markerless motion capture algorithms require a 3D body with properly personalized skeleton dimension and/or body shape and appearance to successfully track a person. Unfortunately,…
A Versatile Scene Model with Differentiable Visibility Applied to Generative Pose Estimation
Helge Rhodin, Nadia Robertini, Christian Richardt +2
Generative reconstruction methods compute the 3D configuration (such as pose and/or geometry) of a shape by optimizing the overlap of the projected 3D shape model with images. Prop…
Efficient Multi-view Performance Capture of Fine-Scale Surface Detail
Nadia Robertini, Edilson De Aguiar, Thomas Helten +1
We present a new effective way for performance capture of deforming meshes with fine-scale time-varying surface detail from multi-view video. Our method builds up on coarse 4D surf…