74 citations · 78 across the 10 of their papers we have counts for
13 papers
CoPE-VideoLM: Leveraging Codec Primitives For Efficient Video Language Modeling
Sayan Deb Sarkar, Rémi Pautrat, Ondrej Miksik +4
Video Language Models (VideoLMs) enable AI systems to understand temporal dynamics in videos. To fit within the maximum context window constraint, current methods use keyframe samp…
Loc3R-VLM: Language-based Localization and 3D Reasoning with Vision-Language Models
Kevin Qu, Haozhe Qi, Mihai Dusmanu +3
Multimodal Large Language Models (MLLMs) have made impressive progress in connecting vision and language, but they still struggle with spatial understanding and viewpoint-aware rea…
MR.NAVI: Mixed-Reality Navigation Assistant for the Visually Impaired
Nicolas Pfitzer, Yifan Zhou, Marco Poggensee +5
Over 43 million people worldwide live with severe visual impairment, facing significant challenges in navigating unfamiliar environments. We present MR.NAVI, a mixed reality system…
Space3D-Bench: Spatial 3D Question Answering Benchmark
Emilia Szymanska, Mihai Dusmanu, Jan-Willem Buurlage +2
Answering questions about the spatial properties of the environment poses challenges for existing language and vision foundation models due to a lack of understanding of the 3D wor…
MaRINeR: Enhancing Novel Views by Matching Rendered Images with Nearby References
Lukas Bösiger, Mihai Dusmanu, Marc Pollefeys +1
Rendering realistic images from 3D reconstruction is an essential task of many Computer Vision and Robotics pipelines, notably for mixed-reality applications as well as training au…
EgoGen: An Egocentric Synthetic Data Generator
Gen Li, Kaifeng Zhao, Siwei Zhang +5
Understanding the world in first-person view is fundamental in Augmented Reality (AR). This immersive perspective brings dramatic visual changes and unique challenges compared to t…
LaMAR: Benchmarking Localization and Mapping for Augmented Reality
Paul-Edouard Sarlin, Mihai Dusmanu, Johannes L. Schönberger +5
Localization and mapping is the foundational technology for augmented reality (AR) that enables sharing and persistence of digital content in the real world. While significant prog…
Learning-Based Dimensionality Reduction for Computing Compact and Effective Local Feature Descriptors
Hao Dong, Xieyuanli Chen, Mihai Dusmanu +3
A distinctive representation of image patches in form of features is a key component of many computer vision and robotics tasks, such as image matching, image retrieval, and visual…
DeepVideoMVS: Multi-View Stereo on Video with Recurrent Spatio-Temporal Fusion
Arda Düzçeker, Silvano Galliani, Christoph Vogel +3
We propose an online multi-view depth prediction approach on posed video streams, where the scene geometry information computed in the previous time steps is propagated to the curr…
Cross-Descriptor Visual Localization and Mapping
Mihai Dusmanu, Ondrej Miksik, Johannes L. Schönberger +1
Visual localization and mapping is the key technology underlying the majority of mixed reality and robotics systems. Most state-of-the-art approaches rely on local features to esta…
Privacy-Preserving Image Features via Adversarial Affine Subspace Embeddings
Mihai Dusmanu, Johannes L. Schönberger, Sudipta N. Sinha +1
Many computer vision systems require users to upload image features to the cloud for processing and storage. These features can be exploited to recover sensitive information about…
Multi-View Optimization of Local Feature Geometry
Mihai Dusmanu, Johannes L. Schönberger, Marc Pollefeys
In this work, we address the problem of refining the geometry of local image features from multiple views without known scene or camera geometry. Current approaches to local featur…
D2-Net: A Trainable CNN for Joint Detection and Description of Local Features
Mihai Dusmanu, Ignacio Rocco, Tomas Pajdla +4
In this work we address the problem of finding reliable pixel-level correspondences under difficult imaging conditions. We propose an approach where a single convolutional neural n…