24 citations · 30 across the 12 of their papers we have counts for
14 papers
Hydra++: Real-Time Hierarchical 3D Scene Graph Construction With Object-Level Shape Estimation
Hyungtae Lim, Nathan Hughes, Xihang Yu +5
3D scene graphs provide a hierarchical abstraction of environments by encoding spatial entities, such as objects and places, and their relationships. However, existing scene graph…
3D Scene Graphs: Open Challenges and Future Directions
Dennis Rotondi, Francesco Argenziano, Sebastian Koch +10
3D Scene Graphs (3DSGs) have emerged as a powerful representation for spatial AI by combining geometric grounding with semantic and relational abstractions of the environment. Thei…
Advancing AI Challenges for the United States Department of the Air Force
Christian Prothmann, Vijay Gadepally, Jeremy Kepner +35
The DAF-MIT AI Accelerator is a collaboration between the United States Department of the Air Force (DAF) and the Massachusetts Institute of Technology (MIT). This program pioneers…
Language-Grounded Hierarchical Planning and Execution with Multi-Robot 3D Scene Graphs
Jared Strader, Aaron Ray, Jacob Arkin +11
In this paper, we introduce a multi-robot system that integrates mapping, localization, and task and motion planning (TAMP) enabled by 3D scene graphs to execute complex instructio…
Clio: Real-time Task-Driven Open-Set 3D Scene Graphs
Dominic Maggio, Yun Chang, Nathan Hughes +6
Modern tools for class-agnostic image segmentation (e.g., SegmentAnything) and open-set semantic understanding (e.g., CLIP) provide unprecedented opportunities for robot perception…
Kimera2: Robust and Accurate Metric-Semantic SLAM in the Real World
Marcus Abate, Yun Chang, Nathan Hughes +1
We present improvements to Kimera, an open-source metric-semantic visual-inertial SLAM library. In particular, we enhance Kimera-VIO, the visual-inertial odometry pipeline powering…
Indoor and Outdoor 3D Scene Graph Generation via Language-Enabled Spatial Ontologies
Jared Strader, Nathan Hughes, William Chen +2
This paper proposes an approach to build 3D scene graphs in arbitrary indoor and outdoor environments. Such extension is challenging; the hierarchy of concepts that describe an out…
Foundations of Spatial Perception for Robotics: Hierarchical Representations and Real-time Systems
Nathan Hughes, Yun Chang, Siyi Hu +4
3D spatial perception is the problem of building and maintaining an actionable and persistent representation of the environment in real-time using sensor data and prior knowledge.…
Hydra-Multi: Collaborative Online Construction of 3D Scene Graphs with Multi-Robot Teams
Yun Chang, Nathan Hughes, Aaron Ray +1
3D scene graphs have recently emerged as an expressive high-level map representation that describes a 3D environment as a layered graph where nodes represent spatial concepts at mu…
Hydra: A Real-time Spatial Perception System for 3D Scene Graph Construction and Optimization
Nathan Hughes, Yun Chang, Luca Carlone
3D scene graphs have recently emerged as a powerful high-level representation of 3D environments. A 3D scene graph describes the environment as a layered graph where nodes represen…
Hierarchical Representations and Explicit Memory: Learning Effective Navigation Policies on 3D Scene Graphs using Graph Neural Networks
Zachary Ravichandran, Lisa Peng, Nathan Hughes +2
Representations are crucial for a robot to learn effective navigation policies. Recent work has shown that mid-level perceptual abstractions, such as depth estimates or 2D semantic…
Dynamic Grasping with a "Soft" Drone: From Theory to Practice
Joshua Fishman, Samuel Ubellacker, Nathan Hughes +1
Rigid grippers used in existing aerial manipulators require precise positioning to achieve successful grasps and transmit large contact forces that may destabilize the drone. This…
Kimera: from SLAM to Spatial Perception with 3D Dynamic Scene Graphs
Antoni Rosinol, Andrew Violette, Marcus Abate +5
Humans are able to form a complex mental model of the environment they move in. This mental model captures geometric and semantic aspects of the scene, describes the environment at…
Active Rendezvous for Multi-Robot Pose Graph Optimization using Sensing over Wi-Fi
Weiying Wang, Ninad Jadhav, Paul Vohs +3
We present a novel framework for collaboration amongst a team of robots performing Pose Graph Optimization (PGO) that addresses two important challenges for multi-robot SLAM: i) th…