1 citations · 1 across the 21 of their papers we have counts for
24 papers
TransCAVE-E: A distributed virtual reality testbed for adaptive external human-machine interfaces
Yun Ye, Zexuan Li, Haoyang Liang +3
External human-machine interfaces (eHMIs) are evolving from predefined displays toward adaptive communication strategies that respond to changing traffic and road-user states. This…
Learning Agile Perceptive Traversal of Sparse 3D Structures for Humanoids
Efe Ongan, Chong Zhang, Boyang Sun +3
Traversing sparse 3D structures requires humanoid robots to perceive thin, overhanging geometry while executing agile, accurate whole-body motions. We study this problem through mo…
EgoTrack3D: A Modular Framework for Egocentric 3D Object Tracking
Jan Kulik, Bjarni Dagur Thor Karason, Yung-Hsu Yang +3
Understanding 3D scenes from egocentric video is fundamental for robotics and autonomous navigation, yet rapid viewpoint changes and partial occlusions make building structured rep…
LIME: Learning Intent-aware Camera Motion from Egocentric Video
Boyang Sun, Jiajie Li, Yung-Hsu Yang +6
Autonomous robots often need to move their camera before they can act: to inspect an object, reveal an occluded region, or obtain a view that responds to a user's intent. While vis…
LocalNav: Distilling Frontier VLMs and Embodied RL for On-Device Object Goal Navigation
Nicolas Baumann, Liam Boyle, Pu Deng +5
Vision Language Models (VLMs) have emerged in the robotic domain as a powerful tool that enables environmental perception with language context, serving as a catalyst for open-voca…
PROSE: Training-Free Egocentric Scene Registration with Vision-Language Models
Zhiang Chen, Nahyuk Lee, Boyang Sun +4
Registering two captures of the same indoor space taken at different times underpins persistent spatial memory for robots and AR systems, yet the realistic version of this task is…
FunRec: Reconstructing Functional 3D Scenes from Egocentric Interaction Videos
Alexandros Delitzas, Chenyangguang Zhang, Alexey Gavryushin +8
We present FunRec, a method for reconstructing functional 3D digital twins of indoor scenes directly from egocentric RGB-D interaction videos. Unlike existing methods on articulate…
Memory Over Maps: 3D Object Localization Without Reconstruction
Rui Zhou, Xander Yap, Jianwen Cao +3
Target localization is a prerequisite for embodied tasks such as navigation and manipulation. Conventional approaches rely on constructing explicit 3D scene representations to enab…
OpenFrontier: General Navigation with Visual-Language Grounded Frontiers
Esteban Padilla-Cerdio, Boyang Sun, Marc Pollefeys +1
Open-world navigation requires robots to make decisions in complex everyday environments while adapting to flexible task requirements. Conventional navigation approaches often rely…
External Human-Machine Interface based on Intent Recognition: Framework Design and Experimental Validation
Boya Sun, Haotian Shi, Ying Ni +2
Increasing autonomous vehicles (AVs) in transportation systems makes effective interactions between AVs and pedestrians indispensable. External human--machine interface (eHMI), whi…
REACT3D: Recovering Articulations for Interactive Physical 3D Scenes
Zhao Huang, Boyang Sun, Alexandros Delitzas +2
Interactive 3D scenes are increasingly vital for embodied intelligence, yet existing datasets remain limited due to the labor-intensive process of annotating part segmentation, kin…
What Matters in RL-Based Methods for Object-Goal Navigation? An Empirical Study and A Unified Framework
Hongze Wang, Boyang Sun, Jiaxu Xing +5
Object-Goal Navigation (ObjectNav) is a key capability for deploying mobile robots in everyday environments such as homes, schools, and workplaces. In this task, an agent must loca…
Sight Over Site: Perception-Aware Reinforcement Learning for Efficient Robotic Inspection
Richard Kuhlmann, Jakob Wolfram, Boyang Sun +4
Autonomous inspection is a central problem in robotics, with applications ranging from industrial monitoring to search-and-rescue. Traditionally, inspection has often been reduced…
ActLoc: Learning to Localize on the Move via Active Viewpoint Selection
Jiajie Li, Boyang Sun, Luca Di Giammarino +2
Reliable localization is critical for robot navigation, yet most existing systems implicitly assume that all viewing directions at a location are equally informative. In practice,…
ForesightNav: Learning Scene Imagination for Efficient Exploration
Hardik Shah, Jiaxu Xing, Nico Messikommer +3
Understanding how humans leverage prior knowledge to navigate unseen environments while making exploratory decisions is essential for developing autonomous robots with similar abil…
SuperDec: 3D Scene Decomposition with Superquadric Primitives
Elisabetta Fedele, Boyang Sun, Leonidas Guibas +2
We present SuperDec, an approach for creating compact 3D scene representations via decomposition into superquadric primitives. While most recent works leverage geometric primitives…
VidBot: Learning Generalizable 3D Actions from In-the-Wild 2D Human Videos for Zero-Shot Robotic Manipulation
Hanzhi Chen, Boyang Sun, Anran Zhang +2
Future robots are envisioned as versatile systems capable of performing a variety of household tasks. The big question remains, how can we bridge the embodiment gap while minimizin…
SG-Tailor: Inter-Object Commonsense Relationship Reasoning for Scene Graph Manipulation
Haoliang Shang, Hanyu Wu, Guangyao Zhai +4
Scene graphs capture complex relationships among objects, serving as strong priors for content generation and manipulation. Yet, reasonably manipulating scene graphs -- whether by…
Loop Closure from Two Views: Revisiting PGO for Scalable Trajectory Estimation through Monocular Priors
Tian Yi Lim, Boyang Sun, Marc Pollefeys +1
(Visual) Simultaneous Localization and Mapping (SLAM) remains a fundamental challenge in enabling autonomous systems to navigate and understand large-scale environments. Traditiona…
FrontierNet: Learning Visual Cues to Explore
Boyang Sun, Hanzhi Chen, Stefan Leutenegger +3
Exploration of unknown environments is crucial for autonomous robots; it allows them to actively reason and decide on what new data to acquire for different tasks, such as mapping,…
Learning Where to Look: Self-supervised Viewpoint Selection for Active Localization using Geometrical Information
Luca Di Giammarino, Boyang Sun, Giorgio Grisetti +3
Accurate localization in diverse environments is a fundamental challenge in computer vision and robotics. The task involves determining a sensor's precise position and orientation,…
NeRF On-the-go: Exploiting Uncertainty for Distractor-free NeRFs in the Wild
Weining Ren, Zihan Zhu, Boyang Sun +3
Neural Radiance Fields (NeRFs) have shown remarkable success in synthesizing photorealistic views from multi-view images of static scenes, but face challenges in dynamic, real-worl…
A 3D Mixed Reality Interface for Human-Robot Teaming
Jiaqi Chen, Boyang Sun, Marc Pollefeys +1
This paper presents a mixed-reality human-robot teaming system. It allows human operators to see in real-time where robots are located, even if they are not in line of sight. The o…
Active Visual Localization for Multi-Agent Collaboration: A Data-Driven Approach
Matthew Hanlon, Boyang Sun, Marc Pollefeys +1
Rather than having each newly deployed robot create its own map of its surroundings, the growing availability of SLAM-enabled devices provides the option of simply localizing in a…