90 citations · 201 across the 21 of their papers we have counts for
13 papers · 1 filter
ConBaT: Control Barrier Transformer for Safe Policy Learning
Yue Meng, Sai Vemprala, Rogerio Bonatti +2
Large-scale self-supervised models have recently revolutionized our ability to perform a variety of tasks within the vision and language domains. However, using such models for aut…
PACT: Perception-Action Causal Transformer for Autoregressive Robotics Pre-Training
Rogerio Bonatti, Sai Vemprala, Shuang Ma +3
Robotics has long been a field riddled with complex systems architectures whose modules and connections, whether traditional or learning-based, require significant human expertise…
LATTE: LAnguage Trajectory TransformEr
Arthur Bucker, Luis Figueredo, Sami Haddadin +4
Natural language is one of the most intuitive ways to express human intent. However, translating instructions and commands towards robotic motion generation and deployment in the r…
Reshaping Robot Trajectories Using Natural Language Commands: A Study of Multi-Modal Data Alignment Using Transformers
Arthur Bucker, Luis Figueredo, Sami Haddadin +3
Natural language is the most intuitive medium for us to interact with other people when expressing commands and instructions. However, using language is seldom an easy task when hu…
Adaptive Safety Margin Estimation for Safe Real-Time Replanning under Time-Varying Disturbance
Cherie Ho, Jay Patrikar, Rogerio Bonatti +1
Safe navigation in real-time is challenging because engineers need to work with uncertain vehicle dynamics, variable external disturbances, and imperfect controllers. A common safe…
3D Human Reconstruction in the Wild with Collaborative Aerial Cameras
Cherie Ho, Andrew Jong, Harry Freeman +3
Aerial vehicles are revolutionizing applications that require capturing the 3D structure of dynamic targets in the wild, such as sports, medicine, and entertainment. The core chall…
Visual Servoing Approach for Autonomous UAV Landing on a Moving Vehicle
Azarakhsh Keipour, Guilherme A. S. Pereira, Rogerio Bonatti +4
Many aerial robotic applications require the ability to land on moving platforms, such as delivery trucks and marine research boats. We present a method to autonomously land an Unm…
Do You See What I See? Coordinating Multiple Aerial Cameras for Robot Cinematography
Arthur Bucker, Rogerio Bonatti, Sebastian Scherer
Aerial cinematography is significantly expanding the capabilities of film-makers. Recent progress in autonomous unmanned aerial vehicles (UAVs) has further increased the potential…
Autonomous Aerial Cinematography In Unstructured Environments With Learned Artistic Decision-Making
Rogerio Bonatti, Wenshan Wang, Cherie Ho +6
Aerial cinematography is revolutionizing industries that require live and dynamic camera viewpoints such as entertainment, sports, and security. However, safely piloting a drone wh…
Can a Robot Become a Movie Director? Learning Artistic Principles for Aerial Cinematography
Mirko Gschwindt, Efe Camci, Rogerio Bonatti +3
Aerial filming is constantly gaining importance due to the recent advances in drone technology. It invites many intriguing, unsolved problems at the intersection of aesthetical and…
Towards a Robust Aerial Cinematography Platform: Localizing and Tracking Moving Targets in Unstructured Environments
Rogerio Bonatti, Cherie Ho, Wenshan Wang +2
The use of drones for aerial cinematography has revolutionized several applications and industries that require live and dynamic camera viewpoints such as entertainment, sports, an…
Integrating kinematics and environment context into deep inverse reinforcement learning for predicting off-road vehicle trajectories
Yanfu Zhang, Wenshan Wang, Rogerio Bonatti +2
Predicting the motion of a mobile agent from a third-person perspective is an important component for many robotics applications, such as autonomous navigation and tracking. With a…
Autonomous drone cinematographer: Using artistic principles to create smooth, safe, occlusion-free trajectories for aerial filming
Rogerio Bonatti, Yanfu Zhang, Sanjiban Choudhury +2
Autonomous aerial cinematography has the potential to enable automatic capture of aesthetically pleasing videos without requiring human intervention, empowering individuals with th…