90 citations · 201 across the 21 of their papers we have counts for
21 papers
EvDNeRF: Reconstructing Event Data with Dynamic Neural Radiance Fields
Anish Bhattacharya, Ratnesh Madaan, Fernando Cladera +7
We present EvDNeRF, a pipeline for generating event data and training an event-based dynamic NeRF, for the purpose of faithfully reconstructing eventstreams on scenes with rigid an…
ChatGPT for Robotics: Design Principles and Model Abilities
Sai Vemprala, Rogerio Bonatti, Arthur Bucker +1
This paper presents an experimental study regarding the use of OpenAI's ChatGPT for robotics applications. We outline a strategy that combines design principles for prompt engineer…
Is Imitation All You Need? Generalized Decision-Making with Dual-Phase Training
Yao Wei, Yanchao Sun, Ruijie Zheng +7
We introduce DualMind, a generalist agent designed to tackle various decision-making tasks that addresses challenges posed by current methods, such as overfitting behaviors and dep…
ConBaT: Control Barrier Transformer for Safe Policy Learning
Yue Meng, Sai Vemprala, Rogerio Bonatti +2
Large-scale self-supervised models have recently revolutionized our ability to perform a variety of tasks within the vision and language domains. However, using such models for aut…
SMART: Self-supervised Multi-task pretrAining with contRol Transformers
Yanchao Sun, Shuang Ma, Ratnesh Madaan +3
Self-supervised pretraining has been extensively studied in language and vision domains, where a unified model can be easily adapted to various downstream tasks by pretraining repr…
PACT: Perception-Action Causal Transformer for Autoregressive Robotics Pre-Training
Rogerio Bonatti, Sai Vemprala, Shuang Ma +3
Robotics has long been a field riddled with complex systems architectures whose modules and connections, whether traditional or learning-based, require significant human expertise…
LATTE: LAnguage Trajectory TransformEr
Arthur Bucker, Luis Figueredo, Sami Haddadin +4
Natural language is one of the most intuitive ways to express human intent. However, translating instructions and commands towards robotic motion generation and deployment in the r…
Reshaping Robot Trajectories Using Natural Language Commands: A Study of Multi-Modal Data Alignment Using Transformers
Arthur Bucker, Luis Figueredo, Sami Haddadin +3
Natural language is the most intuitive medium for us to interact with other people when expressing commands and instructions. However, using language is seldom an easy task when hu…
Adaptive Safety Margin Estimation for Safe Real-Time Replanning under Time-Varying Disturbance
Cherie Ho, Jay Patrikar, Rogerio Bonatti +1
Safe navigation in real-time is challenging because engineers need to work with uncertain vehicle dynamics, variable external disturbances, and imperfect controllers. A common safe…
3D Human Reconstruction in the Wild with Collaborative Aerial Cameras
Cherie Ho, Andrew Jong, Harry Freeman +3
Aerial vehicles are revolutionizing applications that require capturing the 3D structure of dynamic targets in the wild, such as sports, medicine, and entertainment. The core chall…
Visual Servoing Approach for Autonomous UAV Landing on a Moving Vehicle
Azarakhsh Keipour, Guilherme A. S. Pereira, Rogerio Bonatti +4
Many aerial robotic applications require the ability to land on moving platforms, such as delivery trucks and marine research boats. We present a method to autonomously land an Unm…
Batteries, camera, action! Learning a semantic control space for expressive robot cinematography
Rogerio Bonatti, Arthur Bucker, Sebastian Scherer +2
Aerial vehicles are revolutionizing the way film-makers can capture shots of actors by composing novel aerial and dynamic viewpoints. However, despite great advancements in autonom…
Do You See What I See? Coordinating Multiple Aerial Cameras for Robot Cinematography
Arthur Bucker, Rogerio Bonatti, Sebastian Scherer
Aerial cinematography is significantly expanding the capabilities of film-makers. Recent progress in autonomous unmanned aerial vehicles (UAVs) has further increased the potential…
Autonomous Aerial Cinematography In Unstructured Environments With Learned Artistic Decision-Making
Rogerio Bonatti, Wenshan Wang, Cherie Ho +6
Aerial cinematography is revolutionizing industries that require live and dynamic camera viewpoints such as entertainment, sports, and security. However, safely piloting a drone wh…
Learning Visuomotor Policies for Aerial Navigation Using Cross-Modal Representations
Rogerio Bonatti, Ratnesh Madaan, Vibhav Vineet +2
Machines are a long way from robustly solving open-world perception-control tasks, such as first-person view (FPV) aerial navigation. While recent advances in end-to-end Machine Le…
Development of email classifier in Brazilian Portuguese using feature selection for automatic response
Rogerio Bonatti, Arthur Gola de Paula
Automatic email categorization is an important application of text classification. We study the automatic reply of email business messages in Brazilian Portuguese. We present a nov…
Can a Robot Become a Movie Director? Learning Artistic Principles for Aerial Cinematography
Mirko Gschwindt, Efe Camci, Rogerio Bonatti +3
Aerial filming is constantly gaining importance due to the recent advances in drone technology. It invites many intriguing, unsolved problems at the intersection of aesthetical and…
Towards a Robust Aerial Cinematography Platform: Localizing and Tracking Moving Targets in Unstructured Environments
Rogerio Bonatti, Cherie Ho, Wenshan Wang +2
The use of drones for aerial cinematography has revolutionized several applications and industries that require live and dynamic camera viewpoints such as entertainment, sports, an…
Improved Generalization of Heading Direction Estimation for Aerial Filming Using Semi-supervised Regression
Wenshan Wang, Aayush Ahuja, Yanfu Zhang +2
In the task of Autonomous aerial filming of a moving actor (e.g. a person or a vehicle), it is crucial to have a good heading direction estimation for the actor from the visual inp…
Integrating kinematics and environment context into deep inverse reinforcement learning for predicting off-road vehicle trajectories
Yanfu Zhang, Wenshan Wang, Rogerio Bonatti +2
Predicting the motion of a mobile agent from a third-person perspective is an important component for many robotics applications, such as autonomous navigation and tracking. With a…
Autonomous drone cinematographer: Using artistic principles to create smooth, safe, occlusion-free trajectories for aerial filming
Rogerio Bonatti, Yanfu Zhang, Sanjiban Choudhury +2
Autonomous aerial cinematography has the potential to enable automatic capture of aesthetically pleasing videos without requiring human intervention, empowering individuals with th…