2k citations · 3.7k across the 51 of their papers we have counts for
53 papers
Discovering Adaptable Symbolic Algorithms from Scratch
Stephen Kelly, Daniel S. Park, Xingyou Song +8
Autonomous robots deployed in the real world will need control policies that rapidly adapt to environmental changes. To this end, we propose AutoRobotics-Zero (ARZ), a method based…
Transforming a Quadruped into a Guide Robot for the Visually Impaired: Formalizing Wayfinding, Interaction Modeling, and Safety Mechanism
J. Taery Kim, Wenhao Yu, Yash Kothari +3
This paper explores the principles for transforming a quadrupedal robot into a guide robot for individuals with visual impairments. A guide robot has great potential to resolve the…
Datasets and Benchmarks for Offline Safe Reinforcement Learning
Zuxin Liu, Zijian Guo, Haohong Lin +8
This paper presents a comprehensive benchmarking suite tailored to offline safe reinforcement learning (RL) challenges, aiming to foster progress in the development and evaluation…
Language to Rewards for Robotic Skill Synthesis
Wenhao Yu, Nimrod Gileadi, Chuyuan Fu +17
Large language models (LLMs) have demonstrated exciting progress in acquiring diverse new capabilities through in-context learning, ranging from logical reasoning to code-writing.…
CAJun: Continuous Adaptive Jumping using a Learned Centroidal Controller
Yuxiang Yang, Guanya Shi, Xiangyun Meng +4
We present CAJun, a novel hierarchical learning and control framework that enables legged robots to jump continuously with adaptive jumping distances. CAJun consists of a high-leve…
SayTap: Language to Quadrupedal Locomotion
Yujin Tang, Wenhao Yu, Jie Tan +3
Large language models (LLMs) have demonstrated the potential to perform high-level planning. Yet, it remains a challenge for LLMs to comprehend low-level commands, such as joint an…
Barkour: Benchmarking Animal-level Agility with Quadruped Robots
Ken Caluwaerts, Atil Iscen, J. Chase Kew +41
Animals have evolved various agile locomotion strategies, such as sprinting, leaping, and jumping. There is a growing interest in developing legged robots that move like their biol…
IndoorSim-to-OutdoorReal: Learning to Navigate Outdoors without any Outdoor Experience
Joanne Truong, April Zitkovich, Sonia Chernova +4
We present IndoorSim-to-OutdoorReal (I2O), an end-to-end learned visual navigation approach, trained solely in simulated short-range indoor environments, and demonstrates zero-shot…
Learning and Adapting Agile Locomotion Skills by Transferring Experience
Laura Smith, J. Chase Kew, Tianyu Li +5
Legged robots have enormous potential in their range of capabilities, from navigating unstructured terrains to high-speed running. However, designing robust controllers for highly…
Continuous Versatile Jumping Using Learned Action Residuals
Yuxiang Yang, Xiangyun Meng, Wenhao Yu +3
Jumping is essential for legged robots to traverse through difficult terrains. In this work, we propose a hierarchical framework that combines optimal control and reinforcement lea…
On Designing a Learning Robot: Improving Morphology for Enhanced Task Performance and Learning
Maks Sorokin, Chuyuan Fu, Jie Tan +5
As robots become more prevalent, optimizing their design for better performance and efficiency is becoming increasingly important. However, current robot design practices overlook…
Mnemosyne: Learning to Train Transformers with Transformers
Deepali Jain, Krzysztof Marcin Choromanski, Avinava Dubey +4
In this work, we propose a new class of learnable optimizers, called \textit{Mnemosyne}. It is based on the novel spatio-temporal low-rank implicit attention Transformers that can…
Efficient Learning of Voltage Control Strategies via Model-based Deep Reinforcement Learning
Ramij R. Hossain, Tianzhixi Yin, Yan Du +5
This article proposes a model-based deep reinforcement learning (DRL) method to design emergency control strategies for short-term voltage stability problems in power systems. Rece…
Robotic Table Wiping via Reinforcement Learning and Whole-body Trajectory Optimization
Thomas Lew, Sumeet Singh, Mario Prats +11
We propose a framework to enable multipurpose assistive mobile robots to autonomously wipe tables to clean spills and crumbs. This problem is challenging, as it requires planning w…
Learning Model Predictive Controllers with Real-Time Attention for Real-World Navigation
Xuesu Xiao, Tingnan Zhang, Krzysztof Choromanski +14
Despite decades of research, existing navigation systems still face real-world challenges when deployed in the wild, e.g., in cluttered home environments or in human-occupied publi…
PI-ARS: Accelerating Evolution-Learned Visual-Locomotion with Predictive Information Representations
Kuang-Huei Lee, Ofir Nachum, Tingnan Zhang +3
Evolution Strategy (ES) algorithms have shown promising results in training complex robotic control policies due to their massive parallelism capability, simple implementation, eff…
Learning Semantics-Aware Locomotion Skills from Human Demonstration
Yuxiang Yang, Xiangyun Meng, Wenhao Yu +3
The semantics of the environment, such as the terrain type and property, reveals important information for legged robots to adjust their behaviors. In this work, we present a frame…
On the Robustness of Safe Reinforcement Learning under Observational Perturbations
Zuxin Liu, Zijian Guo, Zhepeng Cen +4
Safe reinforcement learning (RL) trains a policy to maximize the task reward while satisfying safety constraints. While prior works focus on the performance optimality, we find tha…
Evolving Pareto-Optimal Actor-Critic Algorithms for Generalizability and Stability
Juan Jose Garau-Luis, Yingjie Miao, John D. Co-Reyes +4
Generalizability and stability are two key objectives for operating reinforcement learning (RL) agents in the real world. Designing RL algorithms that optimize these objectives can…
Safe Reinforcement Learning for Legged Locomotion
Tsung-Yen Yang, Tingnan Zhang, Linda Luu +3
Designing control policies for legged locomotion is complex due to the under-actuated and non-continuous robot dynamics. Model-free reinforcement learning provides promising tools…
MESA: Offline Meta-RL for Safe Adaptation and Fault Tolerance
Michael Luo, Ashwin Balakrishna, Brijen Thananjeyan +6
Safe exploration is critical for using reinforcement learning (RL) in risk-sensitive environments. Recent work learns risk measures which measure the probability of violating const…
Physics-informed Evolutionary Strategy based Control for Mitigating Delayed Voltage Recovery
Yan Du, Qiuhua Huang, Renke Huang +4
In this work we propose a novel data-driven, real-time power system voltage control method based on the physics-informed guided meta evolutionary strategy (ES). The main objective…
Legged Robots that Keep on Learning: Fine-Tuning Locomotion Policies in the Real World
Laura Smith, J. Chase Kew, Xue Bin Peng +3
Legged robots are physically capable of traversing a wide range of challenging environments, but designing controllers that are sufficiently robust to handle this diversity has bee…
Learning to Navigate Sidewalks in Outdoor Environments
Maks Sorokin, Jie Tan, C. Karen Liu +1
Outdoor navigation on sidewalks in urban environments is the key technology behind important human assistive applications, such as last-mile delivery or neighborhood patrol. This p…