Towards MRI-Based Autonomous Robotic US Acquisitions: A First Feasibility Study

Abstract

Robotic ultrasound has the potential to assist and guide physicians during interventions. In this work, we present a set of methods and a workflow to enable autonomous MRI-guided ultrasound acquisitions. Our approach uses a structured-light 3D scanner for patient-to-robot and image-to-patient calibration, which in turn is used to plan 3D ultrasound trajectories. These MRI-based trajectories are followed autonomously by the robot and are further refined online using automatic MRI/US registration. Despite the low spatial resolution of structured light scanners, the initial planned acquisition path can be followed with an accuracy of 2.46 +/- 0.96 mm. This leads to a good initialization of the MRI/US registration: the 3D-scan-based alignment for planning and acquisition shows an accuracy (distance between planned ultrasound and MRI) of 4.47 mm, and 0.97 mm after an online-update of the calibration based on a closed loop registration.

14 pages, 7 figures, journal

Cited by in corpus (22)

• Autonomous Navigation of an Ultrasound Probe Towards Standard Scan Planes with Deep Reinforcement Learning
• Design and integration of a parallel, soft robotic end-effector for extracorporeal ultrasound
• Deformation-Aware Robotic 3D Ultrasound
• Precise Repositioning of Robotic Ultrasound: Improving Registration-based Motion Compensation using Ultrasound Confidence Optimization
• RSV: Robotic Sonography for Thyroid Volumetry
• Learning Robotic Ultrasound Scanning Skills via Human Demonstrations and Guided Explorations
• Motion-Aware Robotic 3D Ultrasound
• Autonomous Tissue Scanning under Free-Form Motion for Intraoperative Tissue Characterisation
• Robotic Sonographer: Autonomous Robotic Ultrasound using Domain Expertise in Bayesian Optimization
• Analysis of Randomization Effects on Sim2Real Transfer in Reinforcement Learning for Robotic Manipulation Tasks
• Toward Fully Automated Robotic Platform for Remote Auscultation
• LBR-Stack: ROS 2 and Python Integration of KUKA FRI for Med and IIWA Robots
• Learning Ultrasound Scanning Skills from Human Demonstrations
• Enhancing Patient Acceptance of Robotic Ultrasound through Conversational Virtual Agent and Immersive Visualizations
• Imitation Learning for Robotic Assisted Ultrasound Examination of Deep Venous Thrombosis using Kernelized Movement Primitives
• Autonomous Robotic Screening of Tubular Structures based only on Real-Time Ultrasound Imaging Feedback
• Continual Domain Randomization
• Image-Guided Navigation of a Robotic Ultrasound Probe for Autonomous Spinal Sonography Using a Shadow-aware Dual-Agent Framework
• Coaching a Robotic Sonographer: Learning Robotic Ultrasound with Sparse Expert's Feedback
• Ultrasound-Guided Robotic Navigation with Deep Reinforcement Learning
• Breaking Barriers in Robotic Soft Tissue Surgery: Conditional Autonomous Intestinal Anastomosis
• Interactive Imitation Learning in State-Space