4 papers
NeuroAI and Beyond: Bridging Between Advances in Neuroscience and Artificial Intelligence
Anthony Zador, Jean-Marc Fellous, Terrence Sejnowski +28
Neuroscience and Artificial Intelligence (AI) have made impressive progress in recent years but remain only loosely interconnected. Based on a workshop convened by the National Sci…
Observing and Controlling Features in Vision-Language-Action Models
Hugo Buurmeijer, Carmen Amo Alonso, Aiden Swann +1
Vision-Language-Action models (VLAs) have shown remarkable progress towards embodied intelligence. While their architecture partially resembles that of Large Language Models (LLMs)…
DEMONSTRATE: Zero-shot Language to Robotic Control via Multi-task Demonstration Learning
Rahel Rickenbach, Bruce Lee, René Zurbrügg +2
The integration of large language models (LLMs) with control systems has demonstrated significant potential in various settings, such as task completion with a robotic manipulator.…
NARRATE: Versatile Language Architecture for Optimal Control in Robotics
Seif Ismail, Antonio Arbues, Ryan Cotterell +2
The impressive capabilities of Large Language Models (LLMs) have led to various efforts to enable robots to be controlled through natural language instructions, opening exciting po…