2 papers
cs.HC2026
'Show It, Don't Just Say It': The Complementary Effects of Instruction Multimodality for Software Guidance
Emran Poh, Yueyue Hou, Tianyi Zhang +1
Designing adaptive tutoring systems for software learning presents challenges in determining appropriate instructional modalities. To inform the design of such systems, we conducte…
cs.HC2025
ImageInThat: Manipulating Images to Convey User Instructions to Robots
Karthik Mahadevan, Blaine Lewis, Jiannan Li +3
Foundation models are rapidly improving the capability of robots in performing everyday tasks autonomously such as meal preparation, yet robots will still need to be instructed by…