35 citations · 119 across the 22 of their papers we have counts for
6 papers · 1 filter
CrossMap Transformer: A Crossmodal Masked Path Transformer Using Double Back-Translation for Vision-and-Language Navigation
Aly Magassouba, Komei Sugiura, Hisashi Kawai
Navigation guided by natural language instructions is particularly suitable for Domestic Service Robots that interacts naturally with users. This task involves the prediction of a…
Predicting and Attending to Damaging Collisions for Placing Everyday Objects in Photo-Realistic Simulations
Aly Magassouba, Komei Sugiura, Angelica Nakayama +4
Placing objects is a fundamental task for domestic service robots (DSRs). Thus, inferring the collision-risk before a placing motion is crucial for achieving the requested task. Th…
A Multimodal Target-Source Classifier with Attention Branches to Understand Ambiguous Instructions for Fetching Daily Objects
Aly Magassouba, Komei Sugiura, Hisashi Kawai
In this study, we focus on multimodal language understanding for fetching instructions in the domestic service robots context. This task consists of predicting a target object, as…
Understanding Natural Language Instructions for Fetching Daily Objects Using GAN-Based Multimodal Target-Source Classification
Aly Magassouba, Komei Sugiura, Anh Trinh Quoc +1
In this paper, we address multimodal language understanding for unconstrained fetching instruction in domestic service robots context. A typical fetching instruction such as "Bring…
A Multimodal Classifier Generative Adversarial Network for Carry and Place Tasks from Ambiguous Language Instructions
Aly Magassouba, Komei Sugiura, Hisashi Kawai
This paper focuses on a multimodal language understanding method for carry-and-place tasks with domestic service robots. We address the case of ambiguous instructions, that is, whe…
Grounded Language Understanding for Manipulation Instructions Using GAN-Based Classification
Komei Sugiura, Hisashi Kawai
The target task of this study is grounded language understanding for domestic service robots (DSRs). In particular, we focus on instruction understanding for short sentences where…