25 citations · 40 across the 12 of their papers we have counts for
14 papers
Demonstrating the Octopi-1.5 Visual-Tactile-Language Model
Samson Yu, Kelvin Lin, Harold Soh
Touch is recognized as a vital sense for humans and an equally important modality for robots, especially for dexterous manipulation, material identification, and scenarios involvin…
Octopi: Object Property Reasoning with Large Tactile-Language Models
Samson Yu, Kelvin Lin, Anxing Xiao +2
Physical reasoning is important for effective robot manipulation. Recent work has investigated both vision and language modalities for physical reasoning; vision can reveal informa…
A Review on Robot Manipulation Methods in Human-Robot Interactions
Haoxu Zhang, Parham M. Kebria, Shady Mohamed +2
Robot manipulation is an important part of human-robot interaction technology. However, traditional pre-programmed methods can only accomplish simple and repetitive tasks. To enabl…
Read My Mind: A Multi-Modal Dataset for Human Belief Prediction
Jiafei Duan, Samson Yu, Nicholas Tan +2
Understanding human intentions is key to enabling effective and efficient human-robot interaction (HRI) in collaborative settings. To enable developments and evaluation of the abil…
Robustness of Utilizing Feedback in Embodied Visual Navigation
Jenny Zhang, Samson Yu, Jiafei Duan +1
This paper presents a framework for training an agent to actively request help in object-goal navigation tasks, with feedback indicating the location of the target object in its fi…
BOSS: A Benchmark for Human Belief Prediction in Object-context Scenarios
Jiafei Duan, Samson Yu, Nicholas Tan +2
Humans with an average level of social cognition can infer the beliefs of others based solely on the nonverbal communication signals (e.g. gaze, gesture, pose and contextual inform…
ABCDE: An Agent-Based Cognitive Development Environment
Jieyi Ye, Jiafei Duan, Samson Yu +2
Children's cognitive abilities are sometimes cited as AI benchmarks. How can the most common 1,000 concepts (89\% of everyday use) be learnt in a naturalistic children's setting? C…
Good Time to Ask: A Learning Framework for Asking for Help in Embodied Visual Navigation
Jenny Zhang, Samson Yu, Jiafei Duan +1
In reality, it is often more efficient to ask for help than to search the entire space to find an object with an unknown location. We present a learning framework that enables an a…
PIP: Physical Interaction Prediction via Mental Simulation with Span Selection
Jiafei Duan, Samson Yu, Soujanya Poria +2
Accurate prediction of physical interaction outcomes is a crucial component of human intelligence and is important for safe and efficient deployments of robots in the real world. W…
SPACE: A Simulator for Physical Interactions and Causal Learning in 3D Environments
Jiafei Duan, Samson Yu Bai Jian, Cheston Tan
Recent advancements in deep learning, computer vision, and embodied AI have given rise to synthetic causal reasoning video datasets. These datasets facilitate the development of AI…
Aspect Sentiment Triplet Extraction Using Reinforcement Learning
Samson Yu Bai Jian, Tapas Nayak, Navonil Majumder +1
Aspect Sentiment Triplet Extraction (ASTE) is the task of extracting triplets of aspect terms, their associated sentiments, and the opinion terms that provide evidence for the expr…
A Survey of Embodied AI: From Simulators to Research Tasks
Jiafei Duan, Samson Yu, Hui Li Tan +2
There has been an emerging paradigm shift from the era of "internet AI" to "embodied AI", where AI algorithms and agents no longer learn from datasets of images, videos or text cur…
Recognizing Emotion Cause in Conversations
Soujanya Poria, Navonil Majumder, Devamanyu Hazarika +9
We address the problem of recognizing emotion cause in conversations, define two novel sub-tasks of this problem, and provide a corresponding dialogue-level dataset, along with str…
Actionet: An Interactive End-To-End Platform For Task-Based Data Collection And Augmentation In 3D Environment
Jiafei Duan, Samson Yu, Hui Li Tan +1
The problem of task planning for artificial agents remains largely unsolved. While there has been increasing interest in data-driven approaches for the study of task planning for a…