1 citations · 2 across the 13 of their papers we have counts for
19 papers
JARVIS: From Visual Manuals to Autonomous Robotic Assembly
Fan Ding, Fucai Ke, Kevin Yuchen Ma +5
Visual manuals communicate procedural knowledge through stepwise diagrams, but translating these instructions into reliable long-horizon robotic execution remains challenging. We i…
SenseWeather: Multimodal Sensing for Robust Robotic Perception under Extreme Conditions
Fucai Ke, Sukai Huang, Junyi Hao +4
Robotic perception must remain reliable when extreme environmental conditions severely degrade the primary RGB observation. Although robotic platforms commonly carry complementary…
World-as-Graph: Relational World Modeling Through Latent Space Graphs
Yaqi Yang, Shuo Huang, Yujin Huang +3
World models aim to learn representations of real-world environments and predict their future evolution. Recent object-centric world models have made expressive progress by represe…
JRDB-AVR: An Active Visual Reasoning Benchmark for Embodied Agents in Real-World Environments
Zhixi Cai, Fucai Ke, Sukai Huang +4
In complex embodied visual reasoning scenarios, an agent often has only a limited field of view, and the evidence needed to answer a question may be distributed across time, viewpo…
What We Talk About When We Talk About LLM Planning: Evidence for Two Distinct Planning Abilities
Sukai Huang, Chenyuan Zhang, Fucai Ke +4
When LLMs exhibit uneven performance across planning tasks, these gaps are often attributed to task difficulty. We argue that this explanation is incomplete, as task-level variatio…
ARIS: Agentic and Relationship Intelligence System for Social Robots
Stavya Datta, Fucai Ke, Leimin Tian +1
Foundational models have advanced social robotics, enabling richer perception and communicative interaction with users. However, current systems still struggle with multi-turn enga…
Mini-BEHAVIOR-Gran: Revealing U-Shaped Effects of Instruction Granularity on Language-Guided Embodied Agents
Sukai Huang, Chenyuan Zhang, Fucai Ke +4
Instruction granularity is an important yet poorly controlled variable in language-guided embodied AI. Existing benchmarks typically pair each task with a single static instruction…
WeatherReasonSeg: A Benchmark for Weather-Aware Reasoning Segmentation in Visual Language Models
Wanjun Du, Zifeng Yuan, Tingting Chen +3
Existing vision-language models (VLMs) have demonstrated impressive performance in reasoning-based segmentation. However, current benchmarks are primarily constructed from high-qua…
VIEW2SPACE: Studying Multi-View Visual Reasoning from Sparse Observations
Fucai Ke, Zhixi Cai, Boying Li +6
Multi-view visual reasoning is essential for intelligent systems that must understand complex environments from sparse and discrete viewpoints, yet existing research has largely fo…
MATA: A Trainable Hierarchical Automaton System for Multi-Agent Visual Reasoning
Zhixi Cai, Fucai Ke, Kevin Leo +4
Recent vision-language models have strong perceptual ability but their implicit reasoning is hard to explain and easily generates hallucinations on complex queries. Compositional m…
Explain Before You Answer: A Survey on Compositional Visual Reasoning
Fucai Ke, Joy Hsu, Zhixi Cai +10
Compositional visual reasoning has emerged as a key research frontier in multimodal AI, aiming to endow machines with the human-like ability to decompose visual scenes, ground inte…
Drive As You Like: Multi-Head Diffusion with Reinforcement Learning for Personalized Driving
Fan Ding, Ding Fan, Xuewen Luo +6
Personalized autonomous driving requires understanding the driving needs implicit in user requests. This is challenging when driving demonstrations lack style annotations and behav…
DPL: Decoupled Prototype Learning for Enhancing Robustness of Vision-Language Transformers to Missing Modalities
Jueqing Lu, Yuanyuan Qi, Xiaohao Yang +8
The performance of Visio-Language Transformers drops sharply when an input modality (e.g., image) is missing, because the model is forced to make predictions using incomplete infor…
DWIM: Towards Tool-aware Visual Reasoning via Discrepancy-aware Workflow Generation & Instruct-Masking Tuning
Fucai Ke, Vijay Kumar B G, Xingjian Leng +6
Visual reasoning (VR), which is crucial in many fields for enabling human-like visual understanding, remains highly challenging. Recently, compositional visual reasoning approaches…
NAVER: A Neuro-Symbolic Compositional Automaton for Visual Grounding with Explicit Logic Reasoning
Zhixi Cai, Fucai Ke, Simindokht Jahangard +4
Visual Grounding (VG) tasks, such as referring expression detection and segmentation tasks are important for linking visual entities to context, especially in complex reasoning tas…
AR-Facilitated Safety Inspection and Fall Hazard Detection on Construction Sites
Jiazhou Liu, Aravinda S. Rao, Fucai Ke +3
Together with industry experts, we are exploring the potential of head-mounted augmented reality to facilitate safety inspections on high-rise construction sites. A particular conc…
Graph Enhanced Reinforcement Learning for Effective Group Formation in Collaborative Problem Solving
Zheng Fang, Fucai Ke, Jae Young Han +2
This study addresses the challenge of forming effective groups in collaborative problem-solving environments. Recognizing the complexity of human interactions and the necessity for…
HYDRA: A Hyper Agent for Dynamic Compositional Visual Reasoning
Fucai Ke, Zhixi Cai, Simindokht Jahangard +3
Recent advances in visual reasoning (VR), particularly with the aid of Large Vision-Language Models (VLMs), show promise but require access to large-scale datasets and face challen…
HiTSKT: A Hierarchical Transformer Model for Session-Aware Knowledge Tracing
Fucai Ke, Weiqing Wang, Weicong Tan +4
Knowledge tracing (KT) aims to leverage students' learning histories to estimate their mastery levels on a set of pre-defined skills, based on which the corresponding future perfor…