10 papers
One-shot Human Video-Guided Adaptation for Vision-Language-Action Models
Qi Chen, Yuwei Wu, Quan Chen +5
Vision-language-action (VLA) models have recently achieved remarkable progress by leveraging large-scale robot datasets and foundation models for general-purpose robot manipulation…
Interactive Reward Agent: GUI Task Evaluation via Environment-State Verification
Chenrui Shi, Yuwei Wu, Yang Liu +5
Graphical user interface task evaluation aims to determine whether a GUI agent has successfully completed a user instruction. Automated GUI task evaluation has received increasing…
Facial Expression Generation Aligned with Human Preference for Natural Dyadic Interaction
Xu Chen, Rui Gao, Xinjie Zhang +5
Achieving natural dyadic interaction requires generating facial expressions that are emotionally appropriate and socially aligned with human preference. Human feedback offers a com…
Morphology-Independent Facial Expression Imitation for Human-Face Robots
Xu Chen, Rui Gao, Che Sun +4
Accurate facial expression imitation on human-face robots is crucial for achieving natural human-robot interaction. Most existing methods have achieved photorealistic expression im…
Fine-Grained 3D Facial Reconstruction for Micro-Expressions
Che Sun, Xinjie Zhang, Rui Gao +3
Recent advances in 3D facial expression reconstruction have demonstrated remarkable performance in capturing macro-expressions, yet the reconstruction of micro-expressions remains…
Bridging Modality Disconnect in Self-Reflection via Closed-Loop Visually Grounded Verification
Haoyu Zhang, Yuwei Wu, Pengxiang Li +6
In the era of Vision-Language Models (VLMs), enhancing multimodal reasoning capabilities remains a critical challenge, particularly in handling ambiguous or complex visual inputs,…
Composition-Incremental Learning for Compositional Generalization
Zhen Li, Yuwei Wu, Chenchen Jing +3
Compositional generalization has achieved substantial progress in computer vision on pre-collected training data. Nonetheless, real-world data continually emerges, with possible co…
Multi-Step Reasoning for Embodied Question Answering via Tool Augmentation
Mingliang Zhai, Hansheng Liang, Xiaomeng Fan +6
Embodied Question Answering (EQA) requires agents to explore 3D environments to obtain observations and answer questions related to the scene. Existing methods leverage VLMs to dir…
LongSplat: Online Generalizable 3D Gaussian Splatting from Long Sequence Images
Guichen Huang, Ruoyu Wang, Xiangjun Gao +4
3D Gaussian Splatting achieves high-fidelity novel view synthesis, but its application to online long-sequence scenarios is still limited. Existing methods either rely on slow per-…
Neural 3D Scene Reconstruction from Multiple 2D Images without 3D Supervision
Yi Guo, Che Sun, Yunde Jia +1
Neural 3D scene reconstruction methods have achieved impressive performance when reconstructing complex geometry and low-textured regions in indoor scenes. However, these methods h…