7 citations · 7 across the 9 of their papers we have counts for
11 papers
Knowledge Interaction in Hypernetwork-based Continual Learning: Conflict and Composition
Jiaqi Zheng, Yi Hu, Yadong Mu +1
Continual learning aims to adapt pretrained large language models (LLMs) to evolving data while preserving their pretrained capabilities. A central challenge is catastrophic forget…
UniETP: Unifying Environments for Generalizable Embodied Task Planning
Peiran Xu, Jiaqi Zheng, Ziyou Wang +1
This paper focuses on the problem of Embodied Task Planning, where an agent is required to execute a sequence of atomic actions within an interactive environment to complete a user…
GOPAgen: Codec-Aware Agentic Long-Video Understanding with Structured Memory
Haozhe Chi, Yang Jin, Yadong Mu
Agentic long-video question answering often relies on sparse RGB sampling and caption retrieval. This reliance can lead to missed brief motion events and repeated processing of irr…
RePlan-Bot: Multi-Level Replanning for Embodied Instruction Following
Xicheng Gong, Guozheng Sun, Peiran Xu +1
Embodied instruction following (EIF) requires agents to understand and execute complex natural language commands within interactive 3D environments. Despite recent advances, existi…
Extending Embodied Question Answering from Perception to Decision
Xicheng Gong, Qiwei Li, Peiran Xu +1
Embodied Question Answering (EQA) connects perception, reasoning, and interaction within embodied environments. However, existing datasets and benchmarks remain fragmented, each fo…
RotVLA: Rotational Latent Action for Vision-Language-Action Model
Qiwei Li, Xicheng Gong, Xinghang Li +5
Latent Action Models (LAMs) have emerged as an effective paradigm for handling heterogeneous datasets during Vision-Language-Action (VLA) model pretraining, offering a unified acti…
RoboAgent: Chaining Basic Capabilities for Embodied Task Planning
Peiran Xu, Jiaqi Zheng, Yadong Mu
This paper focuses on embodied task planning, where an agent acquires visual observations from the environment and executes atomic actions to accomplish a given task. Although rece…
ProgressVLA: Progress-Guided Diffusion Policy for Vision-Language Robotic Manipulation
Hongyu Yan, Qiwei Li, Jiaolong Yang +1
Most existing vision-language-action (VLA) models for robotic manipulation lack progress awareness, typically relying on hand-crafted heuristics for task termination. This limitati…
NavQ: Learning a Q-Model for Foresighted Vision-and-Language Navigation
Peiran Xu, Xicheng Gong, Yadong MU
In this work we concentrate on the task of goal-oriented Vision-and-Language Navigation (VLN). Existing methods often make decisions based on historical information, overlooking th…
Weakly-Supervised Affordance Grounding Guided by Part-Level Semantic Priors
Peiran Xu, Yadong Mu
In this work, we focus on the task of weakly supervised affordance grounding, where a model is trained to identify affordance regions on objects using human-object interaction imag…
Co-Salient Object Detection with Semantic-Level Consensus Extraction and Dispersion
Peiran Xu, Yadong Mu
Given a group of images, co-salient object detection (CoSOD) aims to highlight the common salient object in each image. There are two factors closely related to the success of this…