5 papers
Automating the Design of Embodied Agent Architectures
Jian Zhou, Sihao Lin, Jin Li +3
Embodied agents are typically built as hand-designed compositions of perception, memory, planning, and action modules. This modularity exposes a large architectural design space, b…
Beyond NL2Code: A Structured Survey of Multimodal Code Intelligence
Xuanle Zhao, Qiushi Sun, Jingyu Xiao +16
While Large Language Models (LLMs) have substantially advanced text-to-code synthesis, many real programming tasks specify intent through visual artifacts such as screenshots, char…
Decoupled Action Expert: Confining Task Knowledge to the Conditioning Pathway
Jian Zhou, Sihao Lin, Shuai Fu +3
Many recent Vision-Language-Action models employ diffusion or flow-matching backbones with hundreds of millions of parameters for action generation. However, unlike image synthesis…
Counting Hallucinations in Diffusion Models
Shuai Fu, Jian Zhou, Qi Chen +7
Diffusion probabilistic models (DPMs) have demonstrated remarkable progress in generative tasks, such as image and video synthesis. However, they still often produce hallucinated s…
ScaleTrack: Scaling and back-tracking Automated GUI Agents
Jing Huang, Zhixiong Zeng, Wenkang Han +5
Automated GUI agents aims to facilitate user interaction by automatically performing complex tasks in digital environments, such as web, mobile, desktop devices. It receives textua…