65 citations · 68 across the 6 of their papers we have counts for
7 papers
RoboChrono: A Real Robot Benchmark for Streaming Task Understanding
Yuzhou Wu, Longteng Fan, Zimeng Li +22
Understanding ongoing robot manipulation requires models to interpret visual observations in relation to interaction history and task progress. We introduce RoboChrono, a benchmark…
PoliFormer: Scaling On-Policy RL with Transformers Results in Masterful Navigators
Kuo-Hao Zeng, Zichen Zhang, Kiana Ehsani +6
We present PoliFormer (Policy Transformer), an RGB-only indoor navigation agent trained end-to-end with reinforcement learning at scale that generalizes to the real-world without a…
Unified-IO 2: Scaling Autoregressive Multimodal Models with Vision, Language, Audio, and Action
Jiasen Lu, Christopher Clark, Sangho Lee +5
We present Unified-IO 2, the first autoregressive multimodal model that is capable of understanding and generating image, text, audio, and action. To unify different modalities, we…
Universal Visual Decomposer: Long-Horizon Manipulation Made Easy
Zichen Zhang, Yunshuang Li, Osbert Bastani +4
Real-world robotic tasks stretch over extended horizons and encompass multiple stages. Learning long-horizon manipulation tasks, however, is a long-standing challenge, and demands…
When Learning Is Out of Reach, Reset: Generalization in Autonomous Visuomotor Reinforcement Learning
Zichen Zhang, Luca Weihs
Episodic training, where an agent's environment is reset after every success or failure, is the de facto standard when training embodied reinforcement learning (RL) agents. The und…
VIMA: General Robot Manipulation with Multimodal Prompts
Yunfan Jiang, Agrim Gupta, Zichen Zhang +7
Prompt-based learning has emerged as a successful paradigm in natural language processing, where a single general-purpose language model can be instructed to perform any task speci…
Automated Scoring System of HER2 in Pathological Images under the Microscope
Zichen Zhang, Lang Wang, Shuhao Wang
Breast cancer is the most common cancer among women worldwide. The human epidermal growth factor receptor 2 (HER2) with immunohistochemical (IHC) is widely used for pathological ev…