128 citations · 168 across the 12 of their papers we have counts for
4 papers · 1 filter
GigaHands: A Massive Annotated Dataset of Bimanual Hand Activities
Rao Fu, Dingxi Zhang, Alex Jiang +4
Understanding bimanual human hand activities is a critical problem in AI and robotics. We cannot build large models of bimanual activities because existing datasets lack the scale,…
ScratchEval: Are GPT-4o Smarter than My Child? Evaluating Large Multimodal Models with Visual Programming Challenges
Rao Fu, Ziyang Luo, Hongzhan Lin +2
Recent advancements in large multimodal models (LMMs) have showcased impressive code generation capabilities, primarily evaluated through image-to-code benchmarks. However, these b…
Scene-LLM: Extending Language Model for 3D Visual Understanding and Reasoning
Rao Fu, Jingyu Liu, Xilun Chen +2
This paper introduces Scene-LLM, a 3D-visual-language model that enhances embodied agents' abilities in interactive 3D indoor environments by integrating the reasoning strengths of…
CharacterMixer: Rig-Aware Interpolation of 3D Characters
Xiao Zhan, Rao Fu, Daniel Ritchie
We present CharacterMixer, a system for blending two rigged 3D characters with different mesh and skeleton topologies while maintaining a rig throughout interpolation. CharacterMix…