37 citations · 41 across the 19 of their papers we have counts for
9 papers · 1 filter
DeMoGen: Towards Decompositional Human Motion Generation with Energy-Based Diffusion Models
Jianrong Zhang, Hehe Fan, Yi Yang
Human motions are compositional: complex behaviors can be described as combinations of simpler primitives. However, existing approaches primarily focus on forward modeling, e.g., l…
Endowing GPT-4 with a Humanoid Body: Building the Bridge Between Off-the-Shelf VLMs and the Physical World
Yingzhao Jian, Zhongan Wang, Yi Yang +1
Humanoid agents often struggle to handle flexible and diverse interactions in open environments. A common solution is to collect massive datasets to train a highly capable model, b…
Translution: Unifying Self-attention and Convolution for Adaptive and Relative Modeling
Hehe Fan, Yi Yang, Mohan Kankanhalli +1
When modeling a given type of data, we consider it to involve two key aspects: 1) identifying relevant elements (e.g., image pixels or textual words) to a central element, as in a…
GraphTARIF: Linear Graph Transformer with Augmented Rank and Improved Focus
Zhaolin Hu, Kun Li, Hehe Fan +1
Linear attention mechanisms have emerged as efficient alternatives to full self-attention in Graph Transformers, offering linear time complexity. However, existing linear attention…
Text-Scene: A Scene-to-Language Parsing Framework for 3D Scene Understanding
Haoyuan Li, Rui Liu, Hehe Fan +1
Enabling agents to understand and interact with complex 3D scenes is a fundamental challenge for embodied artificial intelligence systems. While Multimodal Large Language Models (M…
Dropping Experts, Recombining Neurons: Retraining-Free Pruning for Sparse Mixture-of-Experts LLMs
Yixiao Zhou, Ziyu Zhao, Dongzhou Cheng +6
Sparse Mixture-of-Experts (SMoE) architectures are widely used in large language models (LLMs) due to their computational efficiency. However, though only a few experts are activat…
Motion Matters: Motion-guided Modulation Network for Skeleton-based Micro-Action Recognition
Jihao Gu, Kun Li, Fei Wang +4
Micro-Actions (MAs) are an important form of non-verbal communication in social interactions, with potential applications in human emotional analysis. However, existing methods in…
BVINet: Unlocking Blind Video Inpainting with Zero Annotations
Zhiliang Wu, Kerui Chen, Kun Li +2
Video inpainting aims to fill in corrupted regions of the video with plausible contents. Existing methods generally assume that the locations of corrupted regions are known, focusi…
Prompt-Aware Controllable Shadow Removal
Kerui Chen, Zhiliang Wu, Wenjin Hou +3
Shadow removal aims to restore the image content in shadowed regions. While deep learning-based methods have shown promising results, they still face key challenges: 1) uncontrolle…