94 citations · 135 across the 25 of their papers we have counts for
26 papers
SwingBot: Learning Whole-Body Brachiation for Humanoid Robots
Yujie Xiong, Peng Zhai, Taixian Hou +6
Brachiation enables primates to move across overhead supports when ground paths are blocked, suggesting a complementary locomotion mode for robots operating in cluttered or hazardo…
MulDP: Multimodal Diffusion Policy for Autonomous Quadruped Parkour Navigation across Complex Terrains
Kangmai Hu, Yueqi Zhang, Peng Zhai +5
Quadruped robots have demonstrated impressive agility in parkour locomotion across complex terrains. However, most systems still rely on human intervention for high-level planning,…
MUJICA: Multi-skill Unified Joint Integration of Control Architecture for Wheeled-Legged Robots
Yuqi Li, Peng Zhai, Yueqi Zhang +5
Wheeled-legged robots hold promise for traversing complex terrains and offer superior mobility compared to legged robots. However, wheeled-legged robots must effectively balance bo…
KiRAS: Keyframe Guided Self-Imitation for Robust and Adaptive Skill Learning in Quadruped Robots
Xiaoyi Wei, Peng Zhai, Jiaxin Tu +5
With advances in reinforcement learning and imitation learning, quadruped robots can acquire diverse skills within a single policy by imitating multiple skill-specific datasets. Ho…
UniMGS: Unifying Mesh and 3D Gaussian Splatting with Single-Pass Rasterization and Proxy-Based Deformation
Zeyu Xiao, Mingyang Sun, Yimin Cong +7
Joint rendering and deformation of mesh and 3D Gaussian Splatting (3DGS) have significant value as both representa tions offer complementary advantages for graphics applica tions.…
FysicsWorld: A Unified Full-Modality Benchmark for Any-to-Any Understanding, Generation, and Reasoning
Yue Jiang, Dingkang Yang, Minghao Han +6
Despite rapid progress in multimodal large language models (MLLMs) and emerging omni-modal architectures, current benchmarks remain limited in scope and integration, suffering from…
Improving Multimodal Sentiment Analysis via Modality Optimization and Dynamic Primary Modality Selection
Dingkang Yang, Mingcheng Li, Xuecheng Wu +5
Multimodal Sentiment Analysis (MSA) aims to predict sentiment from language, acoustic, and visual data in videos. However, imbalanced unimodal performance often leads to suboptimal…
Reinforcement Learning Meets Large Language Models: A Survey of Advancements and Applications Across the LLM Lifecycle
Keliang Liu, Dingkang Yang, Ziyun Qian +7
In recent years, training methods centered on Reinforcement Learning (RL) have markedly enhanced the reasoning and alignment performance of Large Language Models (LLMs), particular…
RENet: Fault-Tolerant Motion Control for Quadruped Robots via Redundant Estimator Networks under Visual Collapse
Yueqi Zhang, Quancheng Qian, Taixian Hou +5
Vision-based locomotion in outdoor environments presents significant challenges for quadruped robots. Accurate environmental prediction and effective handling of depth sensor noise…
Music-Driven Legged Robots: Synchronized Walking to Rhythmic Beats
Taixian Hou, Yueqi Zhang, Xiaoyi Wei +4
We address the challenge of effectively controlling the locomotion of legged robots by incorporating precise frequency and phase characteristics, which is often ignored in locomoti…
Continuous Control of Diverse Skills in Quadruped Robots Without Complete Expert Datasets
Jiaxin Tu, Xiaoyi Wei, Yueqi Zhang +5
Learning diverse skills for quadruped robots presents significant challenges, such as mastering complex transitions between different skills and handling tasks of varying difficult…
A Robust Quadruped Robot with Twisting Waist for Flexible Motions
Quancheng Qian, Xiaoyi Wei, Zonghao Zhang +6
The waist plays a crucial role in the agile movement of many animals in nature. It provides the torso with additional degrees of freedom and flexibility, inspiring researchers to i…
Role Play: Learning Adaptive Role-Specific Strategies in Multi-Agent Interactions
Weifan Long, Wen Wen, Peng Zhai +1
Zero-shot coordination problem in multi-agent reinforcement learning (MARL), which requires agents to adapt to unseen agents, has attracted increasing attention. Traditional approa…
PhysHand: A Hand Simulation Model with Physiological Geometry, Physical Deformation, and Accurate Contact Handling
Mingyang Sun, Dongliang Kou, Ruisheng Yuan +7
In virtual Hand-Object Interaction (HOI) scenarios, the authenticity of the hand's deformation is important to immersive experience, such as natural manipulation or tactile feedbac…
Large Vision-Language Models as Emotion Recognizers in Context Awareness
Yuxuan Lei, Dingkang Yang, Zhaoyu Chen +3
Context-aware emotion recognition (CAER) is a complex and significant task that requires perceiving emotions from various contextual cues. Previous approaches primarily focus on de…
Asynchronous Multimodal Video Sequence Fusion via Learning Modality-Exclusive and -Agnostic Representations
Dingkang Yang, Mingcheng Li, Linhao Qu +4
Understanding human intentions (e.g., emotions) from videos has received considerable attention recently. Video streams generally constitute a blend of temporal data stemming from…
PediatricsGPT: Large Language Models as Chinese Medical Assistants for Pediatric Applications
Dingkang Yang, Jinjie Wei, Dongling Xiao +11
Developing intelligent pediatric consultation systems offers promising prospects for improving diagnostic efficiency, especially in China, where healthcare resources are scarce. De…
SMCD: High Realism Motion Style Transfer via Mamba-based Diffusion
Ziyun Qian, Zeyu Xiao, Xingliang Jin +6
Motion style transfer is a significant research direction in the field of computer vision, enabling virtual digital humans to rapidly switch between different styles of the same mo…
Towards Multimodal Sentiment Analysis Debiasing via Bias Purification
Dingkang Yang, Mingcheng Li, Dongling Xiao +7
Multimodal Sentiment Analysis (MSA) aims to understand human intentions by integrating emotion-related clues from diverse modalities, such as visual, language, and audio. Unfortuna…
Multi-Task Learning of Active Fault-Tolerant Controller for Leg Failures in Quadruped robots
Taixian Hou, Jiaxin Tu, Xiaofei Gao +3
Electric quadruped robots used in outdoor exploration are susceptible to leg-related electrical or mechanical failures. Unexpected joint power loss and joint locking can immediatel…
CPR-Coach: Recognizing Composite Error Actions based on Single-class Training
Shunli Wang, Qing Yu, Shuaibing Wang +7
The fine-grained medical action analysis task has received considerable attention from pattern recognition communities recently, but it faces the problems of data and algorithm sho…
AIDE: A Vision-Driven Multi-View, Multi-Modal, Multi-Tasking Dataset for Assistive Driving Perception
Dingkang Yang, Shuai Huang, Zhi Xu +12
Driver distraction has become a significant cause of severe traffic accidents over the past decade. Despite the growing development of vision-driven driver monitoring systems, the…
Context De-confounded Emotion Recognition
Dingkang Yang, Zhaoyu Chen, Yuzheng Wang +8
Context-Aware Emotion Recognition (CAER) is a crucial and challenging task that aims to perceive the emotional states of the target person with contextual information. Recent appro…
CA-SpaceNet: Counterfactual Analysis for 6D Pose Estimation in Space
Shunli Wang, Shuaibing Wang, Bo Jiao +5
Reliable and stable 6D pose estimation of uncooperative space objects plays an essential role in on-orbit servicing and debris removal missions. Considering that the pose estimator…