7 citations · 37 across the 50 of their papers we have counts for
59 papers
Foresee: Making Procedural Futures Tangible through Generative Previews
Yusi Sun, Ying Jiang, Jiayin Lu +4
Procedural guidance can show users how to act without explaining what an action enables later. We present Foresee, an interface combining next-step guidance with consequence previe…
Coarse-Grained Predictive Resource Allocation Framework enabling In-Premise XR Collaborations
Sourav Mondal, Elaine Wong
Immersive extended reality (XR) applications are key enablers of human-centric connectivity in next-generation networks. However, meeting their high-throughput, ultra-low-latency,…
Skill2Real: Agentic Skill Learning for Zero-Shot Sim-to-Real Robot Manipulation
Xincheng He, Siyu Ma, Chang Yu +5
Transferring robotic skills from simulation to reality requires task knowledge that remains usable across differences in perception, dynamics, and embodiment. We introduce Skill2Re…
HairCS: Reconstructing Strand-Based Hair from Hair Cards
Zixuan Lu, Tongtong Wang, Yuefan Shen +4
We present an automated pipeline that converts hair-card models into high-quality strand-based hairstyles. Given a collection of textured triangular or quad strips as input, our me…
Projective Affine Body Dynamics for Multibody Systems
Zimeng Ye, Xiaowei He, Yuzhong Guo +3
Multibody systems have widespread applications in diverse fields such as robotics, entertainment, and animation. Their capability to model and simulate intricate interactions among…
SUN: Agentic Robot Policy Learning with Persistent Task Programs
Weiqi Wang, Zhi Li, Yudong Lei +7
Model-based control can directly execute specified objectives, while learning can amortize such behaviors into reactive policies, making their combination a natural solution to mul…
FetchMan: Learning Visual Humanoid Loco-Manipulation Policies from Simulated Experiences
Omar Rayyan, Zhi Li, Max Argus +4
Visual loco-manipulation policies that can generalize to novel scenes and objects have long been a goal of robotics research. However, today's data-hungry algorithms make collectin…
RoboEdit: Turning Human Manipulation Videos into Scalable Robot Experience
Yaowei Guo, Zeng Tao, Yuxin Jiang +7
Collecting robot hand-object interaction data is costly and embodiment-specific, yet abundant human-object videos remain unusable for robot training. We present RoboEdit, a human-t…
Differentiate the Solver, Not the Equation: Reverse-Sweep Adjoints for Block Implicit Simulation
Lei Shu, Ying Jiang, Kui Wu +3
Differentiable simulation is a key component in learning, control, and inverse problems, where gradients through nonlinear implicit solvers are required. Existing approaches either…
Agentic Real2Sim: Physics-based World Modeling with Vision-Language Agents
Guanxiong Chen, Qianjun Xia, Jiawei Peng +24
Real-to-sim conversion for robotic interaction with objects remains labor-intensive because it requires more than visual reconstruction: a streamlined real2sim process must recover…
MemoryVAM: Integrating Memory into Video Action Model for Robot Manipulation
Yuxin Jiang, Chang Yu, Yunuo Chen +4
Video-world-model policies learn action-relevant representations by predicting future observations. However, they condition on only a short observation window, which renders long-h…
Sparse2Act: Learning Action-Aligned Sparse 3D Representations for Cross-Domain Robot Manipulation
Yu Guo, Chang Yu, Siyu Ma +4
Explicit 3D representations are attractive for manipulation because they expose object shape, workspace geometry, and robot-object relations in metric coordinates. However, sparse…
TacCoRL: Integrating Tactile Feedback into VLA via Simulation
Siyu Ma, Yuqi Liang, Chang Yu +5
Vision-language-action (VLA) models provide strong visual, language, and action priors for robot manipulation, but visual observations alone often miss the local contact state requ…
GRAIL: Generating Humanoid Loco-Manipulation from World Models
Tianyi Xie, Haotian Zhang, Jinhyung Park +17
Scaling humanoid loco-manipulation requires robot-compatible demonstrations across diverse objects, whole-body motions, and scene geometries, but teleoperation and motion capture a…
Fishbone: From One 3D Asset to a Million Controllable Edits
Yumeng He, Xiaoying Wang, Peihao Li +7
Large-scale controllable 3D assets are critical for computer graphics, embodied AI, robotics, and interactive content creation, yet creating diverse 3D assets remains challenging d…
WorldParticle: Unified World Simulation of Lagrangian Particle Dynamics via Transformer
Caoliwen Wang, Minghao Guo, Siyuan Chen +13
A unified simulator that can model diverse physical phenomena without solver-specific redesign is a long-standing goal across simulation science. We present a learning-based partic…
JARVIS: A Just-in-Time Augmented Reality VLM-Powered Instruction System for Cross-Reality Task Guidance
Yusi Sun, Ying Jiang, Jiayin Lu +3
Many everyday tasks rely on external tutorials such as manuals and videos, requiring users to constantly switch between reading instructions and performing actions, which disrupts…
Learn2Fold: Structured Origami Generation with World Model Planning
Yanjia Huang, Yunuo Chen, Ying Jiang +4
The ability to transform a flat sheet into a complex three-dimensional structure is a fundamental test of physical intelligence. Unlike cloth manipulation, origami is governed by s…
SeeClear: Reliable Transparent Object Depth Estimation via Generative Opacification
Xiaoying Wang, Yumeng He, Jingkai Shi +4
Monocular depth estimation remains challenging for transparent objects, where refraction and transmission are difficult to model and break the appearance assumptions used by depth…
M-ABD: Scalable, Efficient, and Robust Multi-Affine-Body Dynamics
Zhiyong He, Dewen Guo, Minghao Guo +6
Simulating large-scale articulated assemblies poses a significant challenge due to the numerical stiffness and geometric complexity of jointed structures. Conventional rigid body s…
MetaWorld-X: Hierarchical World Modeling via VLM-Orchestrated Experts for Humanoid Loco-Manipulation
Yutong Shen, Hangxu Liu, Penghui Liu +6
Learning natural, stable, and compositionally generalizable whole-body control policies for humanoid robots performing simultaneous locomotion and manipulation (loco-manipulation)…
MPM Lite: Linear Kernels and Integration without Particles
Xiang Feng, Yunuo Chen, Chang Yu +6
In this paper, we introduce MPM Lite, a new hybrid Lagrangian/Eulerian method that eliminates the need for particle-based quadrature at solve time. Standard MPM practices suffer fr…
DressWild: Feed-Forward Pose-Agnostic Garment Sewing Pattern Generation from In-the-Wild Images
Zeng Tao, Ying Jiang, Yunuo Chen +7
Recent advances in garment pattern generation have shown promising progress. However, existing feed-forward methods struggle with diverse poses and viewpoints, while optimization-b…
EMPM: Embodied MPM for Modeling and Simulation of Deformable Objects
Yunuo Chen, Yafei Hu, Lingfeng Sun +3
Modeling deformable objects - especially continuum materials - in a way that is physically plausible, generalizable, and data-efficient remains challenging across 3D vision, graphi…