4 papers
UniLAP: A Unified Latent Action Policy for Cross-Embodiment Manipulation
Lei Yao, Qiao Feng, Mutian Tong +3
Latent Action Models (LAMs) can capture manipulation priors from action-free videos, but discrete latents usually impose a granularity bottleneck, limiting their ability to represe…
Enabling Immersive Audio-Visual Experience from Any Video
Zitong Lan, Mutian Tong, Jiatao Gu +1
Most videos capture only a narrow field of view and provide no spatial audio, limiting the sense of immersion they can provide. Recent video generation models can expand perspectiv…
PointAction: 3D Points as Universal Action Representations for Robot Control
Mutian Tong, Han Jiang, Qiao Feng +2
Video-Action Models (VAMs) leverage the broad visual dynamics captured by pre-trained video diffusion models, offering a promising path toward generalizable robot manipulation. How…
Spatiotemporally Consistent Indoor Lighting Estimation with Diffusion Priors
Mutian Tong, Rundi Wu, Changxi Zheng
Indoor lighting estimation from a single image or video remains a challenge due to its highly ill-posed nature, especially when the lighting condition of the scene varies spatially…