6 papers
Self-Improving Video-to-Action Models
Hyunwoo Ryu, Eric Ming Chen, Max Wilcoxson +1
Video generative models are an emerging tool for embodied agents: they can serve as scalable visual planners, generating videos that depict how to complete previously unseen tasks.…
Reconstructing the Vocal Tract with Differentiable Acoustic Simulation
Eric Ming Chen, Jin Woo Lee, Vincent Sitzmann
The vocal tract is the region of the human body responsible for filtering one's voice to create speech. In this paper, we present a differentiable and GPU accelerated acoustic simu…
Snapmoji: Instant Generation of Animatable Dual-Stylized Avatars
Eric M. Chen, Di Liu, Sizhuo Ma +8
Despite the increasing popularity of avatar systems such as Snapchat Bitmojis, existing production avatar platforms face several limitations, such as a limited number of predefined…
Riemannian Residual Neural Networks
Isay Katsman, Eric Ming Chen, Sidhanth Holalkere +4
Recent methods in geometric deep learning have introduced various neural networks to operate over data that lie on Riemannian manifolds. Such networks are often necessary to learn…
Ray Conditioning: Trading Photo-consistency for Photo-realism in Multi-view Image Generation
Eric Ming Chen, Sidhanth Holalkere, Ruyu Yan +2
Multi-view image generation attracts particular attention these days due to its promising 3D-related applications, e.g., image viewpoint editing. Most existing methods follow a par…
What's in a Decade? Transforming Faces Through Time
Eric Ming Chen, Jin Sun, Apoorv Khandelwal +3
How can one visually characterize people in a decade? In this work, we assemble the Faces Through Time dataset, which contains over a thousand portrait images from each decade, spa…