145 citations · 279 across the 13 of their papers we have counts for
5 papers · 1 filter
ALP: Action-Aware Embodied Learning for Perception
Xinran Liang, Anthony Han, Wilson Yan +2
Current methods in training and benchmarking vision models exhibit an over-reliance on passive, curated datasets. Although models trained on these datasets have shown strong perfor…
Temporally Consistent Transformers for Video Generation
Wilson Yan, Danijar Hafner, Stephen James +1
To generate accurate videos, algorithms have to understand the spatial and temporal dependencies in the world. Current algorithms enable accurate predictions over short horizons bu…
Patch-based Object-centric Transformers for Efficient Video Generation
Wilson Yan, Ryo Okumura, Stephen James +1
In this work, we present Patch-based Object-centric Video Transformer (POVT), a novel region-based video generation architecture that leverages object-centric information to effici…
VideoGPT: Video Generation using VQ-VAE and Transformers
Wilson Yan, Yunzhi Zhang, Pieter Abbeel +1
We present VideoGPT: a conceptually simple architecture for scaling likelihood based generative modeling to natural videos. VideoGPT uses VQ-VAE that learns downsampled discrete la…
Natural Image Manipulation for Autoregressive Models Using Fisher Scores
Wilson Yan, Jonathan Ho, Pieter Abbeel
Deep autoregressive models are one of the most powerful models that exist today which achieve state-of-the-art bits per dim. However, they lie at a strict disadvantage when it come…