activity
20232026
most citedMovie Gen: A Cast of Media Foundation Models

8 citations · 13 across the 18 of their papers we have counts for

collaborators
Showing 2024Show all

5 papers · 1 filter

cs.CL2024

LLäMmlein: Transparent, Compact and Competitive German-Only Language Models from Scratch

Jan Pfister, Julia Wunderle, Andreas Hotho

We create two German-only decoder models, LLäMmlein 120M and 1B, transparently from scratch and publish them, along with the training data, for the German NLP research community to…

cs.CV2024★ 8 cited

Movie Gen: A Cast of Media Foundation Models

Adam Polyak, Amit Zohar, Andrew Brown +85

We present Movie Gen, a cast of foundation models that generates high-quality, 1080p HD videos with different aspect ratios and synchronized audio. We also show additional capabili…

cs.LG2024

TLDR: Token-Level Detective Reward Model for Large Vision Language Models

Deqing Fu, Tong Xiao, Rui Wang +5

Although reward models have been successful in improving multimodal large language models, the reward models themselves remain brutal and contain minimal information. Notably, exis…

cs.CV2024

Layout Agnostic Scene Text Image Synthesis with Diffusion Models

Qilong Zhangli, Jindong Jiang, Di Liu +6

While diffusion models have significantly advanced the quality of image generation their capability to accurately and coherently render text within these images remains a substanti…

cs.CV2024★ 1 cited

Animated Stickers: Bringing Stickers to Life with Video Diffusion

David Yan, Winnie Zhang, Luxin Zhang +15

We introduce animated stickers, a video diffusion model which generates an animation conditioned on a text prompt and static sticker image. Our model is built on top of the state-o…