activity
20162026
most citedAdding Conditional Control to Text-to-Image Diffusion Models

222 citations · 543 across the 56 of their papers we have counts for

collaborators
Showing 2023Show all

9 papers · 1 filter

cs.HC2023

Almanac: An API for Recommending Text Annotations For Time-Series Charts Using News Headlines

Terrell Ibanez, Vidya Setlur, Maneesh Agrawala

Authors often add text annotations to charts to provide additional context for visually prominent features such as peaks, valleys, and trends. However, writing annotations that pro…

cs.CV2023★ 1 cited

SparseCtrl: Adding Sparse Controls to Text-to-Video Diffusion Models

Yuwei Guo, Ceyuan Yang, Anyi Rao +3

The development of text-to-video (T2V), i.e., generating videos with a given text prompt, has been significantly advanced in recent years. However, relying solely on text prompts o…

cs.GR2023★ 10 cited

Editing Motion Graphics Video via Motion Vectorization and Transformation

Sharon Zhang, Jiaju Ma, Jiajun Wu +2

Motion graphics videos are widely used in Web design, digital advertising, animated logos and film title sequences, to capture a viewer's attention. But editing such video is chall…

cs.CV2023

Tree-Structured Shading Decomposition

Chen Geng, Hong-Xing Yu, Sharon Zhang +2

We study inferring a tree-structured representation from a single image for object shading. Prior work typically uses the parametric or measured representation to model shading, wh…

cs.HC2023★ 15 cited

TaleStream: Supporting Story Ideation with Trope Knowledge

Jean-Peïc Chou, Alexa F. Siu, Nedim Lipka +3

Story ideation is a critical part of the story-writing process. It is challenging to support computationally due to its exploratory and subjective nature. Tropes, which are recurri…

cs.HC2023★ 8 cited

Bridging the Gulf of Envisioning: Cognitive Design Challenges in LLM Interfaces

Hariharan Subramonyam, Roy Pea, Christopher Lawrence Pondoc +2

Large language models (LLMs) exhibit dynamic capabilities and appear to comprehend complex and ambiguous natural language prompts. However, calibrating LLM interactions is challeng…

cs.HC2023★ 7 cited

Automated Conversion of Music Videos into Lyric Videos

Jiaju Ma, Anyi Rao, Li-Yi Wei +3

Musicians and fans often produce lyric videos, a form of music videos that showcase the song's lyrics, for their favorite songs. However, making such videos can be challenging and…

cs.HC2023★ 10 cited

EmphasisChecker: A Tool for Guiding Chart and Caption Emphasis

Dae Hyun Kim, Seulgi Choi, Juho Kim +2

Recent work has shown that when both the chart and caption emphasize the same aspects of the data, readers tend to remember the doubly-emphasized features as takeaways; when there…

cs.CV2023★ 222 cited

Adding Conditional Control to Text-to-Image Diffusion Models

Lvmin Zhang, Anyi Rao, Maneesh Agrawala

We present ControlNet, a neural network architecture to add spatial conditioning controls to large, pretrained text-to-image diffusion models. ControlNet locks the production-ready…