4 papers · 1 filter
Causal-Adapter: Taming Text-to-Image Diffusion for Faithful Counterfactual Generation
Lei Tong, Zhihua Liu, Chaochao Lu +5
We present Causal-Adapter, a modular framework that adapts frozen text-to-image diffusion backbones for counterfactual image generation. Our method supports causal interventions on…
Segment Anyword: Mask Prompt Inversion for Open-Set Grounded Segmentation
Zhihua Liu, Amrutha Saseendran, Lei Tong +8
Open-set image segmentation poses a significant challenge because existing methods often demand extensive training or fine-tuning and generally struggle to segment unified objects…
Tackling Structural Hallucination in Image Translation with Local Diffusion
Seunghoi Kim, Chen Jin, Tom Diethe +5
Recent developments in diffusion models have advanced conditioned image generation, yet they struggle with reconstructing out-of-distribution (OOD) images, such as unseen tumors in…
An Image is Worth Multiple Words: Discovering Object Level Concepts using Multi-Concept Prompt Learning
Chen Jin, Ryutaro Tanno, Amrutha Saseendran +2
Textural Inversion, a prompt learning method, learns a singular text embedding for a new "word" to represent image style and appearance, allowing it to be integrated into natural l…