5 papers
Causal-Adapter: Taming Text-to-Image Diffusion for Faithful Counterfactual Generation
Lei Tong, Zhihua Liu, Chaochao Lu +5
We present Causal-Adapter, a modular framework that adapts frozen text-to-image diffusion backbones for counterfactual image generation. Our method supports causal interventions on…
CoRefine: Confidence-Guided Self-Refinement for Adaptive Test-Time Compute
Chen Jin, Ryutaro Tanno, Tom Diethe +1
Large Language Models (LLMs) often rely on test-time scaling via parallel decoding (for example, 512 samples) to boost reasoning accuracy, but this incurs substantial compute. We i…
Protein generation with embedding learning for motif diversification
Kevin Michalewicz, Chen Jin, Philip Alexander Teare +4
A fundamental challenge in protein design is the trade-off between generating structural diversity while preserving motif biological function. Current state-of-the-art methods, suc…
Diffusion Instruction Tuning
Chen Jin, Ryutaro Tanno, Amrutha Saseendran +2
We introduce Lavender, a simple supervised fine-tuning (SFT) method that boosts the performance of advanced vision-language models (VLMs) by leveraging state-of-the-art image gener…
Segment Anyword: Mask Prompt Inversion for Open-Set Grounded Segmentation
Zhihua Liu, Amrutha Saseendran, Lei Tong +8
Open-set image segmentation poses a significant challenge because existing methods often demand extensive training or fine-tuning and generally struggle to segment unified objects…