4 citations · 6 across the 14 of their papers we have counts for
15 papers
LongSCOP: Semantically Consistent Long Video Outpainting
Yu Tang, Zhiyuan You, Zhixiao Wang +5
Video out-painting is an important problem, yet existing research focuses primarily on short clips, leaving long video out-painting largely underexplored. Extending video out-paint…
DA-VAE: Plug-in Latent Compression for Diffusion via Detail Alignment
Xin Cai, Zhiyuan You, Zhoutong Zhang +1
Reducing token count is crucial for efficient training and inference of latent diffusion models, especially at high resolution. A common strategy is to build high-compression image…
Evaluation of Visual Processing Should Be Human-Centered, Not Metric-Centered
Jinfan Hu, Fanghua Yu, Zhiyuan You +5
This position paper argues that the evaluation of modern visual processing systems should no longer be driven primarily by single-metric image quality assessment benchmarks, partic…
How far have we gone in Generative Image Restoration? A study on its capability, limitations and evaluation practices
Xiang Yin, Jinfan Hu, Zhiyuan You +4
Generative Image Restoration (GIR) has achieved impressive perceptual realism, but how far have its practical capabilities truly advanced compared with previous methods? To answer…
PhotoAgent: Exploratory Visual Aesthetic Planning with Large Vision Models
Mingde Yao, Zhiyuan You, King-Man Tam +2
With the recent fast development of generative models, instruction-based image editing has shown great potential in generating high-quality images. However, the quality of editing…
PhotoFramer: Multi-modal Image Composition Instruction
Zhiyuan You, Ke Wang, He Zhang +5
Composition matters during the photo-taking process, yet many casual users struggle to frame well-composed images. To provide composition guidance, we introduce PhotoFramer, a mult…
Harnessing Diffusion-Yielded Score Priors for Image Restoration
Xinqi Lin, Fanghua Yu, Jinfan Hu +5
Deep image restoration models aim to learn a mapping from degraded image space to natural image space. However, they face several critical challenges: removing degradation, generat…
Revisiting the Generalization Problem of Low-level Vision Models Through the Lens of Image Deraining
Jinfan Hu, Zhiyuan You, Jinjin Gu +3
Generalization to unseen degradations remains a fundamental challenge for low-level vision models. This paper aims to investigate the underlying mechanism of this failure, using im…
Teaching Large Language Models to Regress Accurate Image Quality Scores using Score Distribution
Zhiyuan You, Xin Cai, Jinjin Gu +2
With the rapid advancement of Multi-modal Large Language Models (MLLMs), MLLM-based Image Quality Assessment (IQA) methods have shown promising performance in linguistic quality de…
UltraFusion: Ultra High Dynamic Imaging using Exposure Fusion
Zixuan Chen, Yujin Wang, Xin Cai +5
Capturing high dynamic range (HDR) scenes is one of the most important issues in camera design. Majority of cameras use exposure fusion, which fuses images captured by different ex…
PhoCoLens: Photorealistic and Consistent Reconstruction in Lensless Imaging
Xin Cai, Zhiyuan You, Hailong Zhang +3
Lensless cameras offer significant advantages in size, weight, and cost compared to traditional lens-based systems. Without a focusing lens, lensless cameras rely on computational…
An Intelligent Agentic System for Complex Image Restoration Problems
Kaiwen Zhu, Jinjin Gu, Zhiyuan You +2
Real-world image restoration (IR) is inherently complex and often requires combining multiple specialized models to address diverse degradations. Inspired by human problem-solving,…
Interpreting Low-level Vision Models with Causal Effect Maps
Jinfan Hu, Jinjin Gu, Shiyao Yu +5
Deep neural networks have significantly improved the performance of low-level vision tasks but also increased the difficulty of interpretability. A deep understanding of deep model…
Enhancing Descriptive Image Quality Assessment with A Large-scale Multi-modal Dataset
Zhiyuan You, Jinjin Gu, Xin Cai +4
With the rapid advancement of Vision Language Models (VLMs), VLM-based Image Quality Assessment (IQA) seeks to describe image quality linguistically to align with human expression…
Depicting Beyond Scores: Advancing Image Quality Assessment through Multi-modal Language Models
Zhiyuan You, Zheyuan Li, Jinjin Gu +3
We introduce a Depicted image Quality Assessment method (DepictQA), overcoming the constraints of traditional score-based methods. DepictQA allows for detailed, language-based, hum…