22 papers
MotionInsight: Diagnosing Object Motion Deficiencies in Generated Videos
Jiahao Zhan, Yongrui Ma, Qunliang Xing +6
Despite rapid progress in video generation models, they still exhibit obvious motion deficiencies, often manifested as incorrect object motion. However, most existing video quality…
VQ-Jarvis: Retrieval-Augmented Video Restoration Agent with Sharp Vision and Fast Thought
Xuanyu Zhang, Weiqi Li, Qunliang Xing +6
Video restoration in real-world scenarios is challenged by heterogeneous degradations, where static architectures and fixed inference pipelines often fail to generalize. Recent age…
ME-IQA: Memory-Enhanced Image Quality Assessment via Re-Ranking
Kanglong Fan, Tianhe Wu, Wen Wen +6
Reasoning-induced vision-language models (VLMs) advance image quality assessment (IQA) with textual reasoning, yet their scalar scores often lack sensitivity and collapse to a few…
Improved Adversarial Diffusion Compression for Real-World Video Super-Resolution
Bin Chen, Weiqi Li, Shijie Zhao +4
While many diffusion models have achieved impressive results in real-world video super-resolution (Real-VSR) by generating rich and realistic details, their reliance on multi-step…
Eliminating VAE for Fast and High-Resolution Generative Detail Restoration
Yan Wang, Shijie Zhao, Junlin Li +1
Diffusion models have attained remarkable breakthroughs in the real-world super-resolution (SR) task, albeit at slow inference and high demand on devices. To accelerate inference,…
A Tri-Dynamic Preprocessing Framework for UGC Video Compression
Fei Zhao, Mengxi Guo, Shijie Zhao +3
In recent years, user generated content (UGC) has become the dominant force in internet traffic. However, UGC videos exhibit a higher degree of variability and diverse characterist…
A Preprocessing Framework for Video Machine Vision under Compression
Fei Zhao, Mengxi Guo, Shijie Zhao +3
There has been a growing trend in compressing and transmitting videos from terminals for machine vision tasks. Nevertheless, most video coding optimization method focus on minimizi…
Generative Preprocessing for Image Compression with Pre-trained Diffusion Models
Mengxi Guo, Shijie Zhao, Junlin Li +1
Preprocessing is a well-established technique for optimizing compression, yet existing methods are predominantly Rate-Distortion (R-D) optimized and constrained by pixel-level fide…
Audio-Visual Cross-Modal Compression for Generative Face Video Coding
Youmin Xu, Mengxi Guo, Shijie Zhao +4
Generative face video coding (GFVC) is vital for modern applications like video conferencing, yet existing methods primarily focus on video motion while neglecting the significant…
UARE: A Unified Vision-Language Model for Image Quality Assessment, Restoration, and Enhancement
Weiqi Li, Xuanyu Zhang, Bin Chen +7
Image quality assessment (IQA) and image restoration are fundamental problems in low-level vision. Although IQA and restoration are closely connected conceptually, most existing wo…
TempR1: Improving Temporal Understanding of MLLMs via Temporal-Aware Multi-Task Reinforcement Learning
Tao Wu, Li Yang, Gen Zhan +6
Enhancing the temporal understanding of Multimodal Large Language Models (MLLMs) is essential for advancing long-form video analysis, enabling tasks such as temporal localization,…
Reasoning as Representation: Rethinking Visual Reinforcement Learning in Image Quality Assessment
Shijie Zhao, Xuanyu Zhang, Weiqi Li +4
Reasoning-based image quality assessment (IQA) models trained through reinforcement learning (RL) exhibit exceptional generalization, yet the underlying mechanisms and critical fac…
Self-Evolving Vision-Language Models for Image Quality Assessment via Voting and Ranking
Wen Wen, Tianwu Zhi, Kanglong Fan +6
Improving vision-language models (VLMs) in the post-training stage typically relies on supervised fine-tuning or reinforcement learning, methods that necessitate costly, human-anno…
Adaptive High-Frequency Preprocessing for Video Coding
Yingxue Pang, Shijie Zhao, Junlin Li +1
High-frequency components are crucial for maintaining video clarity and realism, but they also significantly impact coding bitrate, resulting in increased bandwidth and storage cos…
Region-Adaptive Video Sharpening via Rate-Perception Optimization
Yingxue Pang, Shijie Zhao, Mengxi Guo +2
Sharpening is a widely adopted video enhancement technique. However, uniform sharpening intensity ignores texture variations, degrading video quality. Sharpening also increases bit…
VQ-Insight: Teaching VLMs for AI-Generated Video Quality Understanding via Progressive Visual Reinforcement Learning
Xuanyu Zhang, Weiqi Li, Shijie Zhao +3
Recent advances in AI-generated content (AIGC) have led to the emergence of powerful text-to-video generation models. Despite these successes, evaluating the quality of AIGC-genera…
Q-Insight: Understanding Image Quality via Visual Reinforcement Learning
Weiqi Li, Xuanyu Zhang, Shijie Zhao +4
Image quality assessment (IQA) focuses on the perceptual visual quality of images, playing a crucial role in downstream tasks such as image reconstruction, compression, and generat…
GenDR: Lighten Generative Detail Restoration
Yan Wang, Shijie Zhao, Kexin Zhang +2
Although recent research applying text-to-image (T2I) diffusion models to real-world super-resolution (SR) has achieved remarkable progress, the misalignment of their targets leads…
ResVR: Joint Rescaling and Viewport Rendering of Omnidirectional Images
Weiqi Li, Shijie Zhao, Bin Chen +4
With the advent of virtual reality technology, omnidirectional image (ODI) rescaling techniques are increasingly embraced for reducing transmitted and stored file sizes while prese…
Modular Blind Video Quality Assessment
Wen Wen, Mu Li, Yabin Zhang +4
Blind video quality assessment (BVQA) plays a pivotal role in evaluating and improving the viewing experience of end-users across a wide range of video-based platforms and services…
CAMixerSR: Only Details Need More "Attention"
Yan Wang, Yi Liu, Shijie Zhao +2
To satisfy the rapidly increasing demands on the large image (2K-8K) super-resolution (SR), prevailing methods follow two independent tracks: 1) accelerate existing networks by con…
Optimal Transcoding Resolution Prediction for Efficient Per-Title Bitrate Ladder Estimation
Jinhai Yang, Mengxi Guo, Shijie Zhao +2
Adaptive video streaming requires efficient bitrate ladder construction to meet heterogeneous network conditions and end-user demands. Per-title optimized encoding typically traver…