12 papers · 1 filter
A Tri-Dynamic Preprocessing Framework for UGC Video Compression
Fei Zhao, Mengxi Guo, Shijie Zhao +3
In recent years, user generated content (UGC) has become the dominant force in internet traffic. However, UGC videos exhibit a higher degree of variability and diverse characterist…
A Preprocessing Framework for Video Machine Vision under Compression
Fei Zhao, Mengxi Guo, Shijie Zhao +3
There has been a growing trend in compressing and transmitting videos from terminals for machine vision tasks. Nevertheless, most video coding optimization method focus on minimizi…
Generative Preprocessing for Image Compression with Pre-trained Diffusion Models
Mengxi Guo, Shijie Zhao, Junlin Li +1
Preprocessing is a well-established technique for optimizing compression, yet existing methods are predominantly Rate-Distortion (R-D) optimized and constrained by pixel-level fide…
Audio-Visual Cross-Modal Compression for Generative Face Video Coding
Youmin Xu, Mengxi Guo, Shijie Zhao +4
Generative face video coding (GFVC) is vital for modern applications like video conferencing, yet existing methods primarily focus on video motion while neglecting the significant…
UARE: A Unified Vision-Language Model for Image Quality Assessment, Restoration, and Enhancement
Weiqi Li, Xuanyu Zhang, Bin Chen +7
Image quality assessment (IQA) and image restoration are fundamental problems in low-level vision. Although IQA and restoration are closely connected conceptually, most existing wo…
TempR1: Improving Temporal Understanding of MLLMs via Temporal-Aware Multi-Task Reinforcement Learning
Tao Wu, Li Yang, Gen Zhan +6
Enhancing the temporal understanding of Multimodal Large Language Models (MLLMs) is essential for advancing long-form video analysis, enabling tasks such as temporal localization,…
Reasoning as Representation: Rethinking Visual Reinforcement Learning in Image Quality Assessment
Shijie Zhao, Xuanyu Zhang, Weiqi Li +4
Reasoning-based image quality assessment (IQA) models trained through reinforcement learning (RL) exhibit exceptional generalization, yet the underlying mechanisms and critical fac…
Self-Evolving Vision-Language Models for Image Quality Assessment via Voting and Ranking
Wen Wen, Tianwu Zhi, Kanglong Fan +6
Improving vision-language models (VLMs) in the post-training stage typically relies on supervised fine-tuning or reinforcement learning, methods that necessitate costly, human-anno…
Adaptive High-Frequency Preprocessing for Video Coding
Yingxue Pang, Shijie Zhao, Junlin Li +1
High-frequency components are crucial for maintaining video clarity and realism, but they also significantly impact coding bitrate, resulting in increased bandwidth and storage cos…
Region-Adaptive Video Sharpening via Rate-Perception Optimization
Yingxue Pang, Shijie Zhao, Mengxi Guo +2
Sharpening is a widely adopted video enhancement technique. However, uniform sharpening intensity ignores texture variations, degrading video quality. Sharpening also increases bit…
VQ-Insight: Teaching VLMs for AI-Generated Video Quality Understanding via Progressive Visual Reinforcement Learning
Xuanyu Zhang, Weiqi Li, Shijie Zhao +3
Recent advances in AI-generated content (AIGC) have led to the emergence of powerful text-to-video generation models. Despite these successes, evaluating the quality of AIGC-genera…
Q-Insight: Understanding Image Quality via Visual Reinforcement Learning
Weiqi Li, Xuanyu Zhang, Shijie Zhao +4
Image quality assessment (IQA) focuses on the perceptual visual quality of images, playing a crucial role in downstream tasks such as image reconstruction, compression, and generat…