ST-GREED: Space-Time Generalized Entropic Differences for Frame Rate Dependent Video Quality Prediction
arXiv:2010.13715 · doi:10.1109/TIP.2021.3106801
Abstract
We consider the problem of conducting frame rate dependent video quality assessment (VQA) on videos of diverse frame rates, including high frame rate (HFR) videos. More generally, we study how perceptual quality is affected by frame rate, and how frame rate and compression combine to affect perceived quality. We devise an objective VQA model called Space-Time GeneRalized Entropic Difference (GREED) which analyzes the statistics of spatial and temporal band-pass video coefficients. A generalized Gaussian distribution (GGD) is used to model band-pass responses, while entropy variations between reference and distorted videos under the GGD model are used to capture video quality variations arising from frame rate changes. The entropic differences are calculated across multiple temporal and spatial subbands, and merged using a learned regressor. We show through extensive experiments that GREED achieves state-of-the-art performance on the LIVE-YT-HFR Database when compared with existing VQA models. The features used in GREED are highly generalizable and obtain competitive performance even on standard, non-HFR VQA databases. The implementation of GREED has been made available online: https://github.com/pavancm/GREED
References in corpus (2)
Cited by in corpus (13)
- Image Quality Assessment using Contrastive Learning
- GAMIVAL: Video Quality Prediction on Mobile Cloud Gaming Content
- Study of Subjective and Objective Quality Assessment of Mobile Cloud Gaming Videos
- RankDVQA: Deep VQA based on Ranking-inspired Hybrid Training
- A Subjective Quality Study for Video Frame Interpolation
- BVI-VFI: A Video Quality Database for Video Frame Interpolation
- Subjective and Objective Quality Assessment of Rendered Human Avatar Videos in Virtual Reality
- Video Decoding Energy Reduction Using Temporal-Domain Filtering
- RankDVQA-mini: Knowledge Distillation-Driven Deep Video Quality Assessment
- Highly Efficient No-reference 4K Video Quality Assessment with Full-Pixel Covering Sampling and Training Strategy
- MVAD: A Multiple Visual Artifact Detector for Video Streaming
- Making Video Quality Assessment Models Sensitive to Frame Rate Distortions
- An Efficient Quality Metric for Video Frame Interpolation Based on Motion-Field Divergence