278 citations · 481 across the 19 of their papers we have counts for
20 papers
Multi-dimensional Speech Quality Assessment in Crowdsourcing
Babak Naderi, Ross Cutler, Nicolae-Catalin Ristea
Subjective speech quality assessment is the gold standard for evaluating speech enhancement processing and telecommunication systems. The commonly used standard ITU-T Rec. P.800 de…
Full Reference Video Quality Assessment for Machine Learning-Based Video Codecs
Abrar Majeedi, Babak Naderi, Yasaman Hosseinkashi +3
Machine learning-based video codecs have made significant progress in the past few years. A critical area in the development of ML-based video codecs is an accurate evaluation metr…
VCD: A Video Conferencing Dataset for Video Compression
Babak Naderi, Ross Cutler, Nabakumar Singh Khongbantabam +4
Commonly used datasets for evaluating video codecs are all very high quality and not representative of video typically used in video conferencing scenarios. We present the Video Co…
LSTM-based Video Quality Prediction Accounting for Temporal Distortions in Videoconferencing Calls
Gabriel Mittag, Babak Naderi, Vishak Gopal +1
Current state-of-the-art video quality models, such as VMAF, give excellent prediction results by comparing the degraded video with its reference video. However, they do not consid…
ICASSP 2023 Speech Signal Improvement Challenge
Ross Cutler, Ando Saabas, Babak Naderi +3
The ICASSP 2023 Speech Signal Improvement Challenge is intended to stimulate research in the area of improving the speech signal quality in communication systems. The speech signal…
A Transfer Learning Based Model for Text Readability Assessment in German
Salar Mohtaj, Babak Naderi, Sebastian Möller +3
Text readability assessment has a wide range of applications for different target people, from language learners to people with disabilities. The fast pace of textual content produ…
A crowdsourcing approach to video quality assessment
Babak Naderi, Ross Cutler
The gold standard for measuring video quality is the subjective test, and the most prevalent is the ITU-T Rec. P.910, a lab-based subjective standard in use for the past two decade…
ConferencingSpeech 2022 Challenge: Non-intrusive Objective Speech Quality Assessment (NISQA) Challenge for Online Conferencing Applications
Gaoxiong Yi, Wei Xiao, Yiming Xiao +10
With the advances in speech communication systems such as online conferencing applications, we can seamlessly work with people regardless of where they are. However, during online…
Bias-Aware Loss for Training Image and Speech Quality Prediction Models from Multiple Datasets
Gabriel Mittag, Saman Zadtootaghaj, Thilo Michael +2
The ground truth used for training image, video, or speech quality prediction models is based on the Mean Opinion Scores (MOS) obtained from subjective experiments. Usually, it is…
NISQA: A Deep CNN-Self-Attention Model for Multidimensional Speech Quality Prediction with Crowdsourced Datasets
Gabriel Mittag, Babak Naderi, Assmaa Chehadi +1
In this paper, we present an update to the NISQA speech quality prediction model that is focused on distortions that occur in communication networks. In contrast to the previous ve…
Speech Quality Assessment in Crowdsourcing: Comparison Category Rating Method
Babak Naderi, Sebastian Möller, Ross Cutler
Traditionally, Quality of Experience (QoE) for a communication system is evaluated through a subjective test. The most common test method for speech QoE is the Absolute Category Ra…
Effect of Language Proficiency on Subjective Evaluation of Noise Suppression Algorithms
Babak Naderi, Gabriel Mittag, Rafael Zequeira Jim\a'enez +1
Speech communication systems based on Voice-over-IP technology are frequently used by native as well as non-native speakers of a target language, e.g. in international phone calls…
Subjective Evaluation of Noise Suppression Algorithms in Crowdsourcing
Babak Naderi, Ross Cutler
The quality of the speech communication systems, which include noise suppression algorithms, are typically evaluated in laboratory experiments according to the ITU-T Rec. P.835, in…
QUALINET White Paper on Definitions of Immersive Media Experience (IMEx)
Andrew Perkis, Christian Timmerer, Sabina Baraković +41
With the coming of age of virtual/augmented reality and interactive media, numerous definitions, frameworks, and models of immersion have emerged across different fields ranging fr…
An Open source Implementation of ITU-T Recommendation P.808 with Validation
Babak Naderi, Ross Cutler
The ITU-T Recommendation P.808 provides a crowdsourcing approach for conducting a subjective assessment of speech quality using the Absolute Category Rating (ACR) method. We provid…
Transformation of Mean Opinion Scores to Avoid Misleading of Ranked based Statistical Techniques
Babak Naderi, Sebastian Möller
The rank correlation coefficients and the ranked-based statistical tests (as a subset of non-parametric techniques) might be misleading when they are applied to subjectively collec…
Application of Just-Noticeable Difference in Quality as Environment Suitability Test for Crowdsourcing Speech Quality Assessment Task
Babak Naderi, Sebastian Möller
Crowdsourcing micro-task platforms facilitate subjective media quality assessment by providing access to a highly scale-able, geographically distributed and demographically diverse…
Impact of the Number of Votes on the Reliability and Validity of Subjective Speech Quality Assessment in the Crowdsourcing Approach
Babak Naderi, Tobias Hossfeld, Matthias Hirth +3
The subjective quality of transmitted speech is traditionally assessed in a controlled laboratory environment according to ITU-T Rec. P.800. In turn, with crowdsourcing, crowdworke…
Toward a safe supply chain: Incorporating accident, physical, psychosocial, and mental overload risks into supply chain network
Sajad Karimi, Zaniar Ardalan
Considering health and safety factors in supply chain network design brings safer place for employer and help firm to have better image in the society. There are many health and sa…
Subjective Assessment of Text Complexity: A Dataset for German Language
Babak Naderi, Salar Mohtaj, Kaspar Ensikat +1
This paper presents TextComplexityDE, a dataset consisting of 1000 sentences in German language taken from 23 Wikipedia articles in 3 different article-genres to be used for develo…