When majority voting fails: Comparing quality assurance methods for noisy human computation environment

Yu-An Sun, Christopher Dance

Quality assurance remains a key topic in human computation research. Prior work indicates that majority voting is effective for low difficulty tasks, but has limitations for harder…