Mysterious and Manipulative Black Boxes: A Qualitative Analysis of Perceptions on Recommender Systems

Abstract

Recommender systems are used to provide relevant suggestions on various matters. Although these systems are a classical research topic, knowledge is still limited regarding the public opinion about these systems. Public opinion is also important because the systems are known to cause various problems. To this end, this paper presents a qualitative analysis of the perceptions of ordinary citizens, civil society groups, businesses, and others on recommender systems in Europe. The dataset examined is based on the answers submitted to a consultation about the Digital Services Act (DSA) recently enacted in the European Union (EU). Therefore, not only does the paper contribute to the pressing question about regulating new technologies and online platforms, but it also reveals insights about the policy-making of the DSA. According to the qualitative results, Europeans have generally negative opinions about recommender systems and the quality of their recommendations. The systems are widely seen to violate privacy and other fundamental rights. According to many Europeans, these also cause various societal problems, including even threats to democracy. Furthermore, existing regulations in the EU are commonly seen to have failed due to a lack of proper enforcement. Numerous suggestions were made by the respondents to the consultation for improving the situation, but only a few of these ended up to the DSA.

First Monday, vol. 29, no. 6

References in corpus (9)

• AI-Ethics by Design. Evaluating Public Perception on the Importance of Ethical Design Principles of AI
• Tracking, Profiling, and Ad Targeting in the Alexa Echo Smart Speaker Ecosystem
• Recommender Systems and Algorithmic Hate
• The Hitchhiker's Guide to Facebook Web Tracking with Invisible Pixels and Click IDs
• Crossing Cross-Domain Paths in the Current Web
• A Text Mining Analysis of Data Protection Politics: The Case of Plenary Sessions of the European Parliament
• Analyzing User Characteristics of Hate Speech Spreaders on Social Media
• Design Patterns for Machine Learning Based Systems with Human-in-the-Loop
• A Note on the Proposed Law for Improving the Transparency of Political Advertising in the European Union

Cited by in corpus (2)

• The Potential of Citizen Platforms for Requirements Engineering of Large Socio-Technical Software Systems
• SoK: The Design Paradigm of Safe and Secure Defaults