A Privacy Preserving System for Movie Recommendations Using Federated Learning

Abstract

Recommender systems have become ubiquitous in the past years. They solve the tyranny of choice problem faced by many users, and are utilized by many online businesses to drive engagement and sales. Besides other criticisms, like creating filter bubbles within social networks, recommender systems are often reproved for collecting considerable amounts of personal data. However, to personalize recommendations, personal information is fundamentally required. A recent distributed learning scheme called federated learning has made it possible to learn from personal user data without its central collection. Consequently, we present a recommender system for movie recommendations, which provides privacy and thus trustworthiness on multiple levels: First and foremost, it is trained using federated learning and thus, by its very nature, privacy-preserving, while still enabling users to benefit from global insights. Furthermore, a novel federated learning scheme, called FedQ, is employed, which not only addresses the problem of non-i.i.d.-ness and small local datasets, but also prevents input data reconstruction attacks by aggregating client updates early. Finally, to reduce the communication overhead, compression is applied, which significantly compresses the exchanged neural network parametrizations to a fraction of their original size. We conjecture that this may also improve data privacy through its lossy quantization stage.

Accepted for publication in the ACM Transactions on Recommender Systems (TORS) Special Issue on Trustworthy Recommender Systems

References in corpus (19)

• Fundamentals of Recurrent Neural Network (RNN) and Long Short-Term Memory (LSTM) Network
• Graph Convolutional Neural Networks for Web-Scale Recommender Systems
• On the Convergence of FedAvg on Non-IID Data
• Secure Federated Transfer Learning
• FedKD: Communication Efficient Federated Learning via Knowledge Distillation
• iDLG: Improved Deep Leakage from Gradients
• FedPAQ: A Communication-Efficient Federated Learning Method with Periodic Averaging and Quantization
• Federated Meta-Learning with Fast Convergence and Efficient Communication
• LightFR: Lightweight Federated Recommendation with Privacy-preserving Matrix Factorization
• Federated Multi-view Matrix Factorization for Personalized Recommendations
• Feature-Based Matrix Factorization
• Recommender Systems and Algorithmic Hate
• FedEval: A Holistic Evaluation Framework for Federated Learning
• On the Unreasonable Effectiveness of Federated Averaging with Heterogeneous Data
• Speeding up Heterogeneous Federated Learning with Sequentially Trained Superclients
• Data Leakage in Federated Averaging
• Gradient Obfuscation Gives a False Sense of Security in Federated Learning
• A Survey on Federated Recommendation Systems
• Mixed Precision Quantization to Tackle Gradient Leakage Attacks in Federated Learning

Cited by in corpus (1)

• FedSlate:A Federated Deep Reinforcement Learning Recommender System