Developing Future Human-Centered Smart Cities: Critical Analysis of Smart City Security, Interpretability, and Ethical Challenges
arXiv:2012.09110
Abstract
As the globally increasing population drives rapid urbanisation in various parts of the world, there is a great need to deliberate on the future of the cities worth living. In particular, as modern smart cities embrace more and more data-driven artificial intelligence services, it is worth remembering that technology can facilitate prosperity, wellbeing, urban livability, or social justice, but only when it has the right analog complements (such as well-thought out policies, mature institutions, responsible governance); and the ultimate objective of these smart cities is to facilitate and enhance human welfare and social flourishing. Researchers have shown that various technological business models and features can in fact contribute to social problems such as extremism, polarization, misinformation, and Internet addiction. In the light of these observations, addressing the philosophical and ethical questions involved in ensuring the security, safety, and interpretability of such AI algorithms that will form the technological bedrock of future cities assumes paramount importance. Globally there are calls for technology to be made more humane and human-centered. In this paper, we analyze and explore key challenges including security, robustness, interpretability, and ethical (data and algorithmic) challenges to a successful deployment of AI in human-centric applications, with a particular emphasis on the convergence of these concepts/challenges. We provide a detailed review of existing literature on these key challenges and analyze how one of these challenges may lead to others or help in solving other challenges. The paper also advises on the current limitations, pitfalls, and future directions of research in these domains, and how it can fill the current gaps and lead to better solutions. We believe such rigorous analysis will provide a baseline for future research in the domain.
arXiv comment34 pages
References in corpus (48)
- Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithms
- Artificial Intelligence: the global landscape of ethics guidelines
- Deep learning in agriculture: A survey
- Towards A Rigorous Science of Interpretable Machine Learning
- A Survey on Explainable Artificial Intelligence (XAI): Towards Medical XAI
- Learning Important Features Through Propagating Activation Differences
- Interpretable machine learning: definitions, methods, and applications
- Wild Patterns: Ten Years After the Rise of Adversarial Machine Learning
- Understanding Black-box Predictions via Influence Functions
- Explainable Machine Learning for Scientific Insights and Discoveries
- Data Augmentation Generative Adversarial Networks
- On Evaluating Adversarial Robustness
- Understanding Adversarial Attacks on Deep Learning Based Medical Image Analysis Systems
- The Measure and Mismeasure of Fairness
- Defense-GAN: Protecting Classifiers Against Adversarial Attacks Using Generative Models
- AI Fairness 360: An Extensible Toolkit for Detecting, Understanding, and Mitigating Unwanted Algorithmic Bias
- explAIner: A Visual Analytics Framework for Interactive and Explainable Machine Learning
- DARTS: Deceiving Autonomous Cars with Toxic Signs
- Copycat CNN: Stealing Knowledge by Persuading Confession with Random Non-Labeled Data
- Adversarial Attacks on Deep Neural Networks for Time Series Classification
- Algorithmic decision-making in AVs: Understanding ethical and technical concerns for smart cities
- Adversarial Attacks Against Medical Deep Learning Systems
- Thieves on Sesame Street! Model Extraction of BERT-based APIs
- FDA3 : Federated Defense Against Adversarial Attacks for Cloud-Based IIoT Applications
- Prediction Poisoning: Towards Defenses Against DNN Model Stealing Attacks
- Linking Artificial Intelligence Principles
- Practical Solutions for Machine Learning Safety in Autonomous Vehicles
- AI in Education needs interpretable machine learning: Lessons from Open Learner Modelling
- Have You Stolen My Model? Evasion Attacks Against Deep Neural Network Watermarking Techniques
- Interpretable Adversarial Perturbation in Input Embedding Space for Text
- Defense against Adversarial Attacks in NLP via Dirichlet Neighborhood Ensemble
- Oxford Handbook on AI Ethics Book Chapter on Race and Gender
- Defending Against Machine Learning Model Stealing Attacks Using Deceptive Perturbations
- Explainability and Adversarial Robustness for RNNs
- Explaining Vulnerabilities of Deep Learning to Adversarial Malware Binaries
- When Explainability Meets Adversarial Learning: Detecting Adversarial Examples using SHAP Signatures
- Adversarial representation learning for private speech generation
- Ethical Adversaries: Towards Mitigating Unfairness with Adversarial Machine Learning
- MT-Adapted Datasheets for Datasets: Template and Repository
- Uniqueness of Medical Data Mining: How the new technologies and data they generate are transforming medicine
- Disentangling Influence: Using Disentangled Representations to Audit Model Predictions
- Real-Time Adversarial Attacks
- Gradient Similarity: An Explainable Approach to Detect Adversarial Attacks against Deep Learning
- Deriving Emotions and Sentiments from Visual Content: A Disaster Analysis Use Case
- No Surprises: Training Robust Lung Nodule Detection for Low-Dose CT Scans by Augmenting with Adversarial Attacks
- Creation of User Friendly Datasets: Insights from a Case Study concerning Explanations of Loan Denials
- Omni: Automated Ensemble with Unexpected Models against Adversarial Evasion Attack
- Defending Distributed Classifiers Against Data Poisoning Attacks