The Dark Side of Perceptual Manipulations in Virtual Reality

Abstract

"Virtual-Physical Perceptual Manipulations" (VPPMs) such as redirected walking and haptics expand the user's capacity to interact with Virtual Reality (VR) beyond what would ordinarily physically be possible. VPPMs leverage knowledge of the limits of human perception to effect changes in the user's physical movements, becoming able to (perceptibly and imperceptibly) nudge their physical actions to enhance interactivity in VR. We explore the risks posed by the malicious use of VPPMs. First, we define, conceptualize and demonstrate the existence of VPPMs. Next, using speculative design workshops, we explore and characterize the threats/risks posed, proposing mitigations and preventative recommendations against the malicious use of VPPMs. Finally, we implement two sample applications to demonstrate how existing VPPMs could be trivially subverted to create the potential for physical harm. This paper aims to raise awareness that the current way we apply and publish VPPMs can lead to malicious exploits of our perceptual vulnerabilities.

15 pages, 7 figures

Cited by in corpus (11)

• Augmented Object Intelligence with XR-Objects
• Security and Privacy in Virtual Reality: A Literature Survey
• Memory Manipulations in Extended Reality
• The Dark Side of Augmented Reality: Exploring Manipulative Designs in AR
• SoK: Data Privacy in Virtual Reality
• Let's Talk Futures: A Literature Review of HCI's Future-Orientation
• Exploring the Perspectives of Social VR-Aware Non-Parent Adults and Parents on Children's Use of Social Virtual Reality
• Understanding Physical Breakdowns in Virtual Reality
• Mind Games! Exploring the Impact of Dark Patterns in Mixed Reality Scenarios
• Modeling Object Attention in Mobile AR for Intrinsic Cognitive Security
• Illusion Worlds: Deceptive UI Attacks in Social VR