Seeing virtual while acting real: Visual display and strategy effects on the time and precision of eye-hand coordination

Abstract

Effects of computer generated 2D and 3D views on the time and precision of bare-handed or tool-mediated eye-hand coordination were investigated in a pick-and-place-task with complete novices. All of them scored well above average in spatial perspective taking ability and performed the task with their dominant hand. Two groups of novices, four men and four women in each group, had to place a small object in a precise order on the centre of five targets on a Real-world Action Field (RAF), as swiftly as possible and as precisely as possible, using a tool or not (control). Each individual session consisted of four visual display conditions. The order of conditions was counterbalanced between individuals and sessions. Subjects looked at what their hands were doing 1) directly in front of them (natural top-down view) 2) in topdown 2D fisheye camera view 3) in top-down undistorted 2D view or 4) in 3D stereoscopic top-down view (head-mounted OCULUS DK 2). It was made sure that object movements in all image conditions matched the real-world movements in time and space. One group was looking at the 2D images with the monitor positioned sideways (sub-optimal); the other group was looking at the monitor placed straight ahead of them (near-optimal). All image viewing conditions had significantly detrimental effects on time (seconds) and precision (pixels) of task execution when compared with natural direct viewing.

arXiv commentarXiv admin note: text overlap with arXiv:1803.11283

References in corpus (4)

• Principles of perceptual grouping: implications for image-guided surgery
• Getting nowhere fast: trade-off between speed and precision in training to execute image-guided hand-tool movements
• Visual spatial learning of complex object morphologies through interaction with virtual and real-world data
• Wayfinding through an unfamiliar environment

Cited by in corpus (16)

• Seven properties of self-organization in the human brain
• Towards expert-based speed-precision control in early simulator training for novice surgeons
• Sensors for expert grip force profiling: towards benchmarking manual control of a robotic device for surgical tool movements
• Effects of 2D and 3D image views on hand movement trajectories in the surgeons peripersonal space in a computer controlled simulator environment
• Grip force as a functional window to somatosensory cognition
• Spatiotemporal modeling of grip forces captures proficiency in manual robot control
• Colour for behavioural success
• From Biological Synapses to Intelligent Robots
• Human Symmetry Uncertainty Detected by a Self-Organizing Neural Network Map
• Correlating grip force signals from multiple sensors highlights prehensile control strategies in a complex task-user system
• Making Sense of Complex Sensor Data Streams
• Combining visual contrast information with sound can produce faster decisions
• Wearable Sensors for Individual Grip Force Profiling
• Bilateral symmetry strengthens the perceptual salience of figure against ground
• Surgical task expertise detected by a self-organizing neural network map
• Artificial Intelligence, connected products, virtual reality: potential impacts on consumer safety in terms of their physical and psychological ability or well-being