I see an IC: A Mixed-Methods Approach to Study Human Problem-Solving Processes in Hardware Reverse Engineering

Abstract

Trust in digital systems depends on secure hardware, often assured through Hardware Reverse Engineering (HRE). This work develops methods for investigating human problem-solving processes in HRE, an underexplored yet critical aspect. Since reverse engineers rely heavily on visual information, eye tracking holds promise for studying their cognitive processes. To gain further insights, we additionally employ verbal thought protocols during and immediately after HRE tasks: Concurrent and Retrospective Think Aloud. We evaluate the combination of eye tracking and Think Aloud with 41 participants in an HRE simulation. Eye tracking accurately identifies fixations on individual circuit elements and highlights critical components. Based on two use cases, we demonstrate that eye tracking and Think Aloud can complement each other to improve data quality. Our methodological insights can inform future studies in HRE, a specific setting of human-computer interaction, and in other problem-solving settings involving misleading or missing information.

References in corpus (6)

• Evaluation of Appearance-Based Methods and Implications for Gaze-Based Applications
• Hardware Reverse Engineering: Overview and Open Challenges
• Highway to HAL: Open-Sourcing the First Extendable Gate-Level Netlist Reverse Engineering Framework
• Teaching Hardware Reverse Engineering: Educational Guidelines and Practical Insights
• Towards Cognitive Obfuscation: Impeding Hardware Reverse Engineering Based on Psychological Insights
• Promoting the Acquisition of Hardware Reverse Engineering Skills