Inferring Cognitive Models from Data using Approximate Bayesian Computation

Abstract

An important problem for HCI researchers is to estimate the parameter values of a cognitive model from behavioral data. This is a difficult problem, because of the substantial complexity and variety in human behavioral strategies. We report an investigation into a new approach using approximate Bayesian computation (ABC) to condition model parameters to data and prior knowledge. As the case study we examine menu interaction, where we have click time data only to infer a cognitive model that implements a search behaviour with parameters such as fixation duration and recall probability. Our results demonstrate that ABC (i) improves estimates of model parameter values, (ii) enables meaningful comparisons between model variants, and (iii) supports fitting models to individual users. ABC provides ample opportunities for theoretical HCI research by allowing principled inference of model parameter values and their uncertainty.

To appear in CHI'2017

References in corpus (1)

• Bayesian Optimization for Likelihood-Free Inference of Simulator-Based Statistical Models

Cited by in corpus (9)

• Bayesian optimisation for likelihood-free cosmological inference
• ELFI: Engine for Likelihood-Free Inference
• Predicting Game Engagement and Difficulty Using AI Players
• Inverse Reinforcement Learning from Summary Data
• SIM2VR: Towards Automated Biomechanical Testing in VR
• The Human in the Infinite Loop: A Case Study on Revealing and Explaining Human-AI Interaction Loop Failures
• Hierarchical Reinforcement Learning as a Model of Human Task Interleaving
• Stochastic Cluster Embedding
• Forward and Inverse models in HCI:Physical simulation and deep learning for inferring 3D finger pose