Replicating analyses of item response curves using data from the Force and Motion Conceptual Evaluation

Abstract

Ishimoto, Davenport, and Wittmann have previously reported analyses of data from student responses to the Force and Motion Conceptual Evaluation (FMCE), in which they used item response curves (IRCs) to make claims about American and Japanese students' relative likelihood to choose certain incorrect responses to some questions. We have used an independent data set of over 6,500 American students' responses to the FMCE to generate IRCs to test their claims. Converting the IRCs to vectors, we used dot product analysis to compare each response item quantitatively. For most questions, our analyses are consistent with Ishimoto, Davenport, and Wittmann, with some results suggesting more minor differences between American and Japanese students than previously reported. We also highlight the pedagogical advantages of using IRCs to determine the differences in response patterns for different populations to better understand student thinking prior to instruction.

References in corpus (12)

• The demographics of physics education research
• Analyzing Force Concept Inventory with Item Response Theory
• Gender Fairness within the Force Concept Inventory
• Secondary Analysis of Teaching Methods in Introductory Physics: a 50k-Student Study
• Resource Letter: RBAI-1: Research-based Assessment Instruments in Physics and Astronomy
• Applying a resources framework to analysis of the Force and Motion Conceptual Evaluation
• Multi-Dimensional Item Response Theory and the Force Concept Inventory
• Exploring the Structure of Misconceptions in the Force Concept Inventory with Modified Module Analysis
• Extending Modified Module Analysis to Include Correct Responses: An Analysis of the Force Concept Inventory
• Quantitatively ranking incorrect responses to multiple-choice questions using item response theory
• Resource Letter RBAI-2: Research-based assessment instruments: Beyond physics topics
• Transition Matrices: A Tool to Assess Student Learning and Improve Instruction