Development and validation of a conceptual multiple-choice survey instrument to assess student understanding of introductory thermodynamics

Abstract

We discuss the development and validation of the long version of a conceptual multiple-choice survey instrument called the Survey of Thermodynamic Processes and First and Second Laws-Long (STPFaSL-Long) suitable for introductory physics courses. This version of the survey instrument is a longer version of the original shorter version developed and validated earlier. The 19 contexts including the exact wording of all of the problem situations posed in the two versions of the survey instrument are identical and the difference between the long and short versions of the instrument is only in the multiple-choice options. In particular, in the longer version of the survey instrument, there are no alternative conceptions explicitly embedded in the four multiple-choice options students choose from and the questions asked in a given context in one item of the shorter survey instrument were split into several items focusing, e.g., on different thermodynamic variables. After the development and validation of the longer version of the survey instrument, the final version was administered in 12 different in-person classes (four different institutions) in which students answered the questions in-class on paper scantron forms with the instructor as the proctor and 12 different in-person classes (five different institutions) in which students answered the questions online on Qualtrics within a two-hour period. This longer version of the survey instrument was administered to introductory physics students in various traditionally taught calculus-based and algebra-based classes before and after traditional lecture-based instruction in relevant concepts. It was also administered to upper-level undergraduates majoring in physics and Ph.D. students taught traditionally for bench marking purposes.

arXiv admin note: substantial text overlap with arXiv:2102.07302

References in corpus (16)

• Students' Understanding of Direct Current Resistive Electrical Circuits
• Multiple-choice test of energy and momentum concepts
• When physical intuition fails
• Assessing Student Expertise in Introductory Physics with Isomorphic Problems, Part II: Effect of Some Potential Factors on Problem Solving and Transfer
• Student understanding of rotational and rolling motion concepts
• Student understanding of symmetry and Gauss's law of electricity
• Using Isomorphic Problems to Learn Introductory Physics
• Challenges in designing appropriate scaffolding to improve students' representational consistency: The case of a Gauss's law problem
• Identifying Student Difficulties with Entropy, Heat Engines, and the Carnot Cycle
• Resource Letter TTSM-1: Teaching thermodynamics and statistical mechanics in introductory physics, chemistry, and biology
• Do students benefit from drawing productive diagrams themselves while solving introductory physics problems? The case of two electrostatic problems
• Development and Validation of a conceptual survey instrument to evaluate introductory physics students' understanding of thermodynamics
• Student understanding of the Boltzmann factor
• Developing a Magnetism Conceptual Survey and Assessing Gender Differences in Student Understanding of Magnetism
• Student understanding of Symmetry and Gauss' law
• Online Administration of Research-Based Assessments

Cited by in corpus (2)

• Challenges in addressing student difficulties with basics and change of basis for two-state quantum systems using a multiple-choice question sequence in online and in-person classes
• Investigating introductory and advanced students' difficulties with change in internal energy, work and heat transfer using a validated instrument