Cheat sites and artificial intelligence usage in online introductory physics courses: what is the extent and what effect does it have on assessments?
arXiv:2312.15334 · doi:10.1103/PhysRevPhysEducRes.20.010145
Abstract
As a result of the pandemic, many physics courses moved online. Alongside, the popularity of internet-based problem-solving sites and forums rose. With the emergence of Large Language Models, another shift occurred. One year into the public availability of these models, how has online help-seeking behavior among introductory physics students changed, and what is the effect of different patterns of online-resource usage? In a mixed-method approach, we investigate student choices and their impact on assessment components of an online introductory physics course for scientists and engineers. We find that students still mostly rely on traditional internet resources, and that their usage strongly influences the outcome of low-stake unsupervised quizzes. However, we also find that the impact of different help-seeking patterns on the supervised assessment components of the course is non-significant.
References in corpus (7)
- Natural Scales in Geographical Patterns
- Could an Artificial-Intelligence agent pass an introductory physics course?
- Perception, performance, and detectability of conversational artificial intelligence across 32 university courses
- How do physics students evaluate artificial intelligence responses on comprehension questions? A study on the perceived scientific accuracy and linguistic quality
- The Impact of AI in Physics Education: A Comprehensive Review from GCSE to University Levels
- Performance of ChatGPT on the Test of Understanding Graphs in Kinematics
- Extending Item Response Theory to Online Homework
Cited by in corpus (6)
- Multilingual Performance of a Multimodal Artificial Intelligence System on Multisubject Physics Concept Inventories
- Evaluating GPT- and Reasoning-based Large Language Models on Physics Olympiad Problems: Surpassing Human Performance and Implications for Educational Assessment
- Can ChatGPT pass a physics degree? Making a case for reformation of assessment of undergraduate degrees
- Opportunities and Challenges in Harnessing Digital Technology for Effective Teaching and Learning
- The Boiling-Frog Problem of Physics Education
- Advancing clustering methods in physics education research: A case for mixture models