Talking by the numbers: Networks identify productive forum discussions

Abstract

Discussion forums provide a channel for students to engage with peers and course material outside of class, accessible even to commuter and non-traditional populations. As such, forums can build classroom community as well as aid learning, but students do not always take up these tools. We use network analysis to compare three semesters of forum logs from an introductory calculus-based physics course. The networks show dense structures of collaboration that differ significantly between semesters, even though aggregate participation statistics remain steady. After characterizing network structure for each semester, we correlate centrality with final course grade. Finally, we use a backbone extraction procedure to clean up "noise" in the network and clarify centrality/grade correlations. We find that network centrality is positively linked with course success in the two semesters with denser forum networks, and is a more reliable indicator than non-network measures such as post count. Backbone extraction destroys these correlations, suggesting that the "noise" is in fact signal and further analysis of the discussion transcripts is required.

arXiv comment12 pages, 5 figures, 3 tables; submitted to Phys. Rev. PER

References in corpus (6)

• The structure and function of complex networks
• Characterization of complex networks: A survey of measurements
• Extracting the multiscale backbone of complex weighted networks
• Hide and seek on complex networks
• Investigating Student Communities with Network Analysis of Interactions in a Physics Learning Center
• Educational commitment and social networking: The power of informal networks

Cited by in corpus (9)

• Studying physics during the COVID-19 pandemic: Student assessments of learning achievement, perceived effectiveness of online recitations, and online laboratories
• Exploring the Structure of Misconceptions in the Force Concept Inventory with Modified Module Analysis
• Network positions in active learning environments in physics
• Practitioner's guide to social network analysis: Examining physics anxiety in an active-learning setting
• Understanding interaction network formation across instructional contexts in remote physics courses
• Person-centered and qualitative approaches to network analysis in physics education research
• Long-term collaboration with strong friendship ties improves academic performance in remote and hybrid teaching modalities in high school physics
• What topics of peer interactions correlate with student performance in physics courses?
• Complex networks approach to curriculum analysis and subject integration: a case study on Physics and Mathematics