4 papers
Evaluating 21st-Century Competencies in Postsecondary Curricula with Large Language Models: Performance Benchmarking and Reasoning-Based Prompting Strategies
Zhen Xu, Xin Guan, Chenxi Shi +2
The growing emphasis on 21st-century competencies in postsecondary education, intensified by the transformative impact of generative AI, underscores the need to evaluate how these…
Bringing Pedagogy into Focus: Evaluating Virtual Teaching Assistants' Question-Answering in Asynchronous Learning Environments
Li Siyan, Zhen Xu, Vethavikashini Chithrra Raghuram +3
Asynchronous learning environments (ALEs) are widely adopted for formal and informal learning, but timely and personalized support is often limited. In this context, Virtual Teachi…
From Course to Skill: Evaluating LLM Performance in Curricular Analytics
Zhen Xu, Xinjin Li, Yingqi Huan +2
Curricular analytics (CA) -- systematic analysis of curricula data to inform program and course refinement -- becomes an increasingly valuable tool to help institutions align acade…
Whose ChatGPT? Unveiling Real-World Educational Inequalities Introduced by Large Language Models
Renzhe Yu, Zhen Xu, Sky CH-Wang +1
The universal availability of ChatGPT and other similar tools since late 2022 has prompted tremendous public excitement and experimental effort about the potential of large languag…