Higher education assessment practice in the era of generative AI tools
arXiv:2404.01036 · doi:10.37074/jalt.2024.7.1.28
Abstract
The higher education (HE) sector benefits every nation's economy and society at large. However, their contributions are challenged by advanced technologies like generative artificial intelligence (GenAI) tools. In this paper, we provide a comprehensive assessment of GenAI tools towards assessment and pedagogic practice and, subsequently, discuss the potential impacts. This study experimented using three assessment instruments from data science, data analytics, and construction management disciplines. Our findings are two-fold: first, the findings revealed that GenAI tools exhibit subject knowledge, problem-solving, analytical, critical thinking, and presentation skills and thus can limit learning when used unethically. Secondly, the design of the assessment of certain disciplines revealed the limitations of the GenAI tools. Based on our findings, we made recommendations on how AI tools can be utilised for teaching and learning in HE.
11 pages, 7 tables published in the Journal of Applied Learning & Teaching
References in corpus (12)
- LLaMA: Open and Efficient Foundation Language Models
- PaLM: Scaling Language Modeling with Pathways
- Evaluating Large Language Models Trained on Code
- LaMDA: Language Models for Dialog Applications
- Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models
- Do As I Can, Not As I Say: Grounding Language in Robotic Affordances
- Can AI-Generated Text be Reliably Detected?
- UL2: Unifying Language Learning Paradigms
- Comparison of Topic Modelling Approaches in the Banking Context
- The Science of Detecting LLM-Generated Texts
- The Use of a Large Language Model for Cyberbullying Detection
- ChatGPT in the Age of Generative AI and Large Language Models: A Concise Survey