activity
20242026
most citedCan ChatGPT evaluate research quality?

62 citations · 113 across the 23 of their papers we have counts for

collaborators
Showing 2024 · cs.DLShow all

8 papers · 2 filters

cs.DL2024

Journal Quality Factors from ChatGPT: More meaningful than Impact Factors?

Mike Thelwall, Kayvan Kousha

Purpose: Journal Impact Factors and other citation-based indicators are widely used and abused to help select journals to publish in or to estimate the value of a published article…

cs.DL2024

Research evaluation with ChatGPT: Is it age, country, length, or field biased?

Mike Thelwall, Zeyneb Kurt

Some research now suggests that ChatGPT can estimate the quality of journal articles from their titles and abstracts. This has created the possibility to use ChatGPT quality scores…

cs.DL2024★ 1 cited

Evaluating the Predictive Capacity of ChatGPT for Academic Peer Review Outcomes Across Multiple Platforms

Mike Thelwall, Abdullah Yaghi

While previous studies have demonstrated that Large Language Models (LLMs) can predict peer review outcomes to some extent, this paper builds on that by introducing two new context…

cs.DL2024★ 23 cited

Evaluating the quality of published medical research with ChatGPT

Mike Thelwall, Xiaorui Jiang, Peter A. Bath

Estimating the quality of published research is important for evaluations of departments, researchers, and job candidates. Citation-based indicators sometimes support these tasks,…

cs.DL2024★ 10 cited

In which fields can ChatGPT detect journal article quality? An evaluation of REF2021 results

Mike Thelwall, Abdallah Yaghi

Time spent by academics on research quality assessment might be reduced if automated approaches can help. Whilst citation-based indicators have been extensively developed and evalu…

cs.DL2024★ 1 cited

Evaluating Research Quality with Large Language Models: An Analysis of ChatGPT's Effectiveness with Different Settings and Inputs

Mike Thelwall

Evaluating the quality of academic journal articles is a time consuming but critical task for national research evaluation exercises, appointments and promotion. It is therefore im…