activity
20242026
most citedCan ChatGPT evaluate research quality?

62 citations · 113 across the 23 of their papers we have counts for

collaborators
Showing 2025Show all

9 papers · 1 filter

cs.DL2025

Can ChatGPT evaluate research environments? Evidence from REF2021

Kayvan Kousha, Mike Thelwall, Elizabeth Gadd

UK academic departments are evaluated partly on the statements that they write about the value of their research environments for the Research Excellence Framework (REF) periodic a…

cs.DL2025★ 2 cited

How is science discussed on Bluesky?

Er-Te Zheng, Xiaorui Jiang, Zhichao Fang +1

Amid the migration of academics from X, the social media platform Bluesky has emerged as a potential alternative. To assess its viability and relevance for science communication, t…

cs.DL2025

Can Smaller Large Language Models Evaluate Research Quality?

Mike Thelwall

Although both Google Gemini (1.5 Flash) and ChatGPT (4o and 4o-mini) give research quality evaluation scores that correlate positively with expert scores in nearly all fields, and…

cs.DL2025

Implicit and Explicit Research Quality Score Probabilities from ChatGPT

Mike Thelwall, Yunhan Yang

The large language model (LLM) ChatGPT's quality scores for journal articles correlate more strongly with human judgements than some citation-based indicators in most fields. Avera…

cs.DL2025

Research quality evaluation by AI in the era of Large Language Models: Advantages, disadvantages, and systemic effects

Mike Thelwall

Artificial Intelligence (AI) technologies like ChatGPT now threaten bibliometrics as the primary generators of research quality indicators. They are already used in at least one re…

cs.DL2025★ 1 cited

In which fields do ChatGPT scores align better than citations with research quality?

Mike Thelwall

Although citation-based indicators are widely used for research evaluation, they are not useful for recently published research, reflect only one of the three common dimensions of…

cs.DL2025★ 1 cited

Can news and social media attention reduce the influence of problematic research?

Er-Te Zheng, Hui-Zhen Fu, Xiaorui Jiang +2

News and social media are widely used to disseminate science, but do they also help raise awareness of problems in research? This study investigates whether high levels of news and…

cs.DL2025★ 8 cited

Is OpenAlex Suitable for Research Quality Evaluation and Which Citation Indicator is Best?

Mike Thelwall, Xiaorui Jiang

This article compares (1) citation analysis with OpenAlex and Scopus, testing their citation counts, document type/coverage and subject classifications and (2) three citation-based…

cs.DL2025

Estimating the quality of academic books from their descriptions with ChatGPT

Mike Thelwall, Andrew Cox

Although indicators based on scholarly citations are widely used to support the evaluation of academic journals, alternatives are needed for scholarly book acquisitions. This artic…