6 papers
One in Eight OpenAlex Abstracts Has Integrity Issues
Seorin Kim, Vincent Holst, Vincent Ginis
Scientific abstracts are increasingly used as primary data in computational metascience research, yet the quality of these abstracts in widely used bibliographic databases has not…
Human-in-the-Loop LLM Grading for Handwritten Mathematics Assessments
Arne Vanhoyweghen, Vincent Holst, Melika Mobini +9
Providing timely and individualised feedback on handwritten student work is highly beneficial for learning but difficult to achieve at scale. This challenge has become more pressin…
Structurally Human, Semantically Biased: Detecting LLM-Generated References with Embeddings and GNNs
Melika Mobini, Vincent Holst, Floriano Tori +2
Large language models are increasingly used to curate bibliographies, raising the question: are their reference lists distinguishable from human ones? We build paired citation grap…
Turning Citation Networks Inside Out: Studying Science Using Content-Based Knowledge Graphs from LLM-Derived Taxonomies
Seorin Kim, Vincent Holst, Vincent Ginis
Scientific fields are often mapped using citations and metadata, despite knowledge being transmitted primarily through content. We introduce an 'inside-out' approach that reconstru…
How Deep Do Large Language Models Internalize Scientific Literature and Citation Practices?
Andres Algaba, Vincent Holst, Floriano Tori +4
The spread of scientific knowledge depends on how researchers discover and cite previous work. The adoption of large language models (LLMs) in the scientific research process intro…
The Effectiveness of Curvature-Based Rewiring and the Role of Hyperparameters in GNNs Revisited
Floriano Tori, Vincent Holst, Vincent Ginis
Message passing is the dominant paradigm in Graph Neural Networks (GNNs). The efficiency of message passing, however, can be limited by the topology of the graph. This happens when…