84 citations · 190 across the 34 of their papers we have counts for
4 papers · 1 filter
The Heap: A Contamination-Free Multilingual Code Dataset for Evaluating Large Language Models
Jonathan Katzy, Razvan Mihai Popescu, Arie van Deursen +1
The recent rise in the popularity of large language models has spurred the development of extensive code datasets needed to train them. This has left limited code available for col…
Investigating the Performance of Language Models for Completing Code in Functional Programming Languages: a Haskell Case Study
Tim van Dam, Frank van der Heijden, Philippe de Bekker +3
Language model-based code completion models have quickly grown in use, helping thousands of developers write code in many different programming languages. However, research on code…
Enriching Source Code with Contextual Data for Code Completion Models: An Empirical Study
Tim van Dam, Maliheh Izadi, Arie van Deursen
Transformer-based pre-trained models have recently achieved great results in solving many software engineering tasks including automatic code completion which is a staple in a deve…
Targeted Attack on GPT-Neo for the SATML Language Model Data Extraction Challenge
Ali Al-Kaswan, Maliheh Izadi, Arie van Deursen
Previous work has shown that Large Language Models are susceptible to so-called data extraction attacks. This allows an attacker to extract a sample that was contained in the train…