65 citations · 72 across the 7 of their papers we have counts for
9 papers · 1 filter
The Nuts and Bolts of Natural Language to SQL Translation: A Systematic Analysis of Model Pipeline Optimisation Approaches and their Interactions
Filip Klubicka, Vasudevan Nedumpozhimana, Sneha Rautmare +3
In the age of large language models, Natural Language to SQL (NL2SQL) translation remains an open problem with many useful applications. We explore interactions between several NL2…
Missing Information, Unresponsive Authors, Experimental Flaws: The Impossibility of Assessing the Reproducibility of Previous Human Evaluations in NLP
Anya Belz, Craig Thomson, Ehud Reiter +39
We report our efforts in identifying a set of previous human evaluations in NLP that would be suitable for a coordinated study examining what makes human evaluations in NLP more/le…
Idioms, Probing and Dangerous Things: Towards Structural Probing for Idiomaticity in Vector Space
Filip Klubička, Vasudevan Nedumpozhimana, John D. Kelleher
The goal of this paper is to learn more about how idiomatic information is structurally encoded in embeddings, using a structural probing method. We repurpose an existing English v…
Probing Taxonomic and Thematic Embeddings for Taxonomic Information
Filip Klubička, John D. Kelleher
Modelling taxonomic and thematic relatedness is important for building AI with comprehensive natural language understanding. The goal of this paper is to learn more about how taxon…
Probing with Noise: Unpicking the Warp and Weft of Embeddings
Filip Klubička, John D. Kelleher
Improving our understanding of how information is encoded in vector space can yield valuable interpretability insights. Alongside vector dimensions, we argue that it is possible fo…
Semantic Relatedness and Taxonomic Word Embeddings
Magdalena Kacmajor, John D. Kelleher, Filip Klubicka +1
This paper connects a series of papers dealing with taxonomic word embeddings. It begins by noting that there are different types of semantic relatedness and that different lexical…