101 citations · 145 across the 25 of their papers we have counts for
20 papers · 1 filter
Conjecturing: An Overlooked Step in Formal Mathematical Reasoning
Jasivan Alex Sivakumar, Philipp Borchert, Ronald Cardenas +1
Autoformalisation, the task of expressing informal mathematical statements in formal language, is often viewed as a direct translation process. This, however, disregards a critical…
TopoAlign: A Framework for Aligning Code to Math via Topological Decomposition
Yupei Li, Philipp Borchert, Gerasimos Lampouras
Large Language Models (LLMs) excel at both informal and formal (e.g. Lean 4) mathematical reasoning but still struggle with autoformalisation, the task of transforming informal int…
DReSD: Dense Retrieval for Speculative Decoding
Milan Gritta, Huiyin Xue, Gerasimos Lampouras
Speculative decoding (SD) accelerates Large Language Model (LLM) generation by using an efficient draft model to propose the next few tokens, which are verified by the LLM in a sin…
SparsePO: Controlling Preference Alignment of LLMs via Sparse Token Masks
Fenia Christopoulou, Ronald Cardenas, Gerasimos Lampouras +2
Direct alignment algorithms have proven an effective step for aligning language models to human-desired behaviors. Current variants of the Direct Preference Optimization objective…
Mixture of Attentions For Speculative Decoding
Matthieu Zimmer, Milan Gritta, Gerasimos Lampouras +2
The growth in the number of parameters of Large Language Models (LLMs) has led to a significant surge in computational requirements, making them challenging and costly to deploy. S…
Code-Optimise: Self-Generated Preference Data for Correctness and Efficiency
Leonidas Gee, Milan Gritta, Gerasimos Lampouras +1
Code Language Models have been trained to generate accurate solutions, typically with no regard for runtime. On the other hand, previous works that explored execution optimisation…
HumanRankEval: Automatic Evaluation of LMs as Conversational Assistants
Milan Gritta, Gerasimos Lampouras, Ignacio Iacobacci
Language models (LMs) as conversational assistants recently became popular tools that help people accomplish a variety of tasks. These typically result from adapting LMs pretrained…
Encoder-Decoder Framework for Interactive Free Verses with Generation with Controllable High-Quality Rhyming
Tommaso Pasini, Alejo López-Ávila, Husam Quteineh +5
Composing poetry or lyrics involves several creative factors, but a challenging aspect of generation is the adherence to a more or less strict metric and rhyming pattern. To addres…
Text-to-Code Generation with Modality-relative Pre-training
Fenia Christopoulou, Guchun Zhang, Gerasimos Lampouras
Large pre-trained language models have recently been expanded and applied to programming language tasks with great success, often through further pre-training of a strictly-natural…
Findings of the First Workshop on Simulating Conversational Intelligence in Chat
Yvette Graham, Mohammed Rameez Qureshi, Haider Khalid +3
The aim of the workshop was to bring together experts working on open-domain dialogue research. In this speedily advancing research area many challenges still exist, such as learni…
Exploring Data Augmentation for Code Generation Tasks
Pinzhen Chen, Gerasimos Lampouras
Advances in natural language processing, such as transfer learning from pre-trained language models, have impacted how models are trained for programming language tasks too. Previo…
Topic-Aware Response Generation in Task-Oriented Dialogue with Unstructured Knowledge Access
Yue Feng, Gerasimos Lampouras, Ignacio Iacobacci
To alleviate the problem of structured databases' limited coverage, recent task-oriented dialogue systems incorporate external unstructured knowledge to guide the generation of sys…
Training Dynamics for Curriculum Learning: A Study on Monolingual and Cross-lingual NLU
Fenia Christopoulou, Gerasimos Lampouras, Ignacio Iacobacci
Curriculum Learning (CL) is a technique of training models via ranking examples in a typically increasing difficulty trend with the aim of accelerating convergence and improving ge…
Generalising Multilingual Concept-to-Text NLG with Language Agnostic Delexicalisation
Giulio Zhou, Gerasimos Lampouras
Concept-to-text Natural Language Generation is the task of expressing an input meaning representation in natural language. Previous approaches in this task have been able to genera…
Conversation Graph: Data Augmentation, Training and Evaluation for Non-Deterministic Dialogue Management
Milan Gritta, Gerasimos Lampouras, Ignacio Iacobacci
Task-oriented dialogue systems typically rely on large amounts of high-quality training data or require complex handcrafted rules. However, existing datasets are often limited in s…
Show Us the Way: Learning to Manage Dialog from Demonstrations
Gabriel Gordon-Hall, Philip John Gorinski, Gerasimos Lampouras +1
We present our submission to the End-to-End Multi-Domain Dialog Challenge Track of the Eighth Dialog System Technology Challenge. Our proposed dialog system adopts a pipeline archi…
Informed Sampling for Diversity in Concept-to-Text NLG
Giulio Zhou, Gerasimos Lampouras
Deep-learning models for language generation tasks tend to produce repetitive output. Various methods have been proposed to encourage lexical diversity during decoding, but this of…
Generating Texts with Integer Linear Programming
Gerasimos Lampouras, Ion Androutsopoulos
Concept-to-text generation typically employs a pipeline architecture, which often leads to suboptimal texts. Content selection, for example, may greedily select the most important…
Extracting Linguistic Resources from the Web for Concept-to-Text Generation
Gerasimos Lampouras, Ion Androutsopoulos
Many concept-to-text generation systems require domain-specific linguistic resources to produce high quality texts, but manually constructing these resources can be tedious and cos…
Generating Natural Language Descriptions from OWL Ontologies: the NaturalOWL System
Ion Androutsopoulos, Gerasimos Lampouras, Dimitrios Galanis
We present NaturalOWL, a natural language generation system that produces texts describing individuals or classes of OWL ontologies. Unlike simpler OWL verbalizers, which typically…