2 citations · 2 across the 10 of their papers we have counts for
10 papers
One Symptom, Three Levers: A Critical Review of On-Policy Self-Distillation
Justin Robert, Raheel Qader
On-policy distillation trains a language model on its own generations while a teacher scores them token by token. It combines the dense supervision of imitation learning with the o…
The LLM Pro Finance Suite: Multilingual Large Language Models for Financial Applications
Gaëtan Caillaut, Raheel Qader, Jingshu Liu +4
The financial industry's growing demand for advanced natural language processing (NLP) capabilities has highlighted the limitations of generalist large language models (LLMs) in ha…
Lingua Custodi's participation at the WMT 2025 Terminology shared task
Jingshu Liu, Raheel Qader, Gaëtan Caillaut +1
While BERT is an effective method for learning monolingual sentence embeddings for semantic similarity and embedding based transfer learning BERT based cross-lingual sentence embed…
DOLFIN -- Document-Level Financial test set for Machine Translation
Mariam Nakhlé, Marco Dinarelli, Raheel Qader +2
Despite the strong research interest in document-level Machine Translation (MT), the test sets dedicated to this task are still scarce. The existing test sets mainly cover topics f…
Scaling Laws of Decoder-Only Models on the Multilingual Machine Translation Task
Gaëtan Caillaut, Raheel Qader, Mariam Nakhlé +2
Recent studies have showcased remarkable capabilities of decoder-only models in many NLP tasks, including translation. Yet, the machine translation field has been largely dominated…
Large Language Model Adaptation for Financial Sentiment Analysis
Pau Rodriguez Inserte, Mariam Nakhlé, Raheel Qader +2
Natural language processing (NLP) has recently gained relevance within financial institutions by providing highly valuable insights into companies and markets' financial documents.…
Lingua Custodia's participation at the WMT 2021 Machine Translation using Terminologies shared task
Melissa Ailem, Jinghsu Liu, Raheel Qader
This paper describes Lingua Custodia's submission to the WMT21 shared task on machine translation using terminologies. We consider three directions, namely English to French, Russi…
Neural Medication Extraction: A Comparison of Recent Models in Supervised and Semi-supervised Learning Settings
Ali Can Kocabiyikoglu, François Portet, Raheel Qader +1
Drug prescriptions are essential information that must be encoded in electronic medical records. However, much of this information is hidden within free-text reports. This is why t…
Encouraging Neural Machine Translation to Satisfy Terminology Constraints
Melissa Ailem, Jinghsu Liu, Raheel Qader
We present a new approach to encourage neural machine translation to satisfy lexical constraints. Our method acts at the training step and thereby avoiding the introduction of any…
Semi-Supervised Neural Text Generation by Joint Learning of Natural Language Generation and Natural Language Understanding Models
Raheel Qader, François Portet, Cyril Labbé
In Natural Language Generation (NLG), End-to-End (E2E) systems trained through deep learning have recently gained a strong interest. Such deep models need a large amount of careful…