30 citations · 44 across the 12 of their papers we have counts for
4 papers · 1 filter
Enhancing SLM via ChatGPT and Dataset Augmentation
Tom Pieper, Mohamad Ballout, Ulf Krumnack +2
This paper explores the enhancement of small language models through strategic dataset augmentation via ChatGPT-3.5-Turbo, in the domain of Natural Language Inference (NLI). By emp…
Efficient Knowledge Distillation: Empowering Small Language Models with Teacher Model Insights
Mohamad Ballout, Ulf Krumnack, Gunther Heidemann +1
Enhancing small language models for real-life application deployment is a significant challenge facing the research community. Due to the difficulties and costs of using large lang…
Learning Disentangled Audio Representations through Controlled Synthesis
Yusuf Brima, Ulf Krumnack, Simone Pika +1
This paper tackles the scarcity of benchmarking data in disentangled auditory representation learning. We introduce SynTone, a synthetic dataset with explicit ground truth explanat…
Show Me How It's Done: The Role of Explanations in Fine-Tuning Language Models
Mohamad Ballout, Ulf Krumnack, Gunther Heidemann +1
Our research demonstrates the significant benefits of using fine-tuning with explanations to enhance the performance of language models. Unlike prompting, which maintains the model…