149 citations · 373 across the 46 of their papers we have counts for
53 papers
Neural Architecture Search for Sentence Classification with BERT
Philip Kenneweg, Sarah Schröder, Barbara Hammer
Pre training of language models on large text corpora is common practice in Natural Language Processing. Following, fine tuning of these models is performed to achieve the best res…
Faster Convergence for Transformer Fine-tuning with Line Search Methods
Philip Kenneweg, Leonardo Galli, Tristan Kenneweg +1
Recent works have shown that line search methods greatly increase performance of traditional stochastic gradient descent methods on a variety of datasets and architectures [1], [2]…
Novel transfer learning schemes based on Siamese networks and synthetic data
Dominik Stallmann, Philip Kenneweg, Barbara Hammer
Transfer learning schemes based on deep networks which have been trained on huge image corpora offer state-of-the-art technologies in computer vision. Here, supervised and semi-sup…
BERT WEAVER: Using WEight AVERaging to enable lifelong learning for transformer-based models in biomedical semantic search engines
Lisa Kühnel, Alexander Schulz, Barbara Hammer +1
Recent developments in transfer learning have boosted the advancements in natural language processing tasks. The performance is, however, dependent on high-quality, manually annota…
Evaluating Metrics for Bias in Word Embeddings
Sarah Schröder, Alexander Schulz, Philip Kenneweg +3
Over the last years, word and sentence embeddings have established as text preprocessing for all kinds of NLP tasks and improved the performances significantly. Unfortunately, it h…
Application of Graph Convolutions in a Lightweight Model for Skeletal Human Motion Forecasting
Luca Hermes, Barbara Hammer, Malte Schilling
Prediction of movements is essential for successful cooperation with intelligent systems. We propose a model that integrates organized spatial information as given through the movi…