53 citations · 173 across the 27 of their papers we have counts for
Showing 2024Show all
2 papers · 1 filter
cs.CL2024★ 3 cited
Intelligent Learning Rate Distribution to reduce Catastrophic Forgetting in Transformers
Philip Kenneweg, Alexander Schulz, Sarah Schröder +1
Pretraining language models on large text corpora is a common practice in natural language processing. Fine-tuning of these models is then performed to achieve the best results on…
cs.CL2024
Debiasing Sentence Embedders through Contrastive Word Pairs
Philip Kenneweg, Sarah Schröder, Alexander Schulz +1
Over the last years, various sentence embedders have been an integral part in the success of current machine learning approaches to Natural Language Processing (NLP). Unfortunately…