1 citations · 1 across the 3 of their papers we have counts for
4 papers
Kolibri: A Sovereign European Model on the Pareto Frontier
Aleph Alpha, :, Moritz Althaus +65
This report introduces Kolibri, an English-German mixture-of-experts transformer with 78.1B total parameters and 3.46B active parameters per token, released as open weights under t…
The Surprising Effectiveness of Canonical Knowledge Distillation for Semantic Segmentation
Muhammad Ali, Kevin Alexander Laube, Madan Ravi Ganesh +3
Recent knowledge distillation (KD) methods for semantic segmentation introduce increasingly complex hand-crafted objectives, yet are typically evaluated under fixed iteration sched…
Analytical Uncertainty-Based Loss Weighting in Multi-Task Learning
Lukas Kirchdorfer, Cathrin Elich, Simon Kutsche +3
With the rise of neural networks in various domains, multi-task learning (MTL) gained significant relevance. A key challenge in MTL is balancing individual task losses during neura…
Examining Common Paradigms in Multi-Task Learning
Cathrin Elich, Lukas Kirchdorfer, Jan M. Köhler +1
While multi-task learning (MTL) has gained significant attention in recent years, its underlying mechanisms remain poorly understood. Recent methods did not yield consistent perfor…