2 papers
cs.CV2026
Design and Behavior of Sparse Mixture-of-Experts Layers in CNN-based Semantic Segmentation
Svetlana Pavlitska, Haixi Fan, Konstantin Ditschuneit +1
Sparse mixture-of-experts (MoE) layers have been shown to substantially increase model capacity without a proportional increase in computational cost and are widely used in transfo…
cs.LG2023
Self-Distilled Representation Learning for Time Series
Felix Pieper, Konstantin Ditschuneit, Martin Genzel +2
Self-supervised learning for time-series data holds potential similar to that recently unleashed in Natural Language Processing and Computer Vision. While most existing works in th…