activity
20232026
most citedTaylorShift: Shifting the Complexity of Self-Attention from Squared to Linear (and Back) using Taylor-Softmax

10 citations · 10 across the 16 of their papers we have counts for

collaborators
Showing 2026Show all

8 papers · 1 filter

cs.AI2026

The Self-Improvement Problem

Brian B. Moser, Stanislav Frolov, Tobias C. Nauen +2

With the rise of large language models, agentic systems are becoming increasingly autonomous, as they write code, call tools, revise prompts, and propose modifications to their own…

cs.LG2026

Layers Matter: Why Continual Learning Regularization Should Be Layer-Adaptive

Brian B. Moser, Ahmed Anwar, Tobias Christian Nauen +5

Continual learning regularizers like EWC fight forgetting by penalizing changes from previous-task parameters with per-parameter importance, typically diagonal Fisher values. Per-p…

cs.CV2026

LUMA: Benchmarking Segmentation via a Lightweight Universal Mask Adapter

Tobias Christian Nauen, Anosh Billimoria, Federico Raue +3

Comparing transformer backbones for image segmentation is confounded: each is paired with a different decoder, recipe, and pretraining, so reported differences rarely reflect the b…

cs.LG2026

The Gentle Collapse: Distributional Metrics for Continual Learning

Ahmed Anwar, Andreas Wagner, Federico Raue +2

Accuracy degradation is the standard metric for Catastrophic Forgetting (CF), however, it records only whether forgetting occurred or not. It saturates at the extremes and collapse…

cs.CV2026

OA-CutMix: Correcting the Label Bias of CutMix

Tobias Christian Nauen, Stanislav Frolov, Federico Raue +2

CutMix has become the de facto standard mixing augmentation, yet its label assignment rests on a flawed assumption: The area of the pasted patch faithfully reflects its semantic co…

cs.CV2026

TextTeacher: What Can Language Teach About Images?

Tobias Christian Nauen, Stanislav Frolov, Brian Bernhard Moser +3

The platonic representation hypothesis suggests that sufficiently large models converge to a shared representation geometry, even across modalities. Motivated by this, we ask: Can…

cs.LG2026

Hyperspherical Forward-Forward with Prototypical Representations

Shalini Sarode, Brian Moser, Joachim Folz +4

The Forward-Forward (FF) algorithm presents a compelling, bio-inspired alternative to backpropagation. However, while efficient in training, it has a computationally prohibitive in…

cs.CV2026

When Pretty Isn't Useful: Investigating Why Modern Text-to-Image Models Fail as Reliable Training Data Generators

Krzysztof Adamkiewicz, Brian Bernhard Moser, Stanislav Frolov +3

Recent text-to-image (T2I) diffusion models produce visually stunning images and demonstrate excellent prompt following. But do they perform well as synthetic vision data generator…