Showing cs.LGShow all
3 papers · 1 filter
cs.LG2026
Same path, different walk: a mechanistic comparison of looped and stacked transformer encoders on 12-lead ECG
Pawel Olszowiec, Michal Byra, Grzegorz Gruszczynski +2
Recurrent Transformers reusing their weights rather than stacking distinct layers are becoming widely adopted due to their parameter efficiency [1,2,3]. However, the exact repr…
cs.LG2026
Training Crossroads for Recurrent Vision Transformers: Recurrence, Neural ODEs, and Deep Supervision
Grzegorz Gruszczynski, Pawel Olszowiec, Michal Byra +2
Vision Transformers (ViTs) achieve strong image-recognition performance, but their parameter count grows linearly with depth when each block is independently parameterized. Single-…
cs.LG2026
t-gems: text-guided exit modules for decreasing clip image encoder
Alberto Presta, Grzegorz Stefanski, Michal Byra +1
Multimodal deep neural networks enhance deep comprehension by integrating diverse data modalities. Data from different modalities are typically projected into a shared latent space…