4 papers · 1 filter
Training Crossroads for Recurrent Vision Transformers: Recurrence, Neural ODEs, and Deep Supervision
Grzegorz Gruszczynski, Pawel Olszowiec, Michal Byra +2
Vision Transformers (ViTs) achieve strong image-recognition performance, but their parameter count grows linearly with depth when each block is independently parameterized. Single-…
t-gems: text-guided exit modules for decreasing clip image encoder
Alberto Presta, Grzegorz Stefanski, Michal Byra +1
Multimodal deep neural networks enhance deep comprehension by integrating diverse data modalities. Data from different modalities are typically projected into a shared latent space…
SOI: Scaling Down Computational Complexity by Estimating Partial States of the Model
Grzegorz Stefański, Paweł Daniluk, Artur Szumaczuk +1
Consumer electronics used to follow the miniaturization trend described by Moore's Law. Despite increased processing power in Microcontroller Units (MCUs), MCUs used in the smalles…
Short-Term Memory Convolutions
Grzegorz Stefański, Krzysztof Arendt, Paweł Daniluk +2
The real-time processing of time series signals is a critical issue for many real-life applications. The idea of real-time processing is especially important in audio domain as the…