4 papers
TrAction: Action Recognition with Sparse Trajectories
Jan F. Meier, Felix B. Mueller, Alexander Ecker +1
Modern action recognition models operate on memory- and compute-intensive dense RGB video volumes and frequently exploit appearance and background shortcuts, for example, predictin…
Zero-Shot Multi-Animal Tracking in the Wild
Jan Frederik Meier, Timo Lüddecke
Multi-animal tracking is crucial for understanding animal ecology and behavior, yet remains challenging due to variations in habitat, motion patterns, and species appearance. Tradi…
Do traveling waves make good positional encodings?
Chase van de Geijn, Ayush Paliwal, Timo Lüddecke +1
Transformers rely on positional encoding to compensate for the inherent permutation invariance of self-attention. Traditional approaches use absolute sinusoidal embeddings or learn…
A Circular Argument : Does RoPE need to be Equivariant for Vision?
Chase van de Geijn, Timo Lüddecke, Polina Turishcheva +1
Rotary Positional Encodings (RoPE) have emerged as a highly effective technique for one-dimensional sequences in Natural Language Processing spurring recent progress towards genera…