3 papers
cs.LG2026
A Structural Theory of Position Bias in Transformers
Hanna Herasimchyk, Robin Labryga, Tomislav Prusina +1
Transformer models systematically favor certain token positions, yet the architectural origins of this position bias remain poorly understood. This bias is closely connected to the…
cs.CV2025
Multi-Label Plant Species Prediction with Metadata-Enhanced Multi-Head Vision Transformers
Hanna Herasimchyk, Robin Labryga, Tomislav Prusina
We present a multi-head vision transformer approach for multi-label plant species prediction in vegetation plot images, addressing the PlantCLEF 2025 challenge. The task involves t…
math.OC2025
Information Preserving Line Search via Bayesian Optimization
Robin Labryga, Tomislav Prusina, Sören Laue
Line search is a fundamental part of iterative optimization methods for unconstrained and bound-constrained optimization problems to determine suitable step lengths that provide su…