5 papers
Unifying Linear-Time Attention via Latent Probabilistic Modelling
Rares Dolga, Lucas Maystre, Marius Cobzarenco +1
Transformers have achieved state-of-the-art results across a range of domains, but their quadratic attention mechanism poses significant challenges for long-sequence modelling. Rec…
Incremental Sequence Classification with Temporal Consistency
Lucas Maystre, Gabriel Barello, Tudor Berariu +5
We address the problem of incremental sequence classification, where predictions are updated as new elements in the sequence are revealed. Drawing on temporal-difference learning f…
From Characters to Tokens: Dynamic Grouping with Hierarchical BPE
Rares Dolga, Lucas Maystre, Tudor Berariu +1
Subword tokenization methods like Byte Pair Encoding (BPE) are widely used in large language models due to their balance of vocabulary compactness and representational power. Howev…
When Embedding Models Meet: Procrustes Bounds and Applications
Lucas Maystre, Alvaro Ortega Gonzalez, Charles Park +4
Embedding models trained separately on similar data often produce representations that encode stable information but are not directly interchangeable. This lack of interoperability…
Toward Autonomous UI Exploration: The UIExplorer Benchmark
Andrei Cristian Nica, Akshaya Vishnu Kudlu Shanbhogue, Harshil Shah +4
Autonomous agents must know how to explore user interfaces (UIs) for reliable task solving, yet systematic evaluation of this crucial phase is lacking. We introduce UIExplore-Bench…