Showing 2025Show all
3 papers · 1 filter
cs.LG2025
On the Existence and Behavior of Secondary Attention Sinks
Jeffrey T. H. Wong, Cheng Zhang, Louis Mahon +3
Attention sinks are tokens, often the beginning-of-sequence (BOS) token, that receive disproportionately high attention despite limited semantic relevance. In this work, we identif…
cs.SD2025
Robust detection of overlapping bioacoustic sound events
Louis Mahon, Benjamin Hoffman, Logan James +7
We propose a method for accurately detecting bioacoustic sound events that is robust to overlapping events, a common issue in domains such as ethology, ecology and conservation. Wh…
cs.CV2025
Local Compositional Complexity: How to Detect a Human-readable Messsage
Louis Mahon
Data complexity is an important concept in the natural sciences and related areas, but lacks a rigorous and computable definition. In this paper, we focus on a particular sense of…