249 citations · 289 across the 15 of their papers we have counts for
5 papers · 1 filter
Multi-modal transformer for signal classification in nanopore blockade experiments
Sandro Kuppel, Julian Hoßbach, Samuel Tovey +1
Nanopore devices have emerged as powerful tools for single-molecule sensing, with potential for rapid, portable diagnostics. They detect changes in ionic current as analytes enter…
Spectral Reach: Understanding Neural Scaling as Progress into the Spectral Tail
Konstantin Nikolaou, Jonas Scheunemann, Sven Krippendorf +2
Neural scaling laws describe predictable power-law relationships between model size, dataset size, compute, and performance. While these laws guide the development of modern founda…
Deep Learning-Driven Peptide Classification in Biological Nanopores
Julian Hoßbach, Samuel Tovey, Sandro Kuppel +3
Nanopore-based single-molecule sensing is a promising route to fast, low-cost disease diagnosis and protein sequencing: as an analyte such as a peptide or protein traverses a nanos…
Beyond Scaling Curves: Internal Dynamics of Neural Networks Through the NTK Lens
Konstantin Nikolaou, Sven Krippendorf, Samuel Tovey +1
Scaling laws offer valuable insights into the relationship between neural network performance and computational cost, yet their underlying mechanisms remain poorly understood. In t…
Collective variables of neural networks: empirical time evolution and scaling laws
Samuel Tovey, Sven Krippendorf, Michael Spannowsky +2
This work presents a novel means for understanding learning dynamics and scaling relations in neural networks. We show that certain measures on the spectrum of the empirical neural…