Showing stat.MLShow all
2 papers · 1 filter
stat.ML2024
Proper losses regret at least 1/2-order
Han Bao, Asuka Takatsu
A fundamental challenge in machine learning is the choice of a loss as it characterizes our learning task, is minimized in the training phase, and serves as an evaluation criterion…
stat.ML2024
Self-attention Networks Localize When QK-eigenspectrum Concentrates
Han Bao, Ryuichiro Hataya, Ryo Karakida
The self-attention mechanism prevails in modern machine learning. It has an interesting functionality of adaptively selecting tokens from an input sequence by modulating the degree…