329 citations
- Télécom SudParisFR48 papers
- Institut Polytechnique de ParisFR37 papers
- Centre National de la Recherche ScientifiqueFR36 papers
- Institut Mines-TélécomFR11 papers
- Laboratoire d'Ingénierie Circulation TransportsFR7 papers
- Laboratoire Traitement et Communication de l’InformationFR6 papers
- Université Paris-SaclayFR6 papers
- Concordia UniversityCA5 papers
- Centre de Mathématiques Appliquées de l'École polytechniqueFR3 papers
- Cisco Systems (United States)US3 papers
- École PolytechniqueFR3 papers
- Laboratoire de Mathématiques d'OrsayFR3 papers
4 papers · 1 filter
The late-stage training dynamics of (stochastic) subgradient descent on homogeneous neural networks
Sholom Schechtman, Nicolas Schreuder
We analyze the implicit bias of constant step stochastic subgradient descent (SGD). We consider the setting of binary classification with homogeneous neural networks - a large clas…
Laplace Transform Based Low-Complexity Learning of Continuous Markov Semigroups
Vladimir R. Kostic, Karim Lounici, Hélène Halconruy +3
Markov processes serve as a universal model for many real-world random processes. This paper presents a data-driven approach for learning these models through the spectral decompos…
Label-GCN: An Effective Method for Adding Label Propagation to Graph Convolutional Networks
Claudio Bellei, Hussain Alattas, Nesrine Kaaniche
We show that a modification of the first layer of a Graph Convolutional Network (GCN) can be used to effectively propagate label information across neighbor nodes, for binary and m…
The Monte Carlo Transformer: a stochastic self-attention model for sequence prediction
Alice Martin, Charles Ollion, Florian Strub +2
This paper introduces the Sequential Monte Carlo Transformer, an original approach that naturally captures the observations distribution in a transformer architecture. The keys, qu…