9 citations · 22 across the 14 of their papers we have counts for
3 papers · 1 filter
Faster Language Models with Better Multi-Token Prediction Using Tensor Decomposition
Artem Basharin, Andrei Chertkov, Ivan Oseledets
We propose a new model for multi-token prediction in transformers, aiming to enhance sampling efficiency without compromising accuracy. Motivated by recent work that predicts the p…
Black-Box Approximation and Optimization with Hierarchical Tucker Decomposition
Gleb Ryzhakov, Andrei Chertkov, Artem Basharin +1
We develop a new method HTBB for the multidimensional black-box approximation and gradient-free optimization, which is based on the low-rank hierarchical Tucker decomposition with…
Fast gradient-free activation maximization for neurons in spiking neural networks
Nikita Pospelov, Andrei Chertkov, Maxim Beketov +2
Elements of neural networks, both biological and artificial, can be described by their selectivity for specific cognitive features. Understanding these features is important for un…