9 citations · 11 across the 6 of their papers we have counts for
Showing cs.LGShow all
2 papers · 1 filter
cs.LG2025
NNTile: a machine learning framework capable of training extremely large GPT language models on a single node
Aleksandr Mikhalev, Aleksandr Katrutsa, Konstantin Sozykin +1
This study presents an NNTile framework for training large deep neural networks in heterogeneous clusters. The NNTile is based on a StarPU library, which implements task-based para…
cs.LG2022★ 9 cited
TTOpt: A Maximum Volume Quantized Tensor Train-based Optimization and its Application to Reinforcement Learning
Konstantin Sozykin, Andrei Chertkov, Roman Schutski +3
We present a novel procedure for optimization based on the combination of efficient quantized tensor train representation and a generalized maximum matrix volume principle. We demo…