9 citations · 11 across the 6 of their papers we have counts for
7 papers
Prior Knowledge or Search? A Study of LLM Agents in Hardware-Aware Code Optimization
Dmitry Redko, Albert Fazlyev, Konstantin Sozykin +3
LLM discovery and optimization systems are increasingly applied across domains, implementing a common propose-evaluate-revise loop. Such optimization or discovery progresses via co…
Global Optimization of Atomic Clusters via Physically-Constrained Tensor Train Decomposition
Konstantin Sozykin, Nikita Rybin, Andrei Chertkov +5
The global optimization of atomic clusters represents a fundamental challenge in computational chemistry and materials science due to the exponential growth of local minima with sy…
High-dimensional Optimization with Low Rank Tensor Sampling and Local Search
Konstantin Sozykin, Andrei Chertkov, Anh-Huy Phan +2
We present a novel method called TESALOCS (TEnsor SAmpling and LOCal Search) for multidimensional optimization, combining the strengths of gradient-free discrete methods and gradie…
NNTile: a machine learning framework capable of training extremely large GPT language models on a single node
Aleksandr Mikhalev, Aleksandr Katrutsa, Konstantin Sozykin +1
This study presents an NNTile framework for training large deep neural networks in heterogeneous clusters. The NNTile is based on a StarPU library, which implements task-based para…
TTOpt: A Maximum Volume Quantized Tensor Train-based Optimization and its Application to Reinforcement Learning
Konstantin Sozykin, Andrei Chertkov, Roman Schutski +3
We present a novel procedure for optimization based on the combination of efficient quantized tensor train representation and a generalized maximum matrix volume principle. We demo…
Stable Low-rank Tensor Decomposition for Compression of Convolutional Neural Network
Anh-Huy Phan, Konstantin Sobolev, Konstantin Sozykin +6
Most state of the art deep neural networks are overparameterized and exhibit a high computational cost. A straightforward approach to this problem is to replace convolutional kerne…
Multi-label Class-imbalanced Action Recognition in Hockey Videos via 3D Convolutional Neural Networks
Konstantin Sozykin, Stanislav Protasov, Adil Khan +2
Automatic analysis of the video is one of most complex problems in the fields of computer vision and machine learning. A significant part of this research deals with (human) activi…