4 papers
Prior Knowledge or Search? A Study of LLM Agents in Hardware-Aware Code Optimization
Dmitry Redko, Albert Fazlyev, Konstantin Sozykin +3
LLM discovery and optimization systems are increasingly applied across domains, implementing a common propose-evaluate-revise loop. Such optimization or discovery progresses via co…
Global Optimization of Atomic Clusters via Physically-Constrained Tensor Train Decomposition
Konstantin Sozykin, Nikita Rybin, Andrei Chertkov +5
The global optimization of atomic clusters represents a fundamental challenge in computational chemistry and materials science due to the exponential growth of local minima with sy…
High-dimensional Optimization with Low Rank Tensor Sampling and Local Search
Konstantin Sozykin, Andrei Chertkov, Anh-Huy Phan +2
We present a novel method called TESALOCS (TEnsor SAmpling and LOCal Search) for multidimensional optimization, combining the strengths of gradient-free discrete methods and gradie…
NNTile: a machine learning framework capable of training extremely large GPT language models on a single node
Aleksandr Mikhalev, Aleksandr Katrutsa, Konstantin Sozykin +1
This study presents an NNTile framework for training large deep neural networks in heterogeneous clusters. The NNTile is based on a StarPU library, which implements task-based para…