3 citations · 5 across the 3 of their papers we have counts for
3 papers
Diffract: Spectral View of LLM Domain Adaptation
Nikita Borodin, Maria Krylova, Artem Zabolotnyi +6
We study continual pre-training (CPT) as a mechanism for adapting general-purpose large language models to specialized domains: mathematics, instruction, code, and natural text. Us…
A Language and Its Dimensions: Intrinsic Dimensions of Language Fractal Structures
Vasilii A. Gromov, Nikita S. Borodin, Asel S. Yerbolova
The present paper introduces a novel object of study - a language fractal structure. We hypothesize that a set of embeddings of all -grams of a natural language constitutes a re…
Formal concept analysis for evaluating intrinsic dimension of a natural language
Sergei O. Kuznetsov, Vasilii A. Gromov, Nikita S. Borodin +1
Some results of a computational experiment for determining the intrinsic dimension of linguistic varieties for the Bengali and Russian languages are presented. At the same time, bo…