50 citations · 66 across the 11 of their papers we have counts for
11 papers
Estimating Text Temperature with Language Models
Nikolay Mikhaylovskiy
Autoregressive language models typically use temperature parameter at inference to shape the probability distribution and control the randomness of the text generated. After the te…
States of LLM-generated Texts and Phase Transitions between them
Nikolay Mikhaylovskiy
It is known for some time that autocorrelations of words in human-written texts decay according to a power law. Recent works have also shown that the autocorrelations decay in text…
Long Text Generation Challenge
Nikolay Mikhaylovskiy
We propose a shared task of human-like long text generation, LTG Challenge, that asks models to output a consistent human-like long text (a Harry Potter generic audience fanfic in…
Autocorrelations Decay in Texts and Applicability Limits of Language Models
Nikolay Mikhaylovskiy, Ilya Churilov
We show that the laws of autocorrelations decay in texts are closely related to applicability limits of language models. Using distributional semantics we empirically demonstrate t…
On Unsupervised Training of Link Grammar Based Language Models
Nikolay Mikhaylovskiy
In this short note we explore what is needed for the unsupervised training of graph language models based on link grammars. First, we introduce the ter-mination tags formalism requ…
Lib-SibGMU -- A University Library Circulation Dataset for Recommender Systems Developmen
Eduard Zubchuk, Mikhail Arhipkin, Dmitry Menshikov +2
We opensource under CC BY 4.0 license Lib-SibGMU - a university library circulation dataset - for a wide research community, and benchmark major algorithms for recommender systems…
Using a Language Model in a Kiosk Recommender System at Fast-Food Restaurants
Eduard Zubchuk, Dmitry Menshikov, Nikolay Mikhaylovskiy
Kiosks are a popular self-service option in many fast-food restaurants, they save time for the visitors and save labor for the fast-food chains. In this paper, we propose an effect…
Low-Resource Spoken Language Identification Using Self-Attentive Pooling and Deep 1D Time-Channel Separable Convolutions
Roman Bedyakin, Nikolay Mikhaylovskiy
This memo describes NTR/TSU winning submission for Low Resource ASR challenge at Dialog2021 conference, language identification track. Spoken Language Identification (LID) is an im…
Language ID Prediction from Speech Using Self-Attentive Pooling and 1D-Convolutions
Roman Bedyakin, Nikolay Mikhaylovskiy
This memo describes NTR-TSU submission for SIGTYP 2021 Shared Task on predicting language IDs from speech. Spoken Language Identification (LID) is an important step in a multilingu…
MediaSpeech: Multilanguage ASR Benchmark and Dataset
Rostislav Kolobov, Olga Okhapkina, Olga Omelchishina +5
The performance of automated speech recognition (ASR) systems is well known to differ for varied application domains. At the same time, vendors and research groups typically report…
Learning Efficient Representations for Keyword Spotting with Triplet Loss
Roman Vygon, Nikolay Mikhaylovskiy
In the past few years, triplet loss-based metric embeddings have become a de-facto standard for several important computer vision problems, most no-tably, person reidentification.…