50 citations · 66 across the 11 of their papers we have counts for
5 papers · 1 filter
Estimating Text Temperature with Language Models
Nikolay Mikhaylovskiy
Autoregressive language models typically use temperature parameter at inference to shape the probability distribution and control the randomness of the text generated. After the te…
States of LLM-generated Texts and Phase Transitions between them
Nikolay Mikhaylovskiy
It is known for some time that autocorrelations of words in human-written texts decay according to a power law. Recent works have also shown that the autocorrelations decay in text…
Long Text Generation Challenge
Nikolay Mikhaylovskiy
We propose a shared task of human-like long text generation, LTG Challenge, that asks models to output a consistent human-like long text (a Harry Potter generic audience fanfic in…
Autocorrelations Decay in Texts and Applicability Limits of Language Models
Nikolay Mikhaylovskiy, Ilya Churilov
We show that the laws of autocorrelations decay in texts are closely related to applicability limits of language models. Using distributional semantics we empirically demonstrate t…
On Unsupervised Training of Link Grammar Based Language Models
Nikolay Mikhaylovskiy
In this short note we explore what is needed for the unsupervised training of graph language models based on link grammars. First, we introduce the ter-mination tags formalism requ…