200 citations · 322 across the 7 of their papers we have counts for
8 papers
Same Beliefs, Different Policies: Learning Reusable Representations for Early Stopping in LLM Reasoning
Jingwei Ni, Dmitry Abulkhanov, Vladislav Smirnov +5
Reasoning LLMs often continue reasoning after reaching a correct answer, wasting computation and sometimes replacing it with an incorrect one. Deciding when to stop is a metareason…
IDLM: Inverse-distilled Diffusion Language Models
David Li, Nikita Gushchin, Dmitry Abulkhanov +4
Diffusion Language Models (DLMs) have recently achieved strong results in text generation. However, their multi-step sampling leads to slow inference, limiting practical use. To ad…
StarCoder 2 and The Stack v2: The Next Generation
Anton Lozhkov, Raymond Li, Loubna Ben Allal +63
The BigCode project, an open-scientific collaboration focused on the responsible development of Large Language Models for Code (Code LLMs), introduces StarCoder2. In partnership wi…
AI-generated text boundary detection with RoFT
Laida Kushnareva, Tatiana Gaintseva, German Magai +6
Due to the rapid development of large language models, people increasingly often encounter texts that may start as written by a human but continue as machine-generated. Detecting t…
CCT-Code: Cross-Consistency Training for Multilingual Clone Detection and Code Search
Anton Tikhonov, Nikita Sorokin, Dmitry Abulkhanov +3
We consider the well-known and important tasks of clone detection and information retrieval for source code. The most standard setup is to search clones inside the same language co…
Searching by Code: a New SearchBySnippet Dataset and SnippeR Retrieval Model for Searching by Code Snippets
Ivan Sedykh, Dmitry Abulkhanov, Nikita Sorokin +2
Code search is an important and well-studied task, but it usually means searching for code by a text query. We argue that using a code snippet (and possibly an error traceback) as…
StarCoder: may the source be with you!
Raymond Li, Loubna Ben Allal, Yangtian Zi +64
The BigCode community, an open-scientific collaboration working on the responsible development of Large Language Models for Code (Code LLMs), introduces StarCoder and StarCoderBase…
SantaCoder: don't reach for the stars!
Loubna Ben Allal, Raymond Li, Denis Kocetkov +38
The BigCode project is an open-scientific collaboration working on the responsible development of large language models for code. This tech report describes the progress of the col…