2 citations · 7 across the 10 of their papers we have counts for
11 papers
The More Popular, The Harder to Forget: Adaptive Popularity for LLM Unlearning
Anna Borisiuk, Andrey Savchenko, Alexander Panchenko +1
Popular facts are memorised more deeply during pretraining and resist removal longer than rare ones, yet existing LLM unlearning methods apply uniform gradient pressure regardless…
Breaking the Chain: A Causal Analysis of LLM Faithfulness to Intermediate Structures
Oleg Somov, Mikhail Chaichuk, Gleb Ershov +4
In schema-guided reasoning (SGR) pipelines, LLMs produce explicit intermediate structures -- rubrics, checklists, or verification queries -- before committing to a final decision.…
Anatomy of Unlearning: The Dual Impact of Fact Salience and Model Fine-Tuning
Anna Borisiuk, Andrey Savchenko, Alexander Panchenko +1
Machine Unlearning (MU) enables Large Language Models (LLMs) to remove unsafe or outdated information. However, existing work assumes that all facts are equally forgettable and lar…
Emergent Misalignment via In-Context Learning: Narrow in-context examples can produce broadly misaligned LLMs
Nikita Afonin, Nikita Andriianov, Vahagn Hovhannisyan +9
Recent work has shown that narrow finetuning can produce broadly misaligned LLMs, a phenomenon termed emergent misalignment (EM). While concerning, these findings were limited to f…
When Punctuation Matters: A Large-Scale Comparison of Prompt Robustness Methods for LLMs
Mikhail Seleznyov, Mikhail Chaichuk, Gleb Ershov +3
Large Language Models (LLMs) are highly sensitive to subtle, non-semantic variations in prompt phrasing and formatting. In this work, we present the first systematic evaluation of…
The benefits of query-based KGQA systems for complex and temporal questions in LLM era
Artem Alekseev, Mikhail Chaichuk, Miron Butko +3
Large language models excel in question-answering (QA) yet still struggle with multi-hop reasoning and temporal questions. Query-based knowledge graph QA (KGQA) offers a modular al…
Geopolitical biases in LLMs: what are the "good" and the "bad" countries according to contemporary language models
Mikhail Salnikov, Dmitrii Korzh, Ivan Lazichny +7
This paper evaluates geopolitical biases in LLMs with respect to various countries though an analysis of their interpretation of historical events with conflicting national perspec…
Konstruktor: A Strong Baseline for Simple Knowledge Graph Question Answering
Maria Lysyuk, Mikhail Salnikov, Pavel Braslavski +1
While being one of the most popular question types, simple questions such as "Who is the author of Cinderella?", are still not completely solved. Surprisingly, even the most powerf…
Answer Candidate Type Selection: Text-to-Text Language Model for Closed Book Question Answering Meets Knowledge Graphs
Mikhail Salnikov, Maria Lysyuk, Pavel Braslavski +3
Pre-trained Text-to-Text Language Models (LMs), such as T5 or BART yield promising results in the Knowledge Graph Question Answering (KGQA) task. However, the capacity of the model…
Kandinsky: an Improved Text-to-Image Synthesis with Image Prior and Latent Diffusion
Anton Razzhigaev, Arseniy Shakhmatov, Anastasia Maltseva +7
Text-to-image generation is a significant domain in modern computer vision and has achieved substantial improvements through the evolution of generative architectures. Among these,…
Large Language Models Meet Knowledge Graphs to Answer Factoid Questions
Mikhail Salnikov, Hai Le, Prateek Rajput +4
Recently, it has been shown that the incorporation of structured knowledge into Large Language Models significantly improves the results for a variety of NLP tasks. In this paper,…