73 citations · 106 across the 11 of their papers we have counts for
5 papers · 1 filter
A mean teacher algorithm for unlearning of language models
Yegor Klochkov
One of the goals of language model unlearning is to reduce memorization of selected text instances while retaining the model's general abilities. Despite various proposed methods,…
Revisiting inverse Hessian vector products for calculating influence functions
Yegor Klochkov, Yang Liu
Influence functions are a popular tool for attributing a model's output to training data. The traditional approach relies on the calculation of inverse Hessian-vector products (iHV…
Deep Concept Removal
Yegor Klochkov, Jean-Francois Ton, Ruocheng Guo +2
We address the problem of concept removal in deep neural networks, aiming to learn representations that do not encode certain specified concepts (e.g., gender etc.) We propose a no…
Stability and Deviation Optimal Risk Bounds with Convergence Rate
Yegor Klochkov, Nikita Zhivotovskiy
The sharpest known high probability generalization bounds for uniformly stable algorithms (Feldman, Vondrák, 2018, 2019), (Bousquet, Klochkov, Zhivotovskiy, 2020) contain a general…
Sharper bounds for uniformly stable algorithms
Olivier Bousquet, Yegor Klochkov, Nikita Zhivotovskiy
Deriving generalization bounds for stable algorithms is a classical question in learning theory taking its roots in the early works by Vapnik and Chervonenkis (1974) and Rogers and…