73 citations · 106 across the 11 of their papers we have counts for
13 papers
A mean teacher algorithm for unlearning of language models
Yegor Klochkov
One of the goals of language model unlearning is to reduce memorization of selected text instances while retaining the model's general abilities. Despite various proposed methods,…
Revisiting inverse Hessian vector products for calculating influence functions
Yegor Klochkov, Yang Liu
Influence functions are a popular tool for attributing a model's output to training data. The traditional approach relies on the calculation of inverse Hessian-vector products (iHV…
Deep Concept Removal
Yegor Klochkov, Jean-Francois Ton, Ruocheng Guo +2
We address the problem of concept removal in deep neural networks, aiming to learn representations that do not encode certain specified concepts (e.g., gender etc.) We propose a no…
Post-hoc Bias Scoring Is Optimal For Fair Classification
Wenlong Chen, Yegor Klochkov, Yang Liu
We consider a binary classification problem under group fairness constraints, which can be one of Demographic Parity (DP), Equalized Opportunity (EOp), or Equalized Odds (EO). We p…
Trustworthy LLMs: a Survey and Guideline for Evaluating Large Language Models' Alignment
Yang Liu, Yuanshun Yao, Jean-Francois Ton +6
Ensuring alignment, which refers to making models behave in accordance with human intentions [1,2], has become a critical task before deploying large language models (LLMs) in real…
Robustifying Markowitz
Wolfgang Karl Härdle, Yegor Klochkov, Alla Petukhina +1
Markowitz mean-variance portfolios with sample mean and covariance as input parameters feature numerous issues in practice. They perform poorly out of sample due to estimation erro…
Spin glass to paramagnetic transition and triple point in Spherical SK model
Iain M. Johnstone, Yegor Klochkov, Alexei Onatski +1
This paper studies spin glass to paramagnetic transition in the Spherical Sherrington-Kirkpatrick model with ferromagnetic Curie-Weiss interaction with coupling constant and in…
Stability and Deviation Optimal Risk Bounds with Convergence Rate
Yegor Klochkov, Nikita Zhivotovskiy
The sharpest known high probability generalization bounds for uniformly stable algorithms (Feldman, Vondrák, 2018, 2019), (Bousquet, Klochkov, Zhivotovskiy, 2020) contain a general…
SONIC: SOcial Network with Influencers and Communities
Cathy Yi-Hsuan Chen, Wolfgang Karl Härdle, Yegor Klochkov
The integration of social media characteristics into an econometric framework requires modeling a high dimensional dynamic network with dimensions of parameter typically much large…
An edge CLT for the log determinant of Wigner ensembles
Iain M. Johnstone, Yegor Klochkov, Alexei Onatski +1
We derive a Central Limit Theorem (CLT) for where is a Wigner matrix, and is local to the edge of the se…
Robust -means Clustering for Distributions with Two Moments
Yegor Klochkov, Alexey Kroshnin, Nikita Zhivotovskiy
We consider the robust algorithms for the -means clustering problem where a quantizer is constructed based on independent observations. Our main results are median of means…
Sharper bounds for uniformly stable algorithms
Olivier Bousquet, Yegor Klochkov, Nikita Zhivotovskiy
Deriving generalization bounds for stable algorithms is a classical question in learning theory taking its roots in the early works by Vapnik and Chervonenkis (1974) and Rogers and…
Uniform Hanson-Wright type concentration inequalities for unbounded entries via the entropy method
Yegor Klochkov, Nikita Zhivotovskiy
This paper is devoted to uniform versions of the Hanson-Wright inequality for a random vector with independent subgaussian components. The core technique of th…