12 citations · 12 across the 2 of their papers we have counts for
2 papers
cs.DC2024
Data movement limits to frontier model training
Ege Erdil, David Schneider-Joseph
We present a theoretical model of distributed training, and use it to analyze how far dense and sparse training runs can be scaled. Under our baseline assumptions, given a three mo…
cs.LG2023★ 12 cited
LEACE: Perfect linear concept erasure in closed form
Nora Belrose, David Schneider-Joseph, Shauli Ravfogel +3
Concept erasure aims to remove specified features from an embedding. It can improve fairness (e.g. preventing a classifier from using gender or race) and interpretability (e.g. rem…