3 citations · 3 across the 3 of their papers we have counts for
3 papers
VARAN: Variational Inference for Self-Supervised Speech Models Fine-Tuning on Downstream Tasks
Daria Diatlova, Nikita Balagansky, Alexander Varlamov +1
Conventional methods for aggregating layers in fine-tuned self-supervised speech models, such as using the final layer or weighted sum, suffer from information bottlenecks and stat…
TAGC: Optimizing Gradient Communication in Distributed Transformer Training
Igor Polyakov, Alexey Dukhanov, Egor Spirin
The increasing complexity of large language models (LLMs) necessitates efficient training strategies to mitigate the high computational costs associated with distributed training.…
METR: Image Watermarking with Large Number of Unique Messages
Alexander Varlamov, Daria Diatlova, Egor Spirin
Improvements in diffusion models have boosted the quality of image generation, which has led researchers, companies, and creators to focus on improving watermarking algorithms. Thi…