1 citations · 1 across the 2 of their papers we have counts for
3 papers
EigDiff: Eigensample Diffusion - or how to significantly reduce training dataset size with marginal performance variation?
Andrei Jarca, Vlad Hondru, Florinel-Alin Croitoru +1
Diffusion models are notoriously expensive to train, requiring large-scale datasets to learn how to gradually reverse the noise from images over multiple small denoising steps. Cur…
Task-Informed Anti-Curriculum by Masking Improves Downstream Performance on Text
Andrei Jarca, Florinel Alin Croitoru, Radu Tudor Ionescu
Masked language modeling has become a widely adopted unsupervised technique to pre-train large language models (LLMs). However, the process of selecting tokens for masking is rando…
CBM: Curriculum by Masking
Andrei Jarca, Florinel-Alin Croitoru, Radu Tudor Ionescu
We propose Curriculum by Masking (CBM), a novel state-of-the-art curriculum learning strategy that effectively creates an easy-to-hard training schedule via patch (token) masking,…