21 citations · 43 across the 30 of their papers we have counts for
4 papers · 1 filter
On Divergence Measures for Bayesian Pseudocoresets
Balhae Kim, Jungwon Choi, Seanie Lee +3
A Bayesian pseudocoreset is a small synthetic dataset for which the posterior over parameters approximates that of the original dataset. While promising, the scalability of Bayesia…
Self-Distillation for Further Pre-training of Transformers
Seanie Lee, Minki Kang, Juho Lee +2
Pre-training a large transformer model on a massive amount of unlabeled data and fine-tuning it on labeled datasets for diverse downstream tasks has proven to be a successful strat…
Scalable Set Encoding with Universal Mini-Batch Consistency and Unbiased Full Set Gradient Approximation
Jeffrey Willette, Seanie Lee, Bruno Andreis +3
Recent work on mini-batch consistency (MBC) for set functions has brought attention to the need for sequentially processing and aggregating chunks of a partitioned set while guaran…
Set-based Meta-Interpolation for Few-Task Meta-Learning
Seanie Lee, Bruno Andreis, Kenji Kawaguchi +2
Meta-learning approaches enable machine learning systems to adapt to new tasks given few examples by leveraging knowledge from related tasks. However, a large number of meta-traini…