208 citations · 504 across the 30 of their papers we have counts for
4 papers · 1 filter
Continual Learning with Low Rank Adaptation
Martin Wistuba, Prabhu Teja Sivaprasad, Lukas Balles +1
Recent work using pretrained transformers has shown impressive performance when fine-tuned with data from the downstream problem of interest. However, they struggle to retain that…
Renate: A Library for Real-World Continual Learning
Martin Wistuba, Martin Ferianc, Lukas Balles +2
Continual learning enables the incremental training of machine learning models on non-stationary data streams.While academic interest in the topic is high, there is little indicati…
Variational Boosted Soft Trees
Tristan Cinquin, Tammo Rukat, Philipp Schmidt +2
Gradient boosting machines (GBMs) based on decision trees consistently demonstrate state-of-the-art results on regression and classification tasks with tabular data, often outperfo…
Scaling Laws for Hyperparameter Optimization
Arlind Kadra, Maciej Janowski, Martin Wistuba +1
Hyperparameter optimization is an important subfield of machine learning that focuses on tuning the hyperparameters of a chosen algorithm to achieve peak performance. Recently, the…