200 citations · 366 across the 10 of their papers we have counts for
12 papers
Seed-Free Synthetic Data Generation Framework for Instruction-Tuning LLMs: A Case Study in Thai
Parinthapat Pengpun, Can Udomcharoenchaikit, Weerayut Buaphet +1
We present a synthetic data approach for instruction-tuning large language models (LLMs) for low-resource languages in a data-efficient manner, specifically focusing on Thai. We id…
Human-Timescale Adaptation in an Open-Ended Task Space
Adaptive Agent Team, Jakob Bauer, Kate Baumli +25
Foundation models have shown impressive adaptation and scalability in supervised and self-supervised learning problems, but so far these successes have not fully translated to rein…
An Empirical Study of Implicit Regularization in Deep Offline RL
Caglar Gulcehre, Srivatsan Srinivasan, Jakub Sygnowski +5
Deep neural networks are the most commonly used function approximators in offline reinforcement learning. Prior works have shown that neural nets trained with TD-learning and gradi…
Open-Ended Learning Leads to Generally Capable Agents
Open Ended Learning Team, Adam Stooke, Anuj Mahajan +15
In this work we create agents that can perform well beyond a single, individual task, that exhibit much wider generalisation of behaviour to a massive, rich space of challenges. We…
Regularized Behavior Value Estimation
Caglar Gulcehre, Sergio Gómez Colmenarejo, Ziyu Wang +7
Offline reinforcement learning restricts the learning process to rely only on logged-data without access to an environment. While this enables real-world applications, it also pose…
Sequential Changepoint Detection in Neural Networks with Checkpoints
Michalis K. Titsias, Jakub Sygnowski, Yutian Chen
We introduce a framework for online changepoint detection and simultaneous model learning which is applicable to highly parametrized models, such as deep neural networks. It is bas…
Importance Weighted Policy Learning and Adaptation
Alexandre Galashov, Jakub Sygnowski, Guillaume Desjardins +5
The ability to exploit prior experience to solve novel problems rapidly is a hallmark of biological learning systems and of great practical importance for artificial ones. In the m…
Task Agnostic Continual Learning via Meta Learning
Xu He, Jakub Sygnowski, Alexandre Galashov +3
While neural networks are powerful function approximators, they suffer from catastrophic forgetting when the data distribution is not stationary. One particular formalism that stud…
Meta-Learning with Latent Embedding Optimization
Andrei A. Rusu, Dushyant Rao, Jakub Sygnowski +4
Gradient-based meta-learning techniques are both widely applicable and proficient at solving challenging few-shot learning and fast adaptation problems. However, they have practica…
Meta-Learning by the Baldwin Effect
Chrisantha Thomas Fernando, Jakub Sygnowski, Simon Osindero +6
The scope of the Baldwin effect was recently called into question by two papers that closely examined the seminal work of Hinton and Nowlan. To this date there has been no demonstr…
Theano: A Python framework for fast computation of mathematical expressions
The Theano Development Team, Rami Al-Rfou, Guillaume Alain +110
Theano is a Python library that allows to define, optimize, and evaluate mathematical expressions involving multi-dimensional arrays efficiently. Since its introduction, it has bee…
Learning from the memory of Atari 2600
Jakub Sygnowski, Henryk Michalewski
We train a number of neural networks to play games Bowling, Breakout and Seaquest using information stored in the memory of a video game console Atari 2600. We consider four models…