3 citations · 8 across the 15 of their papers we have counts for
3 papers · 1 filter
Considering Context: When World Models Need Context Encoders
Oleg Smirnov, Sofiane Ennadir, John Pertoft +2
Methods for generalization in model-based reinforcement learning typically assume that an agent cannot recover the latent context governing the environment dynamics from its own ex…
Stochasticity in Tokenisation Improves Robustness
Sophie Steger, Rui Li, Sofiane Ennadir +4
The widespread adoption of large language models (LLMs) has increased concerns about their robustness. Vulnerabilities in perturbations of tokenisation of the input indicate that m…
Be Wary of Your Time Series Preprocessing
Sofiane Ennadir, Tianze Wang, Oleg Smirnov +2
Normalization and scaling are fundamental preprocessing steps in time series modeling, yet their role in Transformer-based models remains underexplored from a theoretical perspecti…