2 papers
cs.LG2024
Simultaneous Training of First- and Second-Order Optimizers in Population-Based Reinforcement Learning
Felix Pfeiffer, Shahram Eivazi
The tuning of hyperparameters in reinforcement learning (RL) is critical, as these parameters significantly impact an agent's performance and learning efficiency. Dynamic adjustmen…
cs.LG2024
Attention Mechanisms Don't Learn Additive Models: Rethinking Feature Importance for Transformers
Tobias Leemann, Alina Fastowski, Felix Pfeiffer +1
We address the critical challenge of applying feature attribution methods to the transformer architecture, which dominates current applications in natural language processing and b…