2 papers
cs.LG2025
Attention Mechanisms Don't Learn Additive Models: Rethinking Feature Importance for Transformers
Tobias Leemann, Alina Fastowski, Felix Pfeiffer +1
We address the critical challenge of applying feature attribution methods to the transformer architecture, which dominates current applications in natural language processing and b…
cs.LG2024
Simultaneous Training of First- and Second-Order Optimizers in Population-Based Reinforcement Learning
Felix Pfeiffer, Shahram Eivazi
The tuning of hyperparameters in reinforcement learning (RL) is critical, as these parameters significantly impact an agent's performance and learning efficiency. Dynamic adjustmen…