activity
20212024
most citedIntelligent Learning Rate Distribution to reduce Catastrophic Forgetting in Transformers

3 citations · 7 across the 6 of their papers we have counts for

collaborators
Showing cs.LGShow all

1 paper · 1 filter

cs.LG2024

Targeted Visualization of the Backbone of Encoder LLMs

Isaac Roberts, Alexander Schulz, Luca Hermes +1

Attention based Large Language Models (LLMs) are the state-of-the-art in natural language processing (NLP). The two most common architectures are encoders such as BERT, and decoder…