2 papers
cs.CL2024
Rethinking Associative Memory Mechanism in Induction Head
Shuo Wang, Issei Sato
Induction head mechanism is a part of the computational circuits for in-context learning (ICL) that enable large language models (LLMs) to adapt to new tasks without fine-tuning. M…
cs.CV2023
Understanding Parameter Saliency via Extreme Value Theory
Shuo Wang, Issei Sato
Deep neural networks are being increasingly implemented throughout society in recent years. It is useful to identify which parameters trigger misclassification in diagnosing undesi…