2 papers
cs.CL2024
Dual Process Learning: Controlling Use of In-Context vs. In-Weights Strategies with Weight Forgetting
Suraj Anand, Michael A. Lepori, Jack Merullo +1
Language models have the ability to perform in-context learning (ICL), allowing them to flexibly adapt their behavior based on context. This contrasts with in-weights learning (IWL…
cs.CL2024
Are PPO-ed Language Models Hackable?
Suraj Anand, David Getzen
Numerous algorithms have been proposed to language models to remove undesirable behaviors. However, the challenges associated with a very large state space and cre…