97 citations · 109 across the 14 of their papers we have counts for
Showing 2024Show all
3 papers · 1 filter
cs.LG2024
Visualizing Neural Network Imagination
Nevan Wichers, Victor Tao, Riccardo Volpato +1
In certain situations, neural networks will represent environment states in their hidden activations. Our goal is to visualize what environment states the networks are representing…
cs.CL2024
Beyond Sparse Rewards: Enhancing Reinforcement Learning with Language Model Critique in Text Generation
Meng Cao, Lei Shu, Lei Yu +4
Reinforcement learning (RL) can align language models with non-differentiable reward signals, such as human preferences. However, a major challenge arises from the sparsity of thes…
cs.CL2024★ 2 cited
Gradient-Based Language Model Red Teaming
Nevan Wichers, Carson Denison, Ahmad Beirami
Red teaming is a common strategy for identifying weaknesses in generative language models (LMs), where adversarial prompts are produced that trigger an LM to generate unsafe respon…