Explaining Attention with Program Synthesis

Amiri Hayes, Belinda Z Li, Jacob Andreas

A longstanding goal of research on interpretable deep learning is to replace opaque neural computations with human-meaningful symbolic descriptions. In this paper, we propose an ap…