On Mechanistic Circuits for Extractive Question-Answering

Samyadeep Basu, Vlad Morariu, Zichao Wang +4

Large language models are increasingly used to process documents and facilitate question-answering on them. In our paper, we extract mechanistic circuits for this real-world langua…