Mechanistic Interpretability in the Presence of Architectural Obfuscation

Marcos Florencio, Thomas Barton

Architectural obfuscation - e.g., permuting hidden-state tensors, linearly transforming embedding tables, or remapping tokens - has recently gained traction as a lightweight substi…