Decoupling Knowledge and Reasoning in Transformers: A Modular Architecture with Generalized Cross-Attention

Zhenyu Guo, Wenguang Chen

Transformers have achieved remarkable success across diverse domains, but their monolithic architecture presents challenges in interpretability, adaptability, and scalability. This…