Hierarchical Attention Generates Better Proofs

Jianlong Chen, Chao Li, Yang Yuan +1

Large language models (LLMs) have shown promise in formal theorem proving, but their token-level processing often fails to capture the inherent hierarchical nature of mathematical…