Legal-HNet: Mixing Legal Long-Context Tokens with Hartley Transform

Daniele Giofré, Sneha Ghantasala

Since its introduction, the transformers architecture has seen great adoption in NLP applications, but it also has limitations. Although the self-attention mechanism allows for gen…