3 papers
cs.LG2024
HDT: Hierarchical Document Transformer
Haoyu He, Markus Flicke, Jan Buchmann +2
In this paper, we propose the Hierarchical Document Transformer (HDT), a novel sparse Transformer architecture tailored for structured hierarchical documents. Such documents are ex…
cs.CL2024
Document Structure in Long Document Transformers
Jan Buchmann, Max Eichler, Jan-Micha Bodensohn +2
Long documents often exhibit structure with hierarchically organized elements of different functions, such as section headers and paragraphs. Despite the omnipresence of document s…
cs.CL2023
CARE: Collaborative AI-Assisted Reading Environment
Dennis Zyska, Nils Dycke, Jan Buchmann +2
Recent years have seen impressive progress in AI-assisted writing, yet the developments in AI-assisted reading are lacking. We propose inline commentary as a natural vehicle for AI…