Showing 2024Show all
3 papers · 1 filter
cs.LG2024
HDT: Hierarchical Document Transformer
Haoyu He, Markus Flicke, Jan Buchmann +2
In this paper, we propose the Hierarchical Document Transformer (HDT), a novel sparse Transformer architecture tailored for structured hierarchical documents. Such documents are ex…
cs.CL2024
Attribute or Abstain: Large Language Models as Long Document Assistants
Jan Buchmann, Xiao Liu, Iryna Gurevych
LLMs can help humans working with long documents, but are known to hallucinate. Attribution can increase trust in LLM responses: The LLM provides evidence that supports its respons…
cs.CL2024
Document Structure in Long Document Transformers
Jan Buchmann, Max Eichler, Jan-Micha Bodensohn +2
Long documents often exhibit structure with hierarchically organized elements of different functions, such as section headers and paragraphs. Despite the omnipresence of document s…