Human Guided Exploitation of Interpretable Attention Patterns in Summarization and Topic Segmentation

Raymond Li, Wen Xiao, Linzi Xing +3

The multi-head self-attention mechanism of the transformer model has been thoroughly investigated recently. In one vein of study, researchers are interested in understanding why an…