25 citations · 179 across the 54 of their papers we have counts for
3 papers · 2 filters
General Cross-Architecture Distillation of Pretrained Language Models into Matrix Embeddings
Lukas Galke, Isabelle Cuber, Christoph Meyer +3
Large pretrained language models (PreLMs) are revolutionizing natural language processing across all benchmarks. However, their sheer size is prohibitive for small laboratories or…
Bag-of-Words vs. Graph vs. Sequence in Text Classification: Questioning the Necessity of Text-Graphs and the Surprising Strength of a Wide MLP
Lukas Galke, Ansgar Scherp
Graph neural networks have triggered a resurgence of graph-based text classification methods, defining today's state of the art. We show that a wide multi-layer perceptron (MLP) us…
Analysis of GraphSum's Attention Weights to Improve the Explainability of Multi-Document Summarization
M. Lautaro Hickmann, Fabian Wurzberger, Megi Hoxhalli +3
Modern multi-document summarization (MDS) methods are based on transformer architectures. They generate state of the art summaries, but lack explainability. We focus on graph-based…