741 citations · 8k across the 129 of their papers we have counts for
3 papers · 1 filter
SLS-Bench: A Benchmark for Incident Log Summarization with Synthetic Observability Data
Valerii Iakovlev, Markus Spanring, Martin Flechl
As IT systems grow in complexity, automated agent-driven incident response becomes increasingly critical. A key capability for these agents is summarizing large log streams into hu…
Navigating the Sea of LLM Evaluation: Investigating Bias in Toxicity Benchmarks
Regina Gugg, Selina Niederländer, Andreas Stöckl +1
The rapid adoption of LLMs in both research and industry highlights the challenges of deploying them safely and reveals a gap in the systematic evaluation of toxicity benchmarks. A…
Linear-Time and Constant-Memory Text Embeddings Based on Recurrent Language Models
Tobias Grantner, Emanuel Sallinger, Martin Flechl
Transformer-based embedding models suffer from quadratic computational and linear memory complexity, limiting their utility for long sequences. We propose recurrent architectures a…