109 citations · 258 across the 37 of their papers we have counts for
4 papers · 1 filter
E8 Lattice Key Quantization for Low-Bit KV-Cache Compression
Sasho Nedelkoski, Alexander Acker, Soeren Becker +2
Compressing the key-value (KV) cache is essential for serving long-context large language models (LLMs) under memory constraints. While current scalar quantization methods achieve…
Scalable and Data-Driven Decision Support in the Maintenance, Repair, and Overhaul Process
Houkun Zhu, Helena Ebel, Dominik Scheinert +3
Several businesses apply maintenance, repair, and overhaul (MRO) principles to the life-cycle of their existing products. In cases like casted gas turbine component Product Lifecyc…
Beyond Microservices: Testing Web-Scale RCA Methods on GPU-Driven LLM Workloads
Dominik Scheinert, Alexander Acker, Thorsten Wittkopp +6
Large language model (LLM) services have become an integral part of search, assistance, and decision-making applications. However, unlike traditional web or microservices, the hard…
Distributed LLM Pretraining During Renewable Curtailment Windows: A Feasibility Study
Philipp Wiesner, Soeren Becker, Brett Cornick +3
Training large language models (LLMs) requires substantial compute and energy. At the same time, renewable energy sources regularly produce more electricity than the grid can absor…