248 citations · 269 across the 27 of their papers we have counts for
4 papers · 1 filter
Benchmarking of CPU-intensive Stream Data Processing in The Edge Computing Systems
Tomasz Szydlo, Viacheslav Horbanov, Devki Nandan Jha +3
Edge computing has emerged as a pivotal technology, offering significant advantages such as low latency, enhanced data security, and reduced reliance on centralized cloud infrastru…
Aging-aware CPU Core Management for Embodied Carbon Amortization in Cloud LLM Inference
Tharindu B. Hewage, Shashikant Ilager, Maria Rodriguez Read +1
Broad adoption of Large Language Models (LLM) demands rapid expansions of cloud LLM inference clusters, leading to accumulation of embodied carbonthe emissions from manufacturin…
GREEN-CODE: Learning to Optimize Energy Efficiency in LLM-based Code Generation
Shashikant Ilager, Lukas Florian Briem, Ivona Brandic
Large Language Models (LLMs) are becoming integral to daily life, showcasing their vast potential across various Natural Language Processing (NLP) tasks. Beyond NLP, LLMs are incre…
Characterizing LLM Inference Energy-Performance Tradeoffs across Workloads and GPU Scaling
Paul Joe Maliakel, Shashikant Ilager, Ivona Brandic
LLM inference exhibits substantial variability across queries and execution phases, yet inference configurations are often applied uniformly. We present a measurement-driven charac…