5 papers
Vulcan: Instance-specialized, Verifiable Systems Heuristics Through LLM-driven Search
Rohit Dwivedula, Divyanshu Saxena, Sujay Yadalam +3
Systems resource management tasks rely primarily on hand-designed heuristics. However, growing hardware heterogeneity and workload diversity require heuristics specialized to parti…
Dooly: Configuration-Agnostic, Redundancy-Aware Profiling for LLM Inference Simulation
Joon Ha Kim, Geon-Woo Kim, Anoop Rachakonda +1
Selecting the optimal LLM inference configuration requires evaluation across hardware, serving engines, attention backends, and model architectures, since no single choice performs…
Man-Made Heuristics Are Dead. Long Live Code Generators!
Rohit Dwivedula, Divyanshu Saxena, Aditya Akella +2
Policy design for various systems controllers has conventionally been a manual process, with domain experts carefully tailoring heuristics for the specific instance in which the po…
ConfigBot: Adaptive Resource Allocation for Robot Applications in Dynamic Environments
Rohit Dwivedula, Sadanand Modak, Aditya Akella +3
The growing use of service robots in dynamic environments requires flexible management of on-board compute resources to optimize the performance of diverse tasks such as navigation…
OMEGA: A Low-Latency GNN Serving System for Large Graphs
Geon-Woo Kim, Donghyun Kim, Jeongyoon Moon +5
Graph Neural Networks (GNNs) have been widely adopted for their ability to compute expressive node representations in graph datasets. However, serving GNNs on large graphs is chall…