16 citations · 33 across the 17 of their papers we have counts for
3 papers · 1 filter
Compiler-Assisted Speculative Sampling for Accelerated LLM Inference on Heterogeneous Edge Devices
Alejandro Ruiz y Mesa, Guilherme Korol, Moritz Riesterer +2
LLM deployment on resource-constrained edge devices faces severe latency constraints, particularly in real-time applications where delayed responses can compromise safety or usabil…
Leveraging Stochastic Depth Training for Adaptive Inference
Guilherme Korol, Antonio Carlos Schneider Beck, Jeronimo Castrillon
Dynamic DNN optimization techniques such as layer-skipping offer increased adaptability and efficiency gains but can lead to i) a larger memory footprint as in decision gates, ii)…
A Reinforcement Learning Environment for Polyhedral Optimizations
Alexander Brauckmann, Andrés Goens, Jeronimo Castrillon
The polyhedral model allows a structured way of defining semantics-preserving transformations to improve the performance of a large class of loops. Finding profitable points in thi…