most citedTowards Efficient Multi-LLM Inference: Characterization and Analysis of LLM Routing and Hierarchical Techniques

1 citations · 1 across the 4 of their papers we have counts for

collaborators
Showing cs.DCShow all

1 paper · 1 filter

cs.DC2024

Improved Decision Module Selection for Hierarchical Inference in Resource-Constrained Edge Devices

Adarsh Prasad Behera, Roberto Morabito, Joerg Widmer +1

The Hierarchical Inference (HI) paradigm employs a tiered processing: the inference from simple data samples are accepted at the end device, while complex data samples are offloade…