FSD-Inference: Fully Serverless Distributed Inference with Scalable Cloud Communication

Joe Oakley, Hakan Ferhatosmanoglu

Serverless computing offers attractive scalability, elasticity and cost-effectiveness. However, constraints on memory, CPU and function runtime have hindered its adoption for data-…