Fine-Grained Computation Offload for Off-the-Shelf Servers in Tens of Lines

Bojie Li

Hardware accelerators now sit on the critical path of online serving. GPUs, FPGAs, and increasingly remote services such as hardware security modules, post-quantum KEMs, and infere…