WANSpec: Leveraging Global Compute Capacity for LLM Inference

Noah Martin, Fahad Dogar

Data centers capable of running large language models (LLMs) are spread across the globe. Some have high end GPUs for running the most advanced models (100B+ parameters), and other…