Showing 2025Show all
2 papers · 1 filter
cs.LG2025
DSD: A Distributed Speculative Decoding Solution for Edge-Cloud Agile Large Model Serving
Fengze Yu, Leshu Li, Brad McDanel +1
Large language model (LLM) inference often suffers from high decoding latency and limited scalability across heterogeneous edge-cloud environments. Existing speculative decoding (S…
cs.SE2025
Beyond Trusting Trust: Multi-Model Validation for Robust Code Generation
Bradley McDanel
This paper explores the parallels between Thompson's "Reflections on Trusting Trust" and modern challenges in LLM-based code generation. We examine how Thompson's insights about co…