most citedHADES: Hardware Accelerated Decoding for Efficient Speculation in Large Language Models

1 citations · 1 across the 7 of their papers we have counts for

collaborators
Showing cs.DCShow all

2 papers · 1 filter

cs.DC2025

Scalability Optimization in Cloud-Based AI Inference Services: Strategies for Real-Time Load Balancing and Automated Scaling

Yihong Jin, Ze Yang

The rapid expansion of AI inference services in the cloud necessitates a robust scalability solution to manage dynamic workloads and maintain high performance. This study proposes…

cs.DC2025

Adaptive Fault Tolerance Mechanisms of Large Language Models in Cloud Computing Environments

Yihong Jin, Ze Yang, Xinhe Xu +2

With the rapid evolution of Large Language Models (LLMs) and their large-scale experimentation in cloud-computing spaces, the challenge of guaranteeing their security and efficienc…