Yao Zhang

collaborators

Showing cs.CRShow all

2 papers · 1 filter

cs.CR2026

CachePrune: Privacy-Aware and Fine-Grained KV Cache Sharing for Efficient LLM Inference

Guanlong Wu, Zhaohan li, Yao Zhang +4

Large Language Models (LLMs) rely on Key-Value (KV) caching to accelerate inference, and many serving systems further share the KV cache across users' requests to reduce redundant…

cs.CR2024

H $_{2}$ O $_{2}$ RAM: A High-Performance Hierarchical Doubly Oblivious RAM

Leqian Zheng, Zheng Zhang, Wentao Dong +3

The combination of Oblivious RAM (ORAM) with Trusted Execution Environments (TEE) has found numerous real-world applications due to their complementary nature. TEEs alleviate the p…

CachePrune: Privacy-Aware and Fine-Grained KV Cache Sharing for Efficient LLM Inference

H2​O2​RAM: A High-Performance Hierarchical Doubly Oblivious RAM

H $_{2}$ O $_{2}$ RAM: A High-Performance Hierarchical Doubly Oblivious RAM