1 citations · 1 across the 3 of their papers we have counts for
Showing cs.PFShow all
3 papers · 1 filter
cs.PF2026
A Photonic-CXL Memory Appliance for Scalable KV Cache Management in LLM Inference
Jing Ding, Yash Nishant, Chandrish Ambati +2
LLM inference at scale faces a memory wall. The KV cache demands tens of terabytes at hundreds of gigabytes per second, yet no current memory tier delivers both at once. Characteri…
cs.PF2025
Dissecting Embedding Bag Performance in DLRM Inference
Chandrish Ambati, Jing Ding, Trung Diep
As the size of DLRMs gets larger, the models must be partitioned across multiple GPUs or nodes of GPUs due to the size limitation of total HBM memory that can be packaged in a GPU.…
cs.PF2025★ 1 cited
Photonic Fabric Platform for AI Accelerators
Jing Ding, Trung Diep
This paper presents the Photonic FabricTM and the Photonic Fabric ApplianceTM (PFA), a photonic-enabled switch and memory subsystem that delivers low latency, high bandwidth, and l…