Chenyang Li

activity

20232025

most citedA Theoretical Insight into Attack and Defense of Gradient Leakage in Transformer

3 citations · 5 across the 7 of their papers we have counts for

collaborators

Showing 2023Show all

2 papers · 1 filter

cs.LG2023★ 3 cited

A Theoretical Insight into Attack and Defense of Gradient Leakage in Transformer

Chenyang Li, Zhao Song, Weixin Wang +1

The Deep Leakage from Gradient (DLG) attack has emerged as a prevalent and highly effective method for extracting sensitive training data by inspecting exchanged gradients. This ap…

cs.LG2023

One Pass Streaming Algorithm for Super Long Token Attention Approximation in Sublinear Space

Raghav Addanki, Chenyang Li, Zhao Song +1

Attention computation takes both the time complexity of $O (n^{2})$ and the space complexity of $O (n^{2})$ simultaneously, which makes deploying Large Language Models (LLMs) in streamin…