activity
20202023
most citedTask-Specific Expert Pruning for Sparse Mixture-of-Experts

9 citations · 10 across the 7 of their papers we have counts for

collaborators

7 papers

cs.CR2023

Identifying Vulnerable Third-Party Java Libraries from Textual Descriptions of Vulnerabilities and Libraries

Tianyu Chen, Lin Li, Bingjie Shan +4

To address security vulnerabilities arising from third-party libraries, security researchers maintain databases monitoring and curating vulnerability reports. Application developer…

cs.PL2022

Mechanized Noninterference for Gradual Security

Tianyu Chen, Jeremy G. Siek

This paper presents the first machine-checked proof of noninterference for a language with gradual information-flow control, thereby establishing a rock solid foundation for secure…

cs.CR2022

BadRes: Reveal the Backdoors through Residual Connection

Mingrui He, Tianyu Chen, Haoyi Zhou +2

Generally, residual connections are indispensable network components in building CNNs and Transformers for various downstream tasks in CV and VL, which encourages skip shortcuts be…

cs.CL2022

MoEC: Mixture of Expert Clusters

Yuan Xie, Shaohan Huang, Tianyu Chen +1

Sparsely Mixture of Experts (MoE) has received great interest due to its promising scaling capability with affordable computational overhead. MoE converts dense layers into sparse…

cs.LG2022★ 9 cited

Task-Specific Expert Pruning for Sparse Mixture-of-Experts

Tianyu Chen, Shaohan Huang, Yuan Xie +5

The sparse Mixture-of-Experts (MoE) model is powerful for large-scale pre-training and has achieved promising results due to its model capacity. However, with trillions of paramete…

cs.CR2022★ 1 cited

THE-X: Privacy-Preserving Transformer Inference with Homomorphic Encryption

Tianyu Chen, Hangbo Bao, Shaohan Huang +6

As more and more pre-trained language models adopt on-cloud deployment, the privacy issues grow quickly, mainly for the exposure of plain-text user data (e.g., search history, medi…

cs.PL2020

Parameterized Cast Calculi and Reusable Meta-theory for Gradually Typed Lambda Calculi

Jeremy G. Siek

The research on gradual typing has led to many variations on the Gradually Typed Lambda Calculus (GTLC) of Siek and Taha (2006) and its underlying cast calculus. For example, Wadle…