Ruisi Cai

activity

20232026

most citedH

_{2}

O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models

28 citations · 31 across the 17 of their papers we have counts for

collaborators

Showing 2023Show all

3 papers · 1 filter

cs.CV2023★ 3 cited

Robust Mixture-of-Expert Training for Convolutional Neural Networks

Yihua Zhang, Ruisi Cai, Tianlong Chen +6

Sparsely-gated Mixture of Expert (MoE), an emerging deep model architecture, has demonstrated a great promise to enable high-accuracy and ultra-efficient model inference. Despite t…

cs.LG2023★ 28 cited

H $_{2}$ O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models

Zhenyu Zhang, Ying Sheng, Tianyi Zhou +9

Large Language Models (LLMs), despite their recent impressive accomplishments, are notably cost-prohibitive to deploy, particularly for applications involving long-content generati…

cs.LG2023

Robust Weight Signatures: Gaining Robustness as Easy as Patching Weights?

Ruisi Cai, Zhenyu Zhang, Zhangyang Wang

Given a robust model trained to be resilient to one or multiple types of distribution shifts (e.g., natural image corruptions), how is that "robustness" encoded in the model weight…

Robust Mixture-of-Expert Training for Convolutional Neural Networks

H2​O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models

Robust Weight Signatures: Gaining Robustness as Easy as Patching Weights?

H $_{2}$ O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models