SecMoE: Communication-Efficient Secure MoE Inference via Select-Then-Compute

Bowen Shen, Yuyue Chen, Peng Yang +3

Privacy-preserving Transformer inference has gained attention due to the potential leakage of private information. Despite recent progress, existing frameworks still fall short of…