MEPT: Mixture of Expert Prompt Tuning as a Manifold Mapper

Runjia Zeng, Guangyan Sun, Qifan Wang +8

Considering deep neural networks as manifold mappers, the pretrain-then-fine-tune paradigm can be interpreted as a two-stage process: pretrain establishes a broad knowledge base, a…