Federating to Grow Transformers with Constrained Resources without Model Sharing

Shikun Shen, Yifei Zou, Yuan Yuan +4

The high resource consumption of large-scale models discourages resource-constrained users from developing their customized transformers. To this end, this paper considers a federa…