ADMM Based Semi-Structured Pattern Pruning Framework For Transformer

TianChen Wang

NLP(natural language processsing) has achieved great success through the transformer model.However, the model has hundreds of millions or billions parameters,which is huge burden f…