7 citations · 15 across the 3 of their papers we have counts for
3 papers
cs.CL2023★ 7 cited
Quantization-Aware and Tensor-Compressed Training of Transformers for Natural Language Understanding
Zi Yang, Samridhi Choudhary, Siegfried Kunzmann +1
Fine-tuned transformer models have shown superior performances in many natural language tasks. However, the large model size prohibits deploying high-performance transformer models…
cs.CV2021★ 4 cited
PTCT: Patches with 3D-Temporal Convolutional Transformer Network for Precipitation Nowcasting
Ziao Yang, Xiangrui Yang, Qifeng Lin
Precipitation nowcasting is to predict the future rainfall intensity over a short period of time, which mainly relies on the prediction of radar echo sequences. Though convolutiona…
cs.CL2020★ 4 cited
Pruning Redundant Mappings in Transformer Models via Spectral-Normalized Identity Prior
Zi Lin, Jeremiah Zhe Liu, Zi Yang +2
Traditional (unstructured) pruning methods for a Transformer model focus on regularizing the individual weights by penalizing them toward zero. In this work, we explore spectral-no…