activity
20202022
most citedFTRANS: Energy-Efficient Acceleration of Transformers using FPGA

7 citations · 21 across the 5 of their papers we have counts for

collaborators

5 papers

cs.CV2022

ClipCrop: Conditioned Cropping Driven by Vision-Language Model

Zhihang Zhong, Mingxi Cheng, Zhirong Wu +7

Image cropping has progressed tremendously under the data-driven paradigm. However, current approaches do not account for the intentions of the user, which is an issue especially w…

cs.CR2022★ 6 cited

A Secure and Efficient Federated Learning Framework for NLP

Jieren Deng, Chenghong Wang, Xianrui Meng +7

In this work, we consider the problem of designing secure and efficient federated learning (FL) frameworks. Existing solutions either involve a trusted aggregator or require heavyw…

cs.CR2021★ 3 cited

TAG: Gradient Attack on Transformer-based Language Models

Jieren Deng, Yijue Wang, Ji Li +4

Although federated learning has increasingly gained attention in terms of effectively utilizing local devices for data privacy enhancement, recent studies show that publicly shared…

cs.CL2020★ 5 cited

Efficient Transformer-based Large Scale Language Representations using Hardware-friendly Block Structured Pruning

Bingbing Li, Zhenglun Kong, Tianyun Zhang +4

Pre-trained large-scale language models have increasingly demonstrated high accuracy on many natural language processing (NLP) tasks. However, the limited weight storage and comput…

cs.DC2020★ 7 cited

FTRANS: Energy-Efficient Acceleration of Transformers using FPGA

Bingbing Li, Santosh Pandey, Haowen Fang +7

In natural language processing (NLP), the "Transformer" architecture was proposed as the first transduction model replying entirely on self-attention mechanisms without using seque…