activity
20202023
most citedLinformer: Self-Attention with Linear Complexity

887 citations · 1.4k across the 12 of their papers we have counts for

collaborators

12 papers

cs.CV2023

Mask to reconstruct: Cooperative Semantics Completion for Video-text Retrieval

Han Fang, Zhifei Yang, Xianghao Zang +2

Recently, masked video modeling has been widely explored and significantly improved the model's understanding ability of visual regions at a local level. However, existing methods…

cond-mat.mtrl-sci2023

Multi-objective Generative Design of Three-Dimensional Composite Materials

Zhengyang Zhang, Han Fang, Zhao Xu +3

Composite materials with 3D architectures are desirable in a variety of applications for the capability of tailoring their properties to meet multiple functional requirements. By t…

cs.CL2023★ 3 cited

Representation Deficiency in Masked Language Modeling

Yu Meng, Jitin Krishnan, Sinong Wang +6

Masked Language Modeling (MLM) has been one of the most prominent approaches for pretraining bidirectional text encoders due to its simplicity and effectiveness. One notable concer…

cs.CR2022

Tracing the Origin of Adversarial Attack for Forensic Investigation and Deterrence

Han Fang, Jiyi Zhang, Yupeng Qiu +3

Deep neural networks are vulnerable to adversarial attacks. In this paper, we take the role of investigators who want to trace the attack and identify the source, that is, the part…

cs.LG2022★ 1 cited

Improved Adaptive Algorithm for Scalable Active Learning with Weak Labeler

Yifang Chen, Karthik Sankararaman, Alessandro Lazaric +6

Active learning with strong and weak labelers considers a practical setting where we have access to both costly but accurate strong labelers and inaccurate but cheap predictions pr…

cs.CL2022★ 8 cited

BayesFormer: Transformer with Uncertainty Estimation

Karthik Abinav Sankararaman, Sinong Wang, Han Fang

Transformer has become ubiquitous due to its dominant performance in various NLP and image processing tasks. However, it lacks understanding of how to generate mathematically groun…

cs.CL2021

Reducing Target Group Bias in Hate Speech Detectors

Darsh J Shah, Sinong Wang, Han Fang +2

The ubiquity of offensive and hateful content on online fora necessitates the need for automatic solutions that detect such content competently across target groups. In this paper…

cs.CV2021

MLFW: A Database for Face Recognition on Masked Faces

Chengrui Wang, Han Fang, Yaoyao Zhong +1

As more and more people begin to wear masks due to current COVID-19 pandemic, existing face recognition systems may encounter severe performance degradation when recognizing masked…

cs.CV2021★ 131 cited

CLIP2Video: Mastering Video-Text Retrieval via Image CLIP

Han Fang, Pengfei Xiong, Luhui Xu +1

We present CLIP2Video network to transfer the image-language pre-training model to video-text retrieval in an end-to-end manner. Leading approaches in the domain of video-and-langu…

cs.CL2021★ 106 cited

Entailment as Few-Shot Learner

Sinong Wang, Han Fang, Madian Khabsa +2

Large pre-trained language models (LMs) have demonstrated remarkable ability as few-shot learners. However, their success hinges largely on scaling model parameters to a degree tha…

econ.GN2021★ 258 cited

Micro-Estimates of Wealth for all Low- and Middle-Income Countries

Guanghua Chi, Han Fang, Sourav Chatterjee +1

Many critical policy decisions, from strategic investments to the allocation of humanitarian aid, rely on data about the geographic distribution of wealth and poverty. Yet many pov…

cs.LG2020★ 887 cited

Linformer: Self-Attention with Linear Complexity

Sinong Wang, Belinda Z. Li, Madian Khabsa +2

Large transformer models have shown extraordinary success in achieving state-of-the-art results in many natural language processing applications. However, training and deploying th…