50 citations · 95 across the 8 of their papers we have counts for
8 papers
VisIT-Bench: A Benchmark for Vision-Language Instruction Following Inspired by Real-World Use
Yonatan Bitton, Hritik Bansal, Jack Hessel +6
We introduce VisIT-Bench (Visual InsTruction Benchmark), a benchmark for evaluation of instruction-following vision-language models for real-world use. Our starting point is curati…
Cross-modal Attention Congruence Regularization for Vision-Language Relation Alignment
Rohan Pandey, Rulin Shao, Paul Pu Liang +2
Despite recent progress towards scaling up multimodal vision-language models, these models are still known to struggle on compositional generalization benchmarks such as Winoground…
MPCFormer: fast, performant and private Transformer inference with MPC
Dacheng Li, Rulin Shao, Hongyi Wang +3
Enabling private inference is crucial for many cloud inference services that are based on Transformer models. However, existing private inference solutions can increase the inferen…
How and When Adversarial Robustness Transfers in Knowledge Distillation?
Rulin Shao, Jinfeng Yi, Pin-Yu Chen +1
Knowledge distillation (KD) has been widely used in teacher-student training, with applications to model compression in resource-constrained deep learning. Current works mainly foc…
On the Adversarial Robustness of Vision Transformers
Rulin Shao, Zhouxing Shi, Jinfeng Yi +2
Following the success in advancing natural language processing and understanding, transformers are expected to bring revolutionary changes to computer vision. This work provides a…
Robust Text CAPTCHAs Using Adversarial Examples
Rulin Shao, Zhouxing Shi, Jinfeng Yi +2
CAPTCHA (Completely Automated Public Truing test to tell Computers and Humans Apart) is a widely used technology to distinguish real users and automated users such as bots. However…
Stochastic Channel-Based Federated Learning for Medical Data Privacy Preserving
Rulin Shao, Hongyu He, Hui Liu +1
Artificial neural network has achieved unprecedented success in the medical domain. This success depends on the availability of massive and representative datasets. However, data c…
Privacy Preserving Stochastic Channel-Based Federated Learning with Neural Network Pruning
Rulin Shao, Hui Liu, Dianbo Liu
Artificial neural network has achieved unprecedented success in a wide variety of domains such as classifying, predicting and recognizing objects. This success depends on the avail…