activity
20152026
most citedInstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuning

409 citations · 677 across the 54 of their papers we have counts for

collaborators
Showing 2021Show all

7 papers · 1 filter

cs.CV2021

Improving Tail-Class Representation with Centroid Contrastive Learning

Anthony Meng Huat Tiong, Junnan Li, Guosheng Lin +3

In vision domain, large-scale natural datasets typically exhibit long-tailed distribution which has large class imbalance between head and tail classes. This distribution poses dif…

cs.LG2021★ 2 cited

Noise-Resistant Deep Metric Learning with Probabilistic Instance Filtering

Chang Liu, Han Yu, Boyang Li +6

Noisy labels are commonly found in real-world data, which cause performance degradation of deep neural networks. Cleaning data manually is labour-intensive and time-consuming. Prev…

cs.IR2021★ 9 cited

Initialization Matters: Regularizing Manifold-informed Initialization for Neural Recommendation Systems

Yinan Zhang, Boyang Li, Yong Liu +2

Proper initialization is crucial to the optimization and the generalization of neural networks. However, most existing neural recommendation systems initialize the user and item em…

cs.CV2021★ 6 cited

Noise-resistant Deep Metric Learning with Ranking-based Instance Selection

Chang Liu, Han Yu, Boyang Li +6

The existence of noisy labels in real-world data negatively impacts the performance of deep learning models. Although much research effort has been devoted to improving robustness…

cs.LG2021★ 6 cited

Latent-Optimized Adversarial Neural Transfer for Sarcasm Detection

Xu Guo, Boyang Li, Han Yu +1

The existence of multiple datasets for sarcasm detection prompts us to apply transfer learning to exploit their commonality. The adversarial neural transfer (ANT) framework utilize…

cs.CV2021★ 14 cited

VisualGPT: Data-efficient Adaptation of Pretrained Language Models for Image Captioning

Jun Chen, Han Guo, Kai Yi +2

The ability to quickly learn from a small quantity oftraining data widens the range of machine learning applications. In this paper, we propose a data-efficient image captioning mo…

cs.LG2021★ 25 cited

HYDRA: Hypergradient Data Relevance Analysis for Interpreting Deep Neural Networks

Yuanyuan Chen, Boyang Li, Han Yu +2

The behaviors of deep neural networks (DNNs) are notoriously resistant to human interpretations. In this paper, we propose Hypergradient Data Relevance Analysis, or HYDRA, which in…