7 citations · 28 across the 10 of their papers we have counts for
10 papers
SC-ML: Self-supervised Counterfactual Metric Learning for Debiased Visual Question Answering
Xinyao Shu, Shiyang Yan, Xu Yang +3
Visual question answering (VQA) is a critical multimodal task in which an agent must answer questions according to the visual cue. Unfortunately, language bias is a common problem…
AdaTriplet-RA: Domain Matching via Adaptive Triplet and Reinforced Attention for Unsupervised Domain Adaptation
Xinyao Shu, Shiyang Yan, Zhenyu Lu +2
Unsupervised domain adaption (UDA) is a transfer learning task where the data and annotations of the source domain are available but only have access to the unlabeled target data d…
Discrete-continuous Action Space Policy Gradient-based Attention for Image-Text Matching
Shiyang Yan, Li Yu, Yuan Xie
Image-text matching is an important multi-modal task with massive applications. It tries to match the image and the text with similar semantic information. Existing approaches do n…
Off-Policy Self-Critical Training for Transformer in Visual Paragraph Generation
Shiyang Yan, Yang Hua, Neil M. Robertson
Recently, several approaches have been proposed to solve language generation problems. Transformer is currently state-of-the-art seq-to-seq model in language generation. Reinforcem…
ParaCNN: Visual Paragraph Generation via Adversarial Twin Contextual CNNs
Shiyang Yan, Yang Hua, Neil Robertson
Image description generation plays an important role in many real-world applications, such as image retrieval, automatic navigation, and disabled people support. A well-developed t…
HorNet: A Hierarchical Offshoot Recurrent Network for Improving Person Re-ID via Image Captioning
Shiyang Yan, Jun Xu, Yuai Liu +1
Person re-identification (re-ID) aims to recognize a person-of-interest across different cameras with notable appearance variance. Existing research works focused on the capability…
Image Captioning Based on a Hierarchical Attention Mechanism and Policy Gradient Optimization
Shiyang Yan, Yuan Xie, Fangyu Wu +3
Automatically generating the descriptions of an image, i.e., image captioning, is an important and fundamental topic in artificial intelligence, which bridges the gap between compu…
Hierarchical Multi-scale Attention Networks for Action Recognition
Shiyang Yan, Jeremy S. Smith, Wenjin Lu +1
Recurrent Neural Networks (RNNs) have been widely used in natural language processing and computer vision. Among them, the Hierarchical Multi-scale RNN (HM-RNN), a kind of multi-sc…
Traffic scene recognition based on deep cnn and vlad spatial pyramids
Fang-Yu Wu, Shi-Yang Yan, Jeremy S. Smith +1
Traffic scene recognition is an important and challenging issue in Intelligent Transportation Systems (ITS). Recently, Convolutional Neural Network (CNN) models have achieved great…
CHAM: action recognition using convolutional hierarchical attention model
Shiyang Yan, Jeremy S. Smith, Wenjin Lu +1
Recently, the soft attention mechanism, which was originally proposed in language processing, has been applied in computer vision tasks like image captioning. This paper presents i…