17 citations · 69 across the 16 of their papers we have counts for
18 papers
One Transformer Can Understand Both 2D & 3D Molecular Data
Shengjie Luo, Tianlang Chen, Yixian Xu +4
Unlike vision and language data which usually has a unique format, molecules can naturally be characterized using different chemical formulations. One can view a molecule as a 2D g…
TransVG++: End-to-End Visual Grounding with Language Conditioned Vision Transformer
Jiajun Deng, Zhengyuan Yang, Daqing Liu +5
In this work, we explore neat yet effective Transformer-based frameworks for visual grounding. The previous methods generally address the core problem of visual grounding, i.e., mu…
More Than Just Attention: Improving Cross-Modal Attentions with Contrastive Constraints for Image-Text Matching
Yuxiao Chen, Jianbo Yuan, Long Zhao +4
Cross-modal attention mechanisms have been widely applied to the image-text matching task and have achieved remarkable improvements thanks to its capability of learning fine-graine…
TransVG: End-to-End Visual Grounding with Transformers
Jiajun Deng, Zhengyuan Yang, Tianlang Chen +2
In this paper, we present a neat yet effective transformer-based framework for visual grounding, namely TransVG, to address the task of grounding a language query to the correspond…
Improving One-stage Visual Grounding by Recursive Sub-query Construction
Zhengyuan Yang, Tianlang Chen, Liwei Wang +1
We improve one-stage visual grounding by addressing current limitations on grounding long and complex queries. Existing one-stage methods encode the entire language query as a sing…
Global Image Sentiment Transfer
Jie An, Tianlang Chen, Songyang Zhang +1
Transferring the sentiment of an image is an unexplored research topic in the area of computer vision. This work proposes a novel framework consisting of a reference image retrieva…
Image Sentiment Transfer
Tianlang Chen, Wei Xiong, Haitian Zheng +1
In this work, we introduce an important but still unexplored research task -- image sentiment transfer. Compared with other related tasks that have been well-studied, such as image…
Example-Guided Image Synthesis across Arbitrary Scenes using Masked Spatial-Channel Attention and Self-Supervision
Haitian Zheng, Haofu Liao, Lele Chen +3
Example-guided image synthesis has recently been attempted to synthesize an image from a semantic label map and an exemplary image. In the task, the additional exemplar image provi…
Adaptive Offline Quintuplet Loss for Image-Text Matching
Tianlang Chen, Jiajun Deng, Jiebo Luo
Existing image-text matching approaches typically leverage triplet loss with online hard negatives to train the model. For each image or text anchor in a training mini-batch, the m…
Expressing Objects just like Words: Recurrent Visual Embedding for Image-Text Matching
Tianlang Chen, Jiebo Luo
Existing image-text matching approaches typically infer the similarity of an image-text pair by capturing and aggregating the affinities between the text and each independent objec…
Anatomy-aware 3D Human Pose Estimation with Bone-based Pose Decomposition
Tianlang Chen, Chen Fang, Xiaohui Shen +3
In this work, we propose a new solution to 3D human pose estimation in videos. Instead of directly regressing the 3D joint locations, we draw inspiration from the human skeleton an…
Grounding-Tracking-Integration
Zhengyuan Yang, Tushar Kumar, Tianlang Chen +2
In this paper, we study Tracking by Language that localizes the target box sequence in a video based on a language query. We propose a framework called GTI that decomposes the prob…
Example-Guided Scene Image Synthesis using Masked Spatial-Channel Attention and Patch-Based Self-Supervision
Haitian Zheng, Haofu Liao, Lele Chen +3
Example-guided image synthesis has been recently attempted to synthesize an image from a semantic label map and an exemplary image. In the task, the additional exemplary image serv…
Large-scale Tag-based Font Retrieval with Generative Feature Learning
Tianlang Chen, Zhaowen Wang, Ning Xu +2
Font selection is one of the most important steps in a design workflow. Traditional methods rely on ordered lists which require significant domain knowledge and are often difficult…
How to Become Instagram Famous: Post Popularity Prediction with Dual-Attention
Zhongping Zhang, Tianlang Chen, Zheng Zhou +2
With a growing number of social apps, people have become increasingly willing to share their everyday photos and events on social media platforms, such as Facebook, Instagram, and…
"Factual" or "Emotional": Stylized Image Captioning with Adaptive Learning and Attention
Tianlang Chen, Zhongping Zhang, Quanzeng You +4
Generating stylized captions for an image is an emerging topic in image captioning. Given an image as input, it requires the system to generate a caption that has a specific style…
A Selfie is Worth a Thousand Words: Mining Personal Patterns behind User Selfie-posting Behaviours
Tianlang Chen, Yuxiao Chen, Jiebo Luo
Selfies have become increasingly fashionable in the social media era. People are willing to share their selfies in various social media platforms such as Facebook, Instagram and Fl…
When Saliency Meets Sentiment: Understanding How Image Content Invokes Emotion and Sentiment
Honglin Zheng, Tianlang Chen, Jiebo Luo
Sentiment analysis is crucial for extracting social signals from social media content. Due to the prevalence of images in social media, image sentiment analysis is receiving increa…