665 citations · 4.5k across the 236 of their papers we have counts for
27 papers · 1 filter
Distribution-aware Margin Calibration for Semantic Segmentation in Images
Litao Yu, Zhibin Li, Min Xu +3
The Jaccard index, also known as Intersection-over-Union (IoU), is one of the most critical evaluation metrics in image semantic segmentation. However, direct optimization of IoU s…
Procedure Planning in Instructional Videos via Contextual Modeling and Model-based Policy Learning
Jing Bi, Jiebo Luo, Chenliang Xu
Learning new skills by observing humans' behaviors is an essential capability of AI. In this work, we leverage instructional videos to study humans' decision-making processes, focu…
CoSeg: Cognitively Inspired Unsupervised Generic Event Segmentation
Xiao Wang, Jingen Liu, Tao Mei +1
Some cognitive research has discovered that humans accomplish event segmentation as a side effect of event anticipation. Inspired by this discovery, we propose a simple yet effecti…
Learning Fine-Grained Motion Embedding for Landscape Animation
Hongwei Xue, Bei Liu, Huan Yang +3
In this paper we focus on landscape animation, which aims to generate time-lapse videos from a single landscape image. Motion is crucial for landscape animation as it determines ho…
American Twitter Users Revealed Social Determinants-related Oral Health Disparities amid the COVID-19 Pandemic
Yangxin Fan, Hanjia Lyu, Jin Xiao +1
Objectives: To assess self-reported population oral health conditions amid COVID-19 pandemic using user reports on Twitter. Method and Material: We collected oral health-related tw…
Federated Learning of Molecular Properties with Graph Neural Networks in a Heterogeneous Setting
Wei Zhu, Jiebo Luo, Andrew White
Chemistry research has both high material and computational costs to conduct experiments. Institutions thus consider chemical data to be valuable and there have been few efforts to…
LibFewShot: A Comprehensive Library for Few-shot Learning
Wenbin Li, Ziyi, Wang +9
Few-shot learning, especially few-shot image classification, has received increasing attention and witnessed significant advances in recent years. Some recent studies implicitly sh…
Learning Conditional Knowledge Distillation for Degraded-Reference Image Quality Assessment
Heliang Zheng, Huan Yang, Jianlong Fu +2
An important scenario for image quality assessment (IQA) is to evaluate image restoration (IR) algorithms. The state-of-the-art approaches adopt a full-reference paradigm that comp…
Learning Bias-Invariant Representation by Cross-Sample Mutual Information Minimization
Wei Zhu, Haitian Zheng, Haofu Liao +2
Deep learning algorithms mine knowledge from the training data and thus would likely inherit the dataset's bias information. As a result, the obtained model would generalize poorly…
UniFaceGAN: A Unified Framework for Temporally Consistent Facial Video Editing
Meng Cao, Haozhi Huang, Hao Wang +6
Recent research has witnessed advances in facial image editing tasks including face swapping and face reenactment. However, these methods are confined to dealing with one specific…
Boosting Entity-aware Image Captioning with Multi-modal Knowledge Graph
Wentian Zhao, Yao Hu, Heda Wang +2
Entity-aware image captioning aims to describe named entities and events related to the image by utilizing the background knowledge in the associated article. This task remains cha…
Noise Stability Regularization for Improving BERT Fine-tuning
Hang Hua, Xingjian Li, Dejing Dou +2
Fine-tuning pre-trained language models such as BERT has become a common practice dominating leaderboards across various NLP tasks. Despite its recent success and wide adoption, th…
Probing Inter-modality: Visual Parsing with Self-Attention for Vision-Language Pre-training
Hongwei Xue, Yupan Huang, Bei Liu +4
Vision-Language Pre-training (VLP) aims to learn multi-modal representations from image-text pairs and serves for downstream vision-language tasks in a fine-tuning fashion. The dom…
Video-aided Unsupervised Grammar Induction
Songyang Zhang, Linfeng Song, Lifeng Jin +3
We investigate video-aided grammar induction, which learns a constituency parser from both unlabeled text and its corresponding video. Existing methods of multi-modal grammar induc…
SAT: 2D Semantics Assisted Training for 3D Visual Grounding
Zhengyuan Yang, Songyang Zhang, Liwei Wang +1
3D visual grounding aims at grounding a natural language description about a 3D scene, usually represented in the form of 3D point clouds, to the targeted object region. Point clou…
Few-shot Partial Multi-view Learning
Yuan Zhou, Yanrong Guo, Shijie Hao +2
It is often the case that data are with multiple views in real-world applications. Fully exploring the information of each view is significant for making data more representative.…
State-level Racially Motivated Hate Crimes Contrast Public Opinion on the #StopAsianHate and #StopAAPIHate Movement
Hanjia Lyu, Yangxin Fan, Ziyu Xiong +2
#StopAsianHate and #StopAAPIHate are two of the most commonly used hashtags that represent the current movement to end hate crimes against the Asian American and Pacific Islander c…
ArtFlow: Unbiased Image Style Transfer via Reversible Neural Flows
Jie An, Siyu Huang, Yibing Song +3
Universal style transfer retains styles from reference images in content images. While existing methods have achieved state-of-the-art style transfer performance, they are not awar…
Facial Attribute Transformers for Precise and Robust Makeup Transfer
Zhaoyi Wan, Haoran Chen, Jielei Zhang +3
In this paper, we address the problem of makeup transfer, which aims at transplanting the makeup from the reference face to the source face while preserving the identity of the sou…
Group-aware Label Transfer for Domain Adaptive Person Re-identification
Kecheng Zheng, Wu Liu, Lingxiao He +3
Unsupervised Domain Adaptive (UDA) person re-identification (ReID) aims at adapting the model trained on a labeled source-domain dataset to a target-domain dataset without any furt…
Enhanced Aspect-Based Sentiment Analysis Models with Progressive Self-supervised Attention Learning
Jinsong Su, Jialong Tang, Hui Jiang +6
In aspect-based sentiment analysis (ABSA), many neural models are equipped with an attention mechanism to quantify the contribution of each context word to sentiment prediction. Ho…
From Static to Dynamic Prediction: Wildfire Risk Assessment Based on Multiple Environmental Factors
Tanqiu Jiang, Sidhant K. Bendre, Hanjia Lyu +1
Wildfire is one of the biggest disasters that frequently occurs on the west coast of the United States. Many efforts have been made to understand the causes of the increases in wil…
Object Detection in Aerial Images: A Large-Scale Benchmark and Challenges
Jian Ding, Nan Xue, Gui-Song Xia +8
In the past decade, object detection has achieved significant progress in natural images but not in aerial images, due to the massive variations in the scale and orientation of obj…
Are Top School Students More Critical of Their Professors? Mining Comments on RateMyProfessor.com
Ziqi Tang, Yutong Wang, Jiebo Luo
Student reviews and comments on RateMyProfessor.com reflect realistic learning experiences of students. Such information provides a large-scale data source to examine the teaching…