12 citations · 52 across the 26 of their papers we have counts for
26 papers
Hierarchical Masked 3D Diffusion Model for Video Outpainting
Fanda Fan, Chaoxu Guo, Litong Gong +5
Video outpainting aims to adequately complete missing areas at the edges of video frames. Compared to image outpainting, it presents an additional challenge as the model should mai…
AutoPoster: A Highly Automatic and Content-aware Design System for Advertising Poster Generation
Jinpeng Lin, Min Zhou, Ye Ma +5
Advertising posters, a form of information presentation, combine visual and linguistic modalities. Creating a poster involves multiple steps and necessitates design experience and…
Deep Task-specific Bottom Representation Network for Multi-Task Recommendation
Qi Liu, Zhilong Zhou, Gangwei Jiang +2
Neural-based multi-task learning (MTL) has gained significant improvement, and it has been successfully applied to recommendation system (RS). Recent deep MTL methods for RS (e.g.…
TextPainter: Multimodal Text Image Generation with Visual-harmony and Text-comprehension for Poster Design
Yifan Gao, Jinpeng Lin, Min Zhou +4
Text design is one of the most critical procedures in poster design, as it relies heavily on the creativity and expertise of humans to design text images considering the visual har…
Visual Captioning at Will: Describing Images and Videos Guided by a Few Stylized Sentences
Dingyi Yang, Hongyu Chen, Xinglin Hou +3
Stylized visual captioning aims to generate image or video descriptions with specific styles, making them more attractive and emotionally appropriate. One major challenge with this…
Unsupervised Domain Adaption with Pixel-level Discriminator for Image-aware Layout Generation
Chenchen Xu, Min Zhou, Tiezheng Ge +2
Layout is essential for graphic design and poster generation. Recently, applying deep learning models to generate layouts has attracted increasing attention. This paper focuses on…
CF-Font: Content Fusion for Few-shot Font Generation
Chi Wang, Min Zhou, Tiezheng Ge +3
Content and style disentanglement is an effective way to achieve few-shot font generation. It allows to transfer the style of the font image in a source domain to the style defined…
Video Object of Interest Segmentation
Siyuan Zhou, Chunru Zhan, Biao Wang +3
In this work, we present a new computer vision task named video object of interest segmentation (VOIS). Given a video and a target image of interest, our objective is to simultaneo…
Motion and Appearance Adaptation for Cross-Domain Motion Transfer
Borun Xu, Biao Wang, Jinhong Deng +5
Motion transfer aims to transfer the motion of a driving video to a source image. When there are considerable differences between object in the driving video and that in the source…
Motion Transformer for Unsupervised Image Animation
Jiale Tao, Biao Wang, Tiezheng Ge +3
Image animation aims to animate a source image by using motion learned from a driving video. Current state-of-the-art methods typically use convolutional neural networks (CNNs) to…
Geometry Aligned Variational Transformer for Image-conditioned Layout Generation
Yunning Cao, Ye Ma, Min Zhou +4
Layout generation is a novel task in computer vision, which combines the challenges in both object localization and aesthetic appraisal, widely used in advertisements, posters, and…
Attract me to Buy: Advertisement Copywriting Generation with Multimodal Multi-structured Information
Zhipeng Zhang, Xinglin Hou, Kai Niu +5
Recently, online shopping has gradually become a common way of shopping for people all over the world. Wonderful merchandise advertisements often attract more people to buy. These…
Dual-Level Decoupled Transformer for Video Captioning
Yiqi Gao, Xinglin Hou, Wei Suo +4
Video captioning aims to understand the spatio-temporal semantic concept of the video and generate descriptive sentences. The de-facto approach to this task dictates a text generat…
Composition-aware Graphic Layout GAN for Visual-textual Presentation Designs
Min Zhou, Chenchen Xu, Ye Ma +3
In this paper, we study the graphic layout generation problem of producing high-quality visual-textual presentation designs for given images. We note that image compositions, which…
CapOnImage: Context-driven Dense-Captioning on Image
Yiqi Gao, Xinglin Hou, Yuanmeng Zhang +3
Existing image captioning systems are dedicated to generating narrative captions for images, which are spatially detached from the image in presentation. However, texts can also be…
Self-Supervised Text Erasing with Controllable Image Synthesis
Gangwei Jiang, Shiyao Wang, Tiezheng Ge +3
Recent efforts on scene text erasing have shown promising results. However, existing methods require rich yet costly label annotations to obtain robust models, which limits the use…
Structure-Aware Motion Transfer with Deformable Anchor Model
Jiale Tao, Biao Wang, Borun Xu +4
Given a source image and a driving video depicting the same object type, the motion transfer task aims to generate a video by learning the motion from the driving video while prese…
Learning Pixel-Level Distinctions for Video Highlight Detection
Fanyue Wei, Biao Wang, Tiezheng Ge +3
The goal of video highlight detection is to select the most attractive segments from a long video to depict the most interesting parts of the video. Existing methods typically focu…
Estimation of Reliable Proposal Quality for Temporal Action Detection
Junshan Hu, Chaoxu guo, Liansheng Zhuang +4
Temporal action detection (TAD) aims to locate and recognize the actions in an untrimmed video. Anchor-free methods have made remarkable progress which mainly formulate TAD into tw…
Move As You Like: Image Animation in E-Commerce Scenario
Borun Xu, Biao Wang, Jiale Tao +4
Creative image animations are attractive in e-commerce applications, where motion transfer is one of the import ways to generate animations from static images. However, existing me…
Boosting Image Outpainting with Semantic Layout Prediction
Ye Ma, Jin Ma, Min Zhou +4
The objective of image outpainting is to extend image current border and generate new regions based on known ones. Previous methods adopt generative adversarial networks (GANs) to…
Efficient Optimal Selection for Composited Advertising Creatives with Tree Structure
Jin Chen, Tiezheng Ge, Gangwei Jiang +3
Ad creatives are one of the prominent mediums for online e-commerce advertisements. Ad creatives with enjoyable visual appearance may increase the click-through rate (CTR) of produ…
Automated Creative Optimization for E-Commerce Advertising
Jin Chen, Ju Xu, Gangwei Jiang +4
Advertising creatives are ubiquitous in E-commerce advertisements and aesthetic creatives may improve the click-through rate (CTR) of the products. Nowadays smart advertisement pla…
A Hybrid Bandit Model with Visual Priors for Creative Ranking in Display Advertising
Shiyao Wang, Qi Liu, Tiezheng Ge +2
Creative plays a great important role in e-commerce for exhibiting products. Sellers usually create multiple creatives for comprehensive demonstrations, thus it is crucial to displ…