8 citations · 27 across the 5 of their papers we have counts for
5 papers
KOSMOS-2.5: A Multimodal Literate Model
Tengchao Lv, Yupan Huang, Jingye Chen +13
The automatic reading of text-intensive images represents a significant advancement toward achieving Artificial General Intelligence (AGI). In this paper we present KOSMOS-2.5, a m…
Unifying Vision, Text, and Layout for Universal Document Processing
Zineng Tang, Ziyi Yang, Guoxin Wang +6
We propose Universal Document Processing (UDOP), a foundation Document AI model which unifies text, image, and layout modalities together with varied task formats, including docume…
Understanding Long Documents with Different Position-Aware Attentions
Hai Pham, Guoxin Wang, Yijuan Lu +2
Despite several successes in document understanding, the practical task for long document understanding is largely under-explored due to several challenges in computation and how t…
Understanding Chinese Video and Language via Contrastive Multimodal Pre-Training
Chenyi Lei, Shixian Luo, Yong Liu +6
The pre-trained neural models have recently achieved impressive performances in understanding multimodal content. However, it is still very challenging to pre-train neural models f…
Pre-training Graph Transformer with Multimodal Side Information for Recommendation
Yong Liu, Susen Yang, Chenyi Lei +5
Side information of items, e.g., images and text description, has shown to be effective in contributing to accurate recommendations. Inspired by the recent success of pre-training…