127 citations · 227 across the 14 of their papers we have counts for
14 papers
GLM-OCR Technical Report
Shuaiqi Duan, Yadong Xue, Weihan Wang +20
GLM-OCR is an efficient 0.9B-parameter compact multimodal model designed for real-world document understanding. It combines a 0.4B-parameter CogViT visual encoder with a 0.5B-param…
QA-LoRA: Quantization-Aware Low-Rank Adaptation of Large Language Models
Yuhui Xu, Lingxi Xie, Xiaotao Gu +6
Recently years have witnessed a rapid development of large language models (LLMs). Despite the strong ability in many language-understanding tasks, the heavy computational burden l…
Towards AGI in Computer Vision: Lessons Learned from GPT and Large Language Models
Lingxi Xie, Longhui Wei, Xiaopeng Zhang +4
The AI community has been pursuing algorithms known as artificial general intelligence (AGI) that apply to any kind of real-world problem. Recently, chat systems powered by large l…
Pipeline MoE: A Flexible MoE Implementation with Pipeline Parallelism
Xin Chen, Hengheng Zhang, Xiaotao Gu +3
The Mixture of Experts (MoE) model becomes an important choice of large language models nowadays because of its scalability with sublinear computational complexity for training and…
Pangu-Weather: A 3D High-Resolution Model for Fast and Accurate Global Weather Forecast
Kaifeng Bi, Lingxi Xie, Hengheng Zhang +3
In this paper, we present Pangu-Weather, a deep learning based system for fast and accurate global weather forecast. For this purpose, we establish a data-driven environment by dow…
UCPhrase: Unsupervised Context-aware Quality Phrase Tagging
Xiaotao Gu, Zihan Wang, Zhenyu Bi +4
Identifying and understanding quality phrases from context is a fundamental task in text mining. The most challenging part of this task arguably lies in uncommon, emerging, and dom…
On the Transformer Growth for Progressive BERT Training
Xiaotao Gu, Liyuan Liu, Hongkun Yu +3
Due to the excessive cost of large-scale language model pre-training, considerable efforts have been made to train BERT progressively -- start from an inferior but low-cost model a…
Learning Collaborative Agents with Rule Guidance for Knowledge Graph Reasoning
Deren Lei, Gangrong Jiang, Xiaotao Gu +3
Walk-based models have shown their advantages in knowledge graph (KG) reasoning by achieving decent performance while providing interpretable decisions. However, the sparse reward…
Generating Representative Headlines for News Stories
Xiaotao Gu, Yuning Mao, Jiawei Han +7
Millions of news articles are published online every day, which can be overwhelming for readers to follow. Grouping articles that are reporting the same event into news stories is…
Learning Dynamic Context Augmentation for Global Entity Linking
Xiyuan Yang, Xiaotao Gu, Sheng Lin +6
Despite of the recent success of collective entity linking (EL) methods, these "global" inference methods may yield sub-optimal results when the "all-mention coherence" assumption…
Improving Distantly-supervised Entity Typing with Compact Latent Space Clustering
Bo Chen, Xiaotao Gu, Yufeng Hu +4
Recently, distant supervision has gained great success on Fine-grained Entity Typing (FET). Despite its efficiency in reducing manual labeling efforts, it also brings the challenge…
Learning Named Entity Tagger using Domain-Specific Dictionary
Jingbo Shang, Liyuan Liu, Xiang Ren +3
Recent advances in deep neural models allow us to build reliable named entity recognition (NER) systems without handcrafting features. However, such methods require large amounts o…
End-to-End Reinforcement Learning for Automatic Taxonomy Induction
Yuning Mao, Xiang Ren, Jiaming Shen +2
We present a novel end-to-end reinforcement learning approach to automatic taxonomy induction from a set of terms. While prior methods treat the problem as a two-phase task (i.e.,…
Large-scale Validation of Counterfactual Learning Methods: A Test-Bed
Damien Lefortier, Adith Swaminathan, Xiaotao Gu +2
The ability to perform effective off-policy learning would revolutionize the process of building better interactive systems, such as search engines and recommendation systems for e…