51 citations · 242 across the 54 of their papers we have counts for
8 papers · 1 filter
Sparse is Enough in Fine-tuning Pre-trained Large Language Models
Weixi Song, Zuchao Li, Lefei Zhang +2
With the prevalence of pre-training-fine-tuning paradigm, how to efficiently adapt the pre-trained model to the downstream tasks has been an intriguing issue. Parameter-Efficient F…
Enhancing Visually-Rich Document Understanding via Layout Structure Modeling
Qiwei Li, Zuchao Li, Xiantao Cai +2
In recent years, the use of multi-modal pre-trained Transformers has led to significant advancements in visually-rich document understanding. However, existing models have mainly f…
BatGPT: A Bidirectional Autoregessive Talker from Generative Pre-trained Transformer
Zuchao Li, Shitou Zhang, Hai Zhao +2
BatGPT is a large-scale language model designed and trained jointly by Wuhan University and Shanghai Jiao Tong University. It is capable of generating highly natural and fluent tex…
ArcGPT: A Large Language Model Tailored for Real-world Archival Applications
Shitou Zhang, Jingrui Hou, Siyuan Peng +3
Archives play a crucial role in preserving information and knowledge, and the exponential growth of such data necessitates efficient and automated tools for managing and utilizing…
Bidirectional Looking with A Novel Double Exponential Moving Average to Adaptive and Non-adaptive Momentum Optimizers
Yineng Chen, Zuchao Li, Lefei Zhang +2
Optimizer is an essential component for the success of deep learning, which guides the neural network to update the parameters according to the loss on the training set. SGD and Ad…
FSUIE: A Novel Fuzzy Span Mechanism for Universal Information Extraction
Tianshuo Peng, Zuchao Li, Lefei Zhang +2
Universal Information Extraction (UIE) has been introduced as a unified framework for various Information Extraction (IE) tasks and has achieved widespread success. Despite this, U…
Beyond Chain-of-Thought, Effective Graph-of-Thought Reasoning in Language Models
Yao Yao, Zuchao Li, Hai Zhao
With the widespread use of language models (LMs) in NLP tasks, researchers have discovered the potential of Chain-of-thought (CoT) to assist LMs in accomplishing complex reasoning…
Universal Multimodal Representation for Language Understanding
Zhuosheng Zhang, Kehai Chen, Rui Wang +4
Representation learning is the foundation of natural language processing (NLP). This work presents new methods to employ visual information as assistant signals to general NLP task…