1.5k citations · 2.5k across the 34 of their papers we have counts for
5 papers · 2 filters
K2: A Foundation Language Model for Geoscience Knowledge Understanding and Utilization
Cheng Deng, Tianhang Zhang, Zhongmou He +9
Large language models (LLMs) have achieved great success in general domains of natural language processing. In this paper, we bring LLMs to the realm of geoscience with the objecti…
Fourier Transformer: Fast Long Range Modeling by Removing Sequence Redundancy with FFT Operator
Ziwei He, Meng Yang, Minwei Feng +4
The transformer model is known to be computationally demanding, and prohibitively costly for long sequences, as the self-attention module uses a quadratic time and space complexity…
Text Classification in the Wild: a Large-scale Long-tailed Name Normalization Dataset
Jiexing Qi, Shuhao Li, Zhixin Guo +5
Real-world data usually exhibits a long-tailed distribution,with a few frequent labels and a lot of few-shot labels. The study of institution name normalization is a perfect applic…
Adapting Knowledge for Few-shot Table-to-Text Generation
Zhixin Guo, Minyxuan Yan, Jiexing Qi +4
Pretrained language models (PLMs) have made remarkable progress in table-to-text generation tasks. However, the lack of domain-specific knowledge makes it challenging to bridge the…
Few-Shot Table-to-Text Generation with Prompt Planning and Knowledge Memorization
Zhixin Guo, Minyxuan Yan, Jiexing Qi +5
Pre-trained language models (PLM) have achieved remarkable advancement in table-to-text generation tasks. However, the lack of labeled domain-specific knowledge and the topology ga…