General Point Model with Autoencoding and Autoregressive

Zhe Li, Zhangyang Gao, Cheng Tan +2

The pre-training architectures of large language models encompass various types, including autoencoding models, autoregressive models, and encoder-decoder models. We posit that any…