Hierarchical GPT with Congruent Transformers for Multi-Sentence Language Models

Jihyeon Roh, Huiseong Gim, Soo-Young Lee

We report a GPT-based multi-sentence language model for dialogue generation and document understanding. First, we propose a hierarchical GPT which consists of three blocks, i.e., a…