FlowNIB: An Information Bottleneck Analysis of Bidirectional vs. Unidirectional Language Models

Md Kowsher, Nusrat Jahan Prottasha, Shiyun Xu +4

Bidirectional language models have better context understanding and perform better than unidirectional models on natural language understanding tasks, yet the theoretical reasons b…