Approximating Human-Like Few-shot Learning with GPT-based Compression

Cynthia Huang, Yuqing Xie, Zhiying Jiang +2

In this work, we conceptualize the learning process as information compression. We seek to equip generative pre-trained models with human-like learning capabilities that enable dat…