In-context Autoencoder for Context Compression in a Large Language Model

Tao Ge, Jing Hu, Lei Wang +3

We propose the In-context Autoencoder (ICAE), leveraging the power of a large language model (LLM) to compress a long context into short compact memory slots that can be directly c…