RWKV-edge: Deeply Compressed RWKV for Resource-Constrained Devices

Wonkyo Choe, Yangfeng Ji, Felix Xiaozhu Lin

To deploy LLMs on resource-contained platforms such as mobile robots and smartphones, non-transformers LLMs have achieved major breakthroughs. Recently, a novel RNN-based LLM famil…