HFRWKV: A High-Performance Fully On-Chip Hardware Accelerator for RWKV

Liu Shijie, Zeng Zhenghao, Jiao Han +1

RWKV is a modern RNN architecture that approaches the performance of Transformers, with the advantage of processing long contexts at a linear memory cost. However, its sequential c…