activity
20102024
most citedIn Cloud, Can Scientific Communities Benefit from the Economies of Scale?

1 citations · 3 across the 4 of their papers we have counts for

collaborators
Showing cs.CLShow all

1 paper · 1 filter

cs.CL2024

A Method for Building Large Language Models with Predefined KV Cache Capacity

Zhonghua Yi, Ge Niu, Lei Wang +2

This paper introduces a novel approach, the Bounded-Cache Transformer (BCT), for building large language models with a predefined Key-Value (KV) cache capacity. The BCT addresses t…