The Ingestion Tax: Adopting File-Backed Weights in Tensor Frameworks

Yuan Si, Yufeng Lin, Daming Li +1

Open-weight models can occupy a middle capacity regime: active weights fit in DRAM as cached file pages, but a second framework-owned representation does not fit or must be refille…