ROCS: Request-Oriented Compute Sharing for Efficient Large-Scale Recommendation

Yuxin Chen, Liang Luo, Buyun Zhang +44

The paper introduces ROCS, a request-oriented compute sharing framework that restructures recommendation inference to evaluate shared request features once per request rather than…