MLKV: Efficiently Scaling up Large Embedding Model Training with Disk-based Key-Value Storage

Yongjun He, Roger Waleffe, Zhichao Han +8

Many modern machine learning (ML) methods rely on embedding models to learn vector representations (embeddings) for a set of entities (embedding tables). As increasingly diverse ML…