SAUCE: Truncated Sparse Document Signature Bit-Vectors for Fast Web-Scale Corpus Expansion

Muntasir Wahed, Daniel Gruhl, Alfredo Alba +5

Recent advances in text representation have shown that training on large amounts of text is crucial for natural language understanding. However, models trained without predefined n…