BeanCounter: A low-toxicity, large-scale, and open dataset of business-oriented text

Siyan Wang, Bradford Levy

Many of the recent breakthroughs in language modeling have resulted from scaling effectively the same model architecture to larger datasets. In this vein, recent work has highlight…