563 citations
- FACE FoundationUS8 papers
- Stanford UniversityUS5 papers
- Cornell UniversityUS4 papers
- Massachusetts Institute of TechnologyUS4 papers
- Allen Institute for Artificial IntelligenceUS3 papers
- Carnegie Mellon UniversityUS3 papers
- Google (United States)US3 papers
- King Fahd University of Petroleum and MineralsSA3 papers
- Sorbonne UniversitéFR3 papers
- Allen InstituteUS2 papers
- Booz Allen Hamilton (United States)US2 papers
- École PolytechniqueFR2 papers
Showing 2023 · cs.CLShow all
2 papers · 2 filters
cs.CL2023★ 18 cited
Energy and Carbon Considerations of Fine-Tuning BERT
Xiaorong Wang, Clara Na, Emma Strubell +2
Despite the popularity of the `pre-train then fine-tune' paradigm in the NLP community, existing work quantifying energy costs and associated carbon emissions has largely focused o…
cs.CL2023★ 65 cited
The BigScience ROOTS Corpus: A 1.6TB Composite Multilingual Dataset
Hugo Laurençon, Lucile Saulnier, Thomas Wang +51
As language models grow ever larger, the need for large-scale high-quality text datasets has never been more pressing, especially in multilingual settings. The BigScience workshop,…