Great Power, Great Responsibility: Recommendations for Reducing Energy for Training Language Models

Joseph McDonald, Baolin Li, Nathan Frey +3

The energy requirements of current natural language processing models continue to grow at a rapid, unsustainable pace. Recent works highlighting this problem conclude there is an u…