activity
20212024
most citedGreat Power, Great Responsibility: Recommendations for Reducing Energy for Training Language Models

60 citations · 129 across the 11 of their papers we have counts for

collaborators
Showing 2022Show all

5 papers · 1 filter

physics.ao-ph2022★ 1 cited

A Deep Learning-based Velocity Dealiasing Algorithm Derived from the WSR-88D Open Radar Product Generator

Mark S. Veillette, James M. Kurdzo, Phillip M. Stepanian +3

Radial velocity estimates provided by Doppler weather radar are critical measurements used by operational forecasters for the detection and monitoring of life-impacting storms. The…

cs.LG2022

An Evaluation of Low Overhead Time Series Preprocessing Techniques for Downstream Machine Learning

Matthew L. Weiss, Joseph McDonald, David Bestor +8

In this paper we address the application of pre-processing techniques to multi-channel time series data with varying lengths, which we refer to as the alignment problem, for downst…

cs.CL2022★ 60 cited

Great Power, Great Responsibility: Recommendations for Reducing Energy for Training Language Models

Joseph McDonald, Baolin Li, Nathan Frey +3

The energy requirements of current natural language processing models continue to grow at a rapid, unsustainable pace. Recent works highlighting this problem conclude there is an u…

cs.DC2022★ 4 cited

The MIT Supercloud Workload Classification Challenge

Benny J. Tang, Qiqi Chen, Matthew L. Weiss +24

High-Performance Computing (HPC) centers and cloud providers support an increasingly diverse set of applications on heterogenous hardware. As Artificial Intelligence (AI) and Machi…

cs.LG2022★ 2 cited

Benchmarking Resource Usage for Efficient Distributed Deep Learning

Nathan C. Frey, Baolin Li, Joseph McDonald +6

Deep learning (DL) workflows demand an ever-increasing budget of compute and energy in order to achieve outsized gains. Neural architecture searches, hyperparameter sweeps, and rap…