24 citations · 31 across the 3 of their papers we have counts for
3 papers
cs.LG2023★ 24 cited
Cerebras-GPT: Open Compute-Optimal Language Models Trained on the Cerebras Wafer-Scale Cluster
Nolan Dey, Gurpreet Gosal, Zhiming +6
We study recent research advances that improve large language models through efficient pre-training and scaling, and open datasets and tools. We combine these advances to introduce…
cs.LG2023★ 7 cited
SPDF: Sparse Pre-training and Dense Fine-tuning for Large Language Models
Vithursan Thangarasa, Abhay Gupta, William Marshall +5
The pre-training and fine-tuning paradigm has contributed to a number of breakthroughs in Natural Language Processing (NLP). Instead of directly training on a downstream task, lang…
cs.DS2020
Windowed Prophet Inequalities
William Marshall, Nolan Miranda, Albert Zuo
The prophet inequalities problem has received significant study over the past decades and has several applications such as to online auctions. In this paper, we study two variants…