most citedScaling Studies for Efficient Parameter Search and Parallelism for Large Language Model Pre-training

1 citations · 1 across the 2 of their papers we have counts for

collaborators
Showing cs.DCShow all

2 papers · 1 filter

cs.DC2023★ 1 cited

Scaling Studies for Efficient Parameter Search and Parallelism for Large Language Model Pre-training

Michael Benington, Leo Phan, Chris Pierre Paul +5

AI accelerator processing capabilities and memory constraints largely dictate the scale in which machine learning workloads (e.g., training and inference) can be executed within a…

cs.DC2023

Compiler Optimization for Irregular Memory Access Patterns in PGAS Programs

Thomas B. Rolinger, Christopher D. Krieger, Alan Sussman

Irregular memory access patterns pose performance and user productivity challenges on distributed-memory systems. They can lead to fine-grained remote communication and the data ac…