Many Processors, Still One Computer: The Nested Parallel von Neumann Architecture and Nested BSP

Heng Liao

The contest in large-scale AI computing is no longer whether one processor can be made stronger, but whether a million of them can still behave as a single computer. This paper arg…