4 papers
RLScheduler: An Automated HPC Batch Job Scheduler Using Reinforcement Learning
Di Zhang, Dong Dai, Youbiao He +2
Today high-performance computing (HPC) platforms are still dominated by batch jobs. Accordingly, effective batch job scheduling is crucial to obtain high system efficiency. Existin…
A Cross-Layer Solution in Scientific Workflow System for Tackling Data Movement Challenge
Dong Dai, Robert Ross, Dounia Khaldi +4
Scientific applications in HPC environment are more com-plex and more data-intensive nowadays. Scientists usually rely on workflow system to manage the complexity: simply define mu…
A Software-Defined Approach for QoS Control in High-Performance Computing Storage Systems
Neda Tavakoli, Dong Dai, John Jenkins +3
High-performance computing (HPC) storage systems become increasingly critical to scientific applications given the data-driven discovery paradigm shift. As a storage solution for l…
Client-side Straggler-Aware I/O Scheduler for Object-based Parallel File Systems
Neda Tavakoli, Dong Dai, Yong Chen
Object-based parallel file systems have emerged as promising storage solutions for high-performance computing (HPC) systems. Despite the fact that object storage provides a flexibl…