2 papers
cs.DC2024
Design and Implementation of an Analysis Pipeline for Heterogeneous Data
Arup Kumar Sarker, Aymen Alsaadi, Niranda Perera +8
Managing and preparing complex data for deep learning, a prevalent approach in large-scale data science can be challenging. Data transfer for model training also presents difficult…
cs.DC2024
Workflow Mini-Apps: Portable, Scalable, Tunable & Faithful Representations of Scientific Workflows
Ozgur Ozan Kilic, Tianle Wang, Matteo Turilli +4
Workflows are critical for scientific discovery. However, the sophistication, heterogeneity, and scale of workflows make building, testing, and optimizing them increasingly challen…