2 papers
cs.DC2024
Design and Implementation of an Analysis Pipeline for Heterogeneous Data
Arup Kumar Sarker, Aymen Alsaadi, Niranda Perera +8
Managing and preparing complex data for deep learning, a prevalent approach in large-scale data science can be challenging. Data transfer for model training also presents difficult…
cs.DC2023
Supercharging Distributed Computing Environments For High Performance Data Engineering
Niranda Perera, Kaiying Shan, Supun Kamburugamuwe +7
The data engineering and data science community has embraced the idea of using Python & R dataframes for regular applications. Driven by the big data revolution and artificial inte…