961 citations · 1.1k across the 10 of their papers we have counts for
5 papers · 1 filter
Embarrassingly Parallel Time Series Analysis for Large Scale Weak Memory Systems
Francois Belletti, Evan Sparks, Michael Franklin +1
Second order stationary models in time series analysis are based on the analysis of essential statistics whose computations follow a common pattern. In particular, with a map-reduc…
Matrix Computations and Optimization in Apache Spark
Reza Bosagh Zadeh, Xiangrui Meng, Aaron Staple +6
We describe matrix computations available in the cluster programming framework, Apache Spark. Out of the box, Spark provides abstractions and implementations for distributed matric…
Scientific Computing Meets Big Data Technology: An Astronomy Use Case
Zhao Zhang, Kyle Barbary, Frank Austin Nothaft +5
Scientific analyses commonly compose multiple single-process programs into a dataflow. An end-to-end dataflow of single-process programs is known as a many-task application. Typica…
MLlib: Machine Learning in Apache Spark
Xiangrui Meng, Joseph Bradley, Burak Yavuz +13
Apache Spark is a popular open-source platform for large-scale data processing that is well-suited for iterative machine learning tasks. In this paper we present MLlib, Spark's ope…
TuPAQ: An Efficient Planner for Large-scale Predictive Analytic Queries
Evan R. Sparks, Ameet Talwalkar, Michael J. Franklin +2
The proliferation of massive datasets combined with the development of sophisticated analytical techniques have enabled a wide variety of novel applications such as improved produc…