output
20122026
most citedMLlib: Machine Learning in Apache Spark

961 citations

Showing cs.LGShow all

7 papers · 1 filter

cs.LG2023★ 12 cited

Relax: Composable Abstractions for End-to-End Dynamic Machine Learning

Ruihang Lai, Junru Shao, Siyuan Feng +16

Dynamic shape computations have become critical in modern machine learning workloads, especially in emerging large language models. The success of these models has driven the deman…

cs.LG2020★ 47 cited

Counterfactual Evaluation of Slate Recommendations with Sequential Reward Interactions

James McInerney, Brian Brost, Praveen Chandar +2

Users of music streaming, video streaming, news recommendation, and e-commerce services often engage with content in a sequential manner. Providing and evaluating good sequences of…

cs.LG2019★ 17 cited

More Efficient Off-Policy Evaluation through Regularized Targeted Learning

Aurélien F. Bibaut, Ivana Malenica, Nikos Vlassis +1

We study the problem of off-policy evaluation (OPE) in Reinforcement Learning (RL), where the aim is to estimate the performance of a new policy given historical data that may have…

cs.LG2019★ 9 cited

Correlated Variational Auto-Encoders

Da Tang, Dawen Liang, Tony Jebara +1

Variational Auto-Encoders (VAEs) are capable of learning latent representations for high dimensional data. However, due to the i.i.d. assumption, VAEs only optimize the singleton v…

cs.LG2018★ 30 cited

Explaining Deep Learning Models - A Bayesian Non-parametric Approach

Wenbo Guo, Sui Huang, Yunzhe Tao +2

Understanding and interpreting how machine learning (ML) models make decisions have been a big challenge. While recent research has proposed various technical approaches to provide…

cs.LG2015★ 552 cited

Session-based Recommendations with Recurrent Neural Networks

Balázs Hidasi, Alexandros Karatzoglou, Linas Baltrunas +1

We apply recurrent neural networks (RNN) on a new domain, namely recommender systems. Real-life recommender systems often face the problem of having to base recommendations only on…

cs.LG2015★ 961 cited

MLlib: Machine Learning in Apache Spark

Xiangrui Meng, Joseph Bradley, Burak Yavuz +13

Apache Spark is a popular open-source platform for large-scale data processing that is well-suited for iterative machine learning tasks. In this paper we present MLlib, Spark's ope…