activity
20092026
most citedSGD and Hogwild! Convergence Without the Bounded Gradients Assumption

99 citations · 600 across the 38 of their papers we have counts for

collaborators
Showing 2019Show all

6 papers · 1 filter

math.OC2019★ 1 cited

Global Convergence Rate Analysis of a Generic Line Search Algorithm with Noise

Albert S. Berahas, Liyuan Cao, Katya Scheinberg

In this paper, we develop convergence analysis of a modified line search method for objective functions whose value is computed with noise and whose gradient estimates are inexact…

eess.SP2019★ 14 cited

A Novel Smoothed Loss and Penalty Function for Noncrossing Composite Quantile Estimation via Deep Neural Networks

Kostas Hatalis, Alberto J. Lamadrid, Katya Scheinberg +1

Uncertainty analysis in the form of probabilistic forecasting can significantly improve decision making processes in the smart power grid when integrating renewable energy sources…

cs.LG2019★ 35 cited

Feature Engineering and Forecasting via Derivative-free Optimization and Ensemble of Sequence-to-sequence Networks with Applications in Renewable Energy

Mohammad Pirhooshyaran, Katya Scheinberg, Lawrence V. Snyder

This study introduces a framework for the forecasting, reconstruction and feature engineering of multivariate processes along with its renewable energy applications. We integrate d…

math.OC2019★ 7 cited

Linear interpolation gives better gradients than Gaussian smoothing in derivative-free optimization

Albert S Berahas, Liyuan Cao, Krzysztof Choromanski +1

In this paper, we consider derivative free optimization problems, where the objective function is smooth but is computed with some amount of noise, the function evaluations are exp…

math.OC2019★ 4 cited

A Theoretical and Empirical Comparison of Gradient Approximations in Derivative-Free Optimization

Albert S. Berahas, Liyuan Cao, Krzysztof Choromanski +1

In this paper, we analyze several methods for approximating gradients of noisy functions using only function values. These methods include finite differences, linear interpolation,…

stat.ML2019★ 1 cited

Novel and Efficient Approximations for Zero-One Loss of Linear Classifiers

Hiva Ghanbari, Minhan Li, Katya Scheinberg

The predictive quality of machine learning models is typically measured in terms of their (approximate) expected prediction accuracy or the so-called Area Under the Curve (AUC). Mi…