activity
20202026
most citedNear-Optimal SQ Lower Bounds for Agnostically Learning Halfspaces and ReLUs under Gaussian Marginals

10 citations · 53 across the 28 of their papers we have counts for

collaborators
Showing cs.LGShow all

26 papers · 1 filter

cs.LG2025

Robustly Learning Monotone Single-Index Models

Puqian Wang, Nikos Zarifis, Ilias Diakonikolas +1

We consider the basic problem of learning Single-Index Models with respect to the square loss under the Gaussian distribution in the presence of adversarial label noise. Our main c…

cs.LG2025

Robust Learning of Multi-index Models via Iterative Subspace Approximation

Ilias Diakonikolas, Giannis Iakovidis, Daniel M. Kane +1

We study the task of learning Multi-Index Models (MIMs) with label noise under the Gaussian distribution. A -MIM is any function that only depends on a -dimensional subsp…

cs.LG2025

Robustly Learning Monotone Generalized Linear Models via Data Augmentation

Nikos Zarifis, Puqian Wang, Ilias Diakonikolas +1

We study the task of learning Generalized Linear models (GLMs) in the agnostic model under the Gaussian distribution. We give the first polynomial-time algorithm that achieves a co…

cs.LG2025

A Near-optimal Algorithm for Learning Margin Halfspaces with Massart Noise

Ilias Diakonikolas, Nikos Zarifis

We study the problem of PAC learning -margin halfspaces in the presence of Massart noise. Without computational considerations, the sample complexity of this learning problem is…

cs.LG2024

Reliable Learning of Halfspaces under Gaussian Marginals

Ilias Diakonikolas, Lisheng Ren, Nikos Zarifis

We study the problem of PAC learning halfspaces in the reliable agnostic model of Kalai et al. (2012). The reliable PAC model captures learning scenarios where one type of error is…

cs.LG2024

Sample and Computationally Efficient Robust Learning of Gaussian Single-Index Models

Puqian Wang, Nikos Zarifis, Ilias Diakonikolas +1

A single-index model (SIM) is a function of the form , where is a known link function and …

cs.LG2024

Efficient Testable Learning of General Halfspaces with Adversarial Label Noise

Ilias Diakonikolas, Daniel M. Kane, Sihan Liu +1

We study the task of testable learning of general -- not necessarily homogeneous -- halfspaces with adversarial label noise with respect to the Gaussian distribution. In the testab…

cs.LG2024

Online Learning of Halfspaces with Massart Noise

Ilias Diakonikolas, Vasilis Kontonis, Christos Tzamos +1

We study the task of online learning in the presence of Massart noise. Instead of assuming that the online adversary chooses an arbitrary sequence of labels, we assume that the con…

cs.LG2024

Robustly Learning Single-Index Models via Alignment Sharpness

Nikos Zarifis, Puqian Wang, Ilias Diakonikolas +1

We study the problem of learning Single-Index Models under the loss in the agnostic model. We give an efficient learning algorithm, achieving a constant factor approximatio…

cs.LG2023

Agnostically Learning Multi-index Models with Queries

Ilias Diakonikolas, Daniel M. Kane, Vasilis Kontonis +2

We study the power of query access for the task of agnostic learning under the Gaussian distribution. In the agnostic model, no assumptions are made on the labels and the goal is t…

cs.LG2023

Self-Directed Linear Classification

Ilias Diakonikolas, Vasilis Kontonis, Christos Tzamos +1

In online classification, a learner is presented with a sequence of examples and aims to predict their labels in an online fashion so as to minimize the total number of mistakes. I…

cs.LG2023

Near-Optimal Bounds for Learning Gaussian Halfspaces with Random Classification Noise

Ilias Diakonikolas, Jelena Diakonikolas, Daniel M. Kane +2

We study the problem of learning general (i.e., not necessarily homogeneous) halfspaces with Random Classification Noise under the Gaussian distribution. We establish nearly-matchi…

cs.LG2023

Information-Computation Tradeoffs for Learning Margin Halfspaces with Random Classification Noise

Ilias Diakonikolas, Jelena Diakonikolas, Daniel M. Kane +2

We study the problem of PAC learning -margin halfspaces with Random Classification Noise. We establish an information-computation tradeoff suggesting an inherent gap between the…

cs.LG2023

SQ Lower Bounds for Learning Bounded Covariance GMMs

Ilias Diakonikolas, Daniel M. Kane, Thanasis Pittas +1

We study the complexity of learning mixtures of separated Gaussians with common unknown bounded covariance matrix. Specifically, we focus on learning Gaussian mixture models (GMMs)…

cs.LG2023

Robustly Learning a Single Neuron via Sharpness

Puqian Wang, Nikos Zarifis, Ilias Diakonikolas +1

We study the problem of learning a single neuron with respect to the -loss in the presence of adversarial label noise. We give an efficient algorithm that, for a broad famil…

cs.LG2023

Efficient Testable Learning of Halfspaces with Adversarial Label Noise

Ilias Diakonikolas, Daniel M. Kane, Vasilis Kontonis +2

We give the first polynomial-time algorithm for the testable learning of halfspaces in the presence of adversarial label noise under the Gaussian distribution. In the recently intr…

cs.LG2022★ 1 cited

Learning a Single Neuron with Adversarial Label Noise via Gradient Descent

Ilias Diakonikolas, Vasilis Kontonis, Christos Tzamos +1

We study the fundamental problem of learning a single neuron, i.e., a function of the form for monotone activations $σ:\mathbb{R}\ma…

cs.LG2021

Learning General Halfspaces with General Massart Noise under the Gaussian Distribution

Ilias Diakonikolas, Daniel M. Kane, Vasilis Kontonis +2

We study the problem of PAC learning halfspaces on with Massart noise under the Gaussian distribution. In the Massart model, an adversary is allowed to flip the labe…

cs.LG2021★ 2 cited

Agnostic Proper Learning of Halfspaces under Gaussian Marginals

Ilias Diakonikolas, Daniel M. Kane, Vasilis Kontonis +2

We study the problem of agnostically learning halfspaces under the Gaussian distribution. Our main result is the {\em first proper} learning algorithm for this problem whose sample…

cs.LG2021★ 3 cited

The Optimality of Polynomial Regression for Agnostic Learning under Gaussian Marginals

Ilias Diakonikolas, Daniel M. Kane, Thanasis Pittas +1

We study the problem of agnostic learning under the Gaussian distribution. We develop a method for finding hard families of examples for a wide class of problems by using LP dualit…

cs.LG2020★ 9 cited

A Polynomial Time Algorithm for Learning Halfspaces with Tsybakov Noise

Ilias Diakonikolas, Daniel M. Kane, Vasilis Kontonis +2

We study the problem of PAC learning homogeneous halfspaces in the presence of Tsybakov noise. In the Tsybakov noise model, the label of every sample is independently flipped with…

cs.LG2020★ 10 cited

Near-Optimal SQ Lower Bounds for Agnostically Learning Halfspaces and ReLUs under Gaussian Marginals

Ilias Diakonikolas, Daniel M. Kane, Nikos Zarifis

We study the fundamental problems of agnostically learning halfspaces and ReLUs under Gaussian marginals. In the former problem, given labeled examples from an un…

cs.LG2020★ 10 cited

Algorithms and SQ Lower Bounds for PAC Learning One-Hidden-Layer ReLU Networks

Ilias Diakonikolas, Daniel M. Kane, Vasilis Kontonis +1

We study the problem of PAC learning one-hidden-layer ReLU networks with hidden units on under Gaussian marginals in the presence of additive label noise. For th…

cs.LG2020★ 4 cited

Non-Convex SGD Learns Halfspaces with Adversarial Label Noise

Ilias Diakonikolas, Vasilis Kontonis, Christos Tzamos +1

We study the problem of agnostically learning homogeneous halfspaces in the distribution-specific PAC model. For a broad family of structured distributions, including log-concave d…