An Exact Poly-Time Membership-Queries Algorithm for Extraction a three-Layer ReLU Network

Amit Daniely, Elad Granot

We consider the natural problem of learning a ReLU network from queries, which was recently remotivated by model extraction attacks. In this work, we present a polynomial-time algo…