3 papers
cs.IT2025
Memory Complexity of Estimating Entropy and Mutual Information
Tomer Berg, Or Ordentlich, Ofer Shayevitz
We observe an infinite sequence of independent identically distributed random variables drawn from an unknown distribution over , and our goal is to estim…
cs.LG2024
Statistical Inference with Limited Memory: A Survey
Tomer Berg, Or Ordentlich, Ofer Shayevitz
The problem of statistical inference in its various forms has been the subject of decades-long extensive research. Most of the effort has been focused on characterizing the behavio…
cs.LG2024
Batches Stabilize the Minimum Norm Risk in High Dimensional Overparameterized Linear Regression
Shahar Stein Ioushua, Inbar Hasidim, Ofer Shayevitz +1
Learning algorithms that divide the data into batches are prevalent in many machine-learning applications, typically offering useful trade-offs between computational efficiency and…