35 citations · 91 across the 12 of their papers we have counts for
15 papers
Is Weight Tying Still Beneficial for Decoder-Only LLMs in Private Settings Under DP-SGD?
Razan El Mais, Ali Chehab, Ibrahim Issa +1
Differentially Private Stochastic Gradient Descent (DP-SGD) is a leading approach for privacy-preserving fine-tuning of large language models (LLMs). Many decoder-only LLMs employ…
Sibson -Mutual Information and Its Variational Representations
Amedeo Roberto Esposito, Michael Gastpar, Ibrahim Issa
Information measures can be constructed from Rényi divergences much like mutual information from Kullback-Leibler divergence. One such information measure is known as Sibson -mu…
Total Variation Meets Differential Privacy
Elena Ghazi, Ibrahim Issa
The framework of approximate differential privacy is considered, and augmented by leveraging the notion of ``the total variation of a (privacy-preserving) mechanism'' (denoted by $…
Generalization Error Bounds for Noisy, Iterative Algorithms via Maximal Leakage
Ibrahim Issa, Amedeo Roberto Esposito, Michael Gastpar
We adopt an information-theoretic framework to analyze the generalization behavior of the class of iterative, noisy learning algorithms. This class is particularly suitable for stu…
Age Distribution in Arbitrary Preemptive Memoryless Networks
Rajai Nasser, Ibrahim Issa, Ibrahim Abou-Faycal
We study the probability distribution of age of information (AoI) in arbitrary networks with memoryless service times. A source node generates packets following a Poisson process,…
Strong Asymptotic Composition Theorems for Mutual Information Measures
Benjamin Wu, Aaron B. Wagner, Ibrahim Issa +1
We characterize the growth of the Sibson and Arimoto mutual informations and -maximal leakage, of any order that is at least unity, between a random variable and a growing set o…
Robust Generalization via -Mutual Information
Amedeo Roberto Esposito, Michael Gastpar, Ibrahim Issa
The aim of this work is to provide bounds connecting two probability measures of the same event using Rényi -Divergences and Sibson's -Mutual Information, a generalization of…
Generalization Error Bounds Via Rényi-, -Divergences and Maximal Leakage
Amedeo Roberto Esposito, Michael Gastpar, Ibrahim Issa
In this work, the probability of an event under some joint distribution is bounded by measuring it with the product of the marginals instead (which is typically easier to analyze)…
Strengthened Information-theoretic Bounds on the Generalization Error
Ibrahim Issa, Amedeo Roberto Esposito, Michael Gastpar
The following problem is considered: given a joint distribution and an event , bound in terms of (where is the product of the marginals…
A New Approach to Adaptive Data Analysis and Learning via Maximal Leakage
Amedeo Roberto Esposito, Michael Gastpar, Ibrahim Issa
There is an increasing concern that most current published research findings are false. The main cause seems to lie in the fundamental disconnection between theory and practice in…
An Operational Approach to Information Leakage
Ibrahim Issa, Aaron B. Wagner, Sudeep Kamath
Given two random variables and , an operational approach is undertaken to quantify the ``leakage'' of information from to . The resulting measure $\mathcal{L}(X \!\!…
Measuring Quantum Entropy
Jayadev Acharya, Ibrahim Issa, Nirmal V. Shende +1
The entropy of a quantum system is a measure of its randomness, and has applications in measuring quantum entanglement. We study the problem of measuring the von Neumann entropy, $…
Measuring Secrecy by the Probability of a Successful Guess
Ibrahim Issa, Aaron B. Wagner
The secrecy of a communication system in which both the legitimate receiver and an eavesdropper are allowed some distortion is investigated. The secrecy metric considered is the ex…
Two-Hop Interference Channels: Impact of Linear Schemes
Ibrahim Issa, Silas L. Fong, A. Salman Avestimehr
We consider the two-hop interference channel (IC), which consists of two source-destination pairs communicating with each other via two relays. We analyze the degrees of freedom (D…
Two-Hop Interference Channels: Impact of Linear Time-Varying Schemes
Ibrahim Issa, Silas L. Fong, A. Salman Avestimehr
We consider the two-hop interference channel (IC) with constant real channel coefficients, which consists of two source-destination pairs, separated by two relays. We analyze the a…