Rank Minimization over Finite Fields: Fundamental Limits and Coding-Theoretic Interpretations
arXiv:1104.4302 · doi:10.1109/TIT.2011.2178017
Abstract
This paper establishes information-theoretic limits in estimating a finite field low-rank matrix given random linear measurements of it. These linear measurements are obtained by taking inner products of the low-rank matrix with random sensing matrices. Necessary and sufficient conditions on the number of measurements required are provided. It is shown that these conditions are sharp and the minimum-rank decoder is asymptotically optimal. The reliability function of this decoder is also derived by appealing to de Caen's lower bound on the probability of a union. The sufficient condition also holds when the sensing matrices are sparse - a scenario that may be amenable to efficient decoding. More precisely, it is shown that if the n\times n-sensing matrices contain, on average, Ω(nlog n) entries, the number of measurements required is the same as that when the sensing matrices are dense and contain entries drawn uniformly at random from the field. Analogies are drawn between the above results and rank-metric codes in the coding theory literature. In fact, we are also strongly motivated by understanding when minimum rank distance decoding of random rank-metric codes succeeds. To this end, we derive distance properties of equiprobable and sparse rank-metric codes. These distance properties provide a precise geometric interpretation of the fact that the sparse ensemble requires as few measurements as the dense one. Finally, we provide a non-exhaustive procedure to search for the unknown low-rank matrix.
arXiv commentAccepted to the IEEE Transactions on Information Theory; Presented at IEEE International Symposium on Information Theory (ISIT) 2011
References in corpus (9)
- Guaranteed Minimum-Rank Solutions of Linear Matrix Equations via Nuclear Norm Minimization
- A Simpler Approach to Matrix Completion
- A Rank-Metric Approach to Error Control in Random Network Coding
- Guaranteed Rank Minimization via Singular Value Projection
- Communication over Finite-Field Matrix Channels
- Properties of codes in rank metric
- Coding for Network Coding
- Capacity Achieving Linear Codes with Random Binary Sparse Generating Matrices
- Unicity conditions for low-rank matrix recovery