Optimal Exact-Regenerating Codes for Distributed Storage at the MSR and MBR Points via a Product-Matrix Construction
arXiv:1005.4178 · doi:10.1109/TIT.2011.2159049
Abstract
Regenerating codes are a class of distributed storage codes that optimally trade the bandwidth needed for repair of a failed node with the amount of data stored per node of the network. Minimum Storage Regenerating (MSR) codes minimize first, the amount of data stored per node, and then the repair bandwidth, while Minimum Bandwidth Regenerating (MBR) codes carry out the minimization in the reverse order. An [n, k, d] regenerating code permits the data to be recovered by connecting to any k of the n nodes in the network, while requiring that repair of a failed node be made possible by connecting (using links of lesser capacity) to any d nodes. Previous, explicit and general constructions of exact-regenerating codes have been confined to the case n=d+1. In this paper, we present optimal, explicit constructions of MBR codes for all feasible values of [n, k, d] and MSR codes for all [n, k, d >= 2k-2], using a product-matrix framework. The particular product-matrix nature of the constructions is shown to significantly simplify system operation. To the best of our knowledge, these are the first constructions of exact-regenerating codes that allow the number n of nodes in the distributed storage network, to be chosen independent of the other parameters. The paper also contains a simpler description, in the product-matrix framework, of a previously constructed MSR code in which the parameter d satisfies [n=d+1, k, d >= 2k-1].
Submitted to IEEE Transactions on Information Theory. Contains 20 pages, 2 figures
Cited by in corpus (40)
- Speeding Up Distributed Machine Learning Using Codes
- A family of optimal locally recoverable codes
- Binary Cyclic Codes that are Locally Repairable
- Characterizing the Rate Region of the (4,3,3) Exact-Repair Regenerating Codes
- A Generic Transformation to Enable Optimal Repair in MDS Codes for Distributed Storage Systems
- Layered, Exact-Repair Regenerating Codes Via Embedded Error Correction and Block Designs
- Cooperative Local Repair in Distributed Storage
- The Storage vs Repair-Bandwidth Trade-off for Clustered Storage Systems
- Distributed Storage in Mobile Wireless Networks with Device-to-Device Communication
- A Framework of Constructions of Minimal Storage Regenerating Codes with the Optimal Access/Update Property
- HashTag Erasure Codes: From Theory to Practice
- Constructions and Properties of Linear Locally Repairable Codes
- Irregular Fractional Repetition Code Optimization for Heterogeneous Cloud Storage
- A Systematic Construction of MDS Codes With Small Sub-packetization Level and Near-Optimal Repair Bandwidth
- Codes between MBR and MSR Points with Exact Repair Property
- Cascade Codes For Distributed Storage Systems
- Optimal Storage Allocation for Wireless Cloud Caching Systems with a Limited Sum Storage Capacity
- Distributed Data Storage Systems with Opportunistic Repair
- Towards Practical Private Information Retrieval from MDS Array Codes
- Rack-Aware Regenerating Codes with Multiple Erasure Tolerance
- MSR Codes with Linear Field Size and Smallest Sub-packetization for Any Number of Helper Nodes
- A Generic Transformation for Optimal Node Repair in MDS Array Codes over
- Constructing MSR codes with subpacketization for helper nodes
- Fundamental Limits on Communication for Oblivious Updates in Storage Networks
- On the Duality and File Size Hierarchy of Fractional Repetition Codes
- Determinant Codes with Helper-Independent Repair for Single and Multiple Failures
- Multilinear Algebra for Distributed Storage
- Multilinear Algebra for Minimum Storage Regenerating Codes
- Security Concerns in Minimum Storage Cooperative Regenerating Codes
- PMDS Array Codes With Small Sub-packetization, Small Repair Bandwidth/Rebuilding Access
- Explicit Construction of Minimum Bandwidth Rack-Aware Regenerating Codes
- Constructing cooperative MSR codes with sub-packetization
- When and By How Much Can Helper Node Selection Improve Regenerating Codes?
- A Repair Framework for Scalar MDS Codes
- Latency optimal storage and scheduling of replicated fragments for memory-constrained servers
- A Connection Between Locally Repairable Codes and Exact Regenerating Codes
- Storage and Repair Bandwidth Tradeoff for Distributed Storage Systems with Clusters and Separate Nodes
- Generalized regenerating codes and node repair on graphs
- Multilevel Diversity Coding with Secure Regeneration: Separate Coding Achieves the MBR Point
- Field Trace Polynomial Codes for Secure Distributed Matrix Multiplication