Distributed Storage Codes with Repair-by-Transfer and Non-achievability of Interior Points on the Storage-Bandwidth Tradeoff
arXiv:1011.2361 · doi:10.1109/TIT.2011.2173792
Abstract
Regenerating codes are a class of recently developed codes for distributed storage that, like Reed-Solomon codes, permit data recovery from any subset of k nodes within the n-node network. However, regenerating codes possess in addition, the ability to repair a failed node by connecting to an arbitrary subset of d nodes. It has been shown that for the case of functional-repair, there is a tradeoff between the amount of data stored per node and the bandwidth required to repair a failed node. A special case of functional-repair is exact-repair where the replacement node is required to store data identical to that in the failed node. Exact-repair is of interest as it greatly simplifies system implementation. The first result of the paper is an explicit, exact-repair code for the point on the storage-bandwidth tradeoff corresponding to the minimum possible repair bandwidth, for the case when d=n-1. This code has a particularly simple graphical description and most interestingly, has the ability to carry out exact-repair through mere transfer of data and without any need to perform arithmetic operations. Hence the term `repair-by-transfer'. The second result of this paper shows that the interior points on the storage-bandwidth tradeoff cannot be achieved under exact-repair, thus pointing to the existence of a separate tradeoff under exact-repair. Specifically, we identify a set of scenarios, termed `helper node pooling', and show that it is the necessity to satisfy such scenarios that over-constrains the system.
30 pages, 6 figures. Submitted to IEEE Transactions on Information Theory
References in corpus (7)
- Optimal Exact-Regenerating Codes for Distributed Storage at the MSR and MBR Points via a Product-Matrix Construction
- Distributed Data Storage with Minimum Storage Regenerating Codes - Exact and Functional Repair are Asymptotically Equally Efficient
- Enabling Node Repair in Any Erasure Code for Distributed Storage
- On the Existence of Optimal Exact-Repair MDS Codes for Distributed Storage
- Searching for Minimum Storage Regenerating Codes
- Homomorphic Self-repairing Codes for Agile Maintenance of Distributed Storage Systems
- Double Circulant Minimum Storage Regenerating Codes
Cited by in corpus (72)
- Characterizing the Rate Region of the (4,3,3) Exact-Repair Regenerating Codes
- Layered, Exact-Repair Regenerating Codes Via Embedded Error Correction and Block Designs
- The Storage vs Repair-Bandwidth Trade-off for Clustered Storage Systems
- Optimal Repair of MDS Codes in Distributed Storage via Subspace Interference Alignment
- Enabling Node Repair in Any Erasure Code for Distributed Storage
- Codes with Local Regeneration
- Towards Optimal Secure Distributed Storage Systems with Exact Repair
- Outer bounds for exact repair codes
- Cascade Codes For Distributed Storage Systems
- Codes between MBR and MSR Points with Exact Repair Property
- Distributed Data Storage Systems with Opportunistic Repair
- Regenerating Codes for Errors and Erasures in Distributed Storage
- On Minimizing Data-read and Download for Storage-Node Recovery
- On Weak Dress Codes for Cloud Storage
- Explicit MBR All-Symbol Locality Codes
- Minimum Storage Regenerating Codes For All Parameters
- Exact Minimum-Repair-Bandwidth Cooperative Regenerating Codes for Distributed Storage Systems
- Evaluation of Codes with Inherent Double Replication for Hadoop
- On the Duality and File Size Hierarchy of Fractional Repetition Codes
- Multilinear Algebra for Distributed Storage
- Determinant Codes with Helper-Independent Repair for Single and Multiple Failures
- Multi-Layer Transformed MDS Codes with Optimal Repair Access and Low Sub-Packetization
- Optimal Repair Layering for Erasure-Coded Data Centers: From Theory to Practice
- Exact-Regenerating Codes between MBR and MSR Points
- Security Concerns in Minimum Storage Cooperative Regenerating Codes
- Rate Region of the (4,3,3) Exact-Repair Regenerating Codes
- Enabling optimal access and error correction for the repair of Reed-Solomon codes
- A Piggybacking Design Framework for Read-and Download-efficient Distributed Storage Codes
- Cooperative Regenerating Codes
- Reconstruction and Repair Degree of Fractional Repetition Codes
- HFR Code: A Flexible Replication Scheme for Cloud Storage Systems
- Secure Partial Repair in Wireless Caching Networks with Broadcast Channels
- When and By How Much Can Helper Node Selection Improve Regenerating Codes?
- Optimized-Cost Repair in Multi-hop Distributed Storage Systems with Network Coding
- Exact-Repair Regenerating Codes Via Layered Erasure Correction and Block Designs
- Analysis and Construction of Functional Regenerating Codes with Uncoded Repair for Distributed Storage Systems
- Erasure Coding for Distributed Storage: An Overview
- Centralized Multi-Node Repair Regenerating Codes
- A Connection Between Locally Repairable Codes and Exact Regenerating Codes
- Quasi-cyclic Flexible Regenerating Codes
- Information-theoretically Secure Erasure Codes for Distributed Storage
- High-Rate Regenerating Codes Through Layering
- Storage codes -- coding rate and repair locality
- Optimal Fractional Repetition Codes and Fractional Repetition Batch Codes
- Generalized regenerating codes and node repair on graphs
- On Heterogeneous Regenerating Codes and Capacity of Distributed Storage Systems
- When Can Helper Node Selection Improve Regenerating Codes? Part I: Graph-Based Analysis
- The Storage-Repair-Bandwidth Trade-off of Exact Repair Linear Regenerating Codes for the Case
- Improved Upper Bounds on Systematic-Length for Linear Minimum Storage Regenerating Codes
- Optimal Fraction Repetition Codes for Access-Balancing in Distributed Storage
- Fractional repetition codes with flexible repair from combinatorial designs
- Three Stories on a Two-sided Coin: Index Coding, Locally Recoverable Distributed Storage, and Guessing Games on Graphs
- Optimal Rebuilding of Multiple Erasures in MDS Codes
- Repair for Distributed Storage Systems in Packet Erasure Networks
- Communication Cost for Updating Linear Functions when Message Updates are Sparse: Connections to Maximally Recoverable Codes
- Explicit Constructions of MBR and MSR Codes for Clustered Distributed Storage
- Bandwidth Cost of Code Conversions in Distributed Storage: Fundamental Limits and Optimal Constructions
- Cooperative Repair of Multiple Node Failures in Distributed Storage Systems
- Symmetry in Distributed Storage Systems
- Generalized piggybacking codes for distributed storage systems
- Data Secrecy in Distributed Storage Systems under Exact Repair
- Concurrent Regenerating Codes and Scalable Application in Network Storage
- Codes with Combined Locality and Regeneration Having Optimal Rate, and Linear Field Size
- On Universally Good Flower Codes
- Erasure Codes for Distributed Storage: Tight Bounds and Matching Constructions
- Multilevel Diversity Coding with Regeneration
- Local Codes with Cooperative Repair in Distributed Storage System
- Functional Broadcast Repair of Multiple Partial Failures in Wireless Distributed Storage Systems
- Applications of Common Information to Computing Functions
- Access-optimal Linear MDS Convertible Codes for All Parameters
- Novel Repair-by-Transfer Codes and Systematic Exact-MBR Codes with Lower Complexities and Smaller Field Sizes
- Achieving Secrecy Capacity of Minimum Storage Regenerating Codes for all Feasible Parameter Values