The Lustre Storage Architecture

Abstract

This lengthy document often referred to as the "Lustre Book", contains a detailed outline of Lustre file system architecture, as it was created between 2001 and 2005, in accordance with the requirements from various users. Now, in 2019, most features have been implemented, but some only recently, and some along different lines of thought.

Cited by in corpus (10)

• Interactive Supercomputing on 40,000 Cores for Machine Learning and Data Analysis
• PageRank Pipeline Benchmark: Proposal for a Holistic System Benchmark for Big-Data Platforms
• A Container-Based Workflow for Distributed Training of Deep Learning Algorithms in HPC Clusters
• Node-Based Job Scheduling for Large Scale Simulations of Short Running Jobs
• Exploring Object Stores for High-Energy Physics Data Storage
• AI Enabling Technologies: A Survey
• Two-Chains: High Performance Framework for Function Injection and Execution
• DIAL: Decentralized I/O AutoTuning via Learned Client-side Local Metrics for Parallel File System
• Comparative Analysis of Distributed and Parallel File Systems' Internal Techniques
• Technical Report: Developing a Working Data Hub