Fletch: File-System Metadata Caching in Programmable Switches

Abstract

Fast and scalable metadata management across multiple metadata servers is crucial for distributed file systems to handle numerous files and directories. Client-side caching of frequently accessed metadata can mitigate server loads, but it incurs significant overhead and complexity in maintaining cache consistency when the number of clients increases. We propose Fletch, an in-switch file-system metadata caching framework that leverages programmable switches to serve file-system metadata requests from multiple clients directly in the switch data plane. Unlike prior in-switch key-value caching systems, Fletch addresses file-system-specific path dependencies under stringent switch resource constraints. We implement Fletch atop HDFS and evaluate it on a Tofino-switch testbed using real-world filesystem metadata workloads. Fletch achieves up to 181.6% higher throughput than vanilla HDFS and complements client-side caching with throughput gains of up to 139.6% on 128 simulated metadata servers.

17 pages. Accepted by IEEE Transactions on Networking