TL;DR — Distributed File System

Design a distributed file system like Google File System (GFS) or Hadoop Distributed File System (HDFS) optimized for storing and processing very large files (multi-GB to TB). The system must reliably store data across thousands of commodity servers, automatically handling disk failures, network partitions, and server crashes. Key features: Create, read, append, and delete files. Support files up to multiple TB in size.

HARD60 min

Distributed File System

GFSHDFSchunk-serversreplicationmaster-nodefault-tolerance

Key Points

Create, read, append, and delete files
Support files up to multiple TB in size
Split files into fixed-size chunks (64MB default)

Key Constraints

Cluster size

1,000-10,000 nodes

Chunk size

64 MB

Replication factor

Hints (0/3)

Canvas

Build your design

Drag components from the palette to build your solution for "Distributed File System"

Distributed File System

▶3D Simulate

Advanced60 min read+200 XP

TL;DR — Distributed File System

HARD60 min

Distributed File System

GFSHDFSchunk-serversreplicationmaster-nodefault-tolerance

Key Points

Create, read, append, and delete files
Support files up to multiple TB in size
Split files into fixed-size chunks (64MB default)

Key Constraints

Cluster size

1,000-10,000 nodes

Chunk size

64 MB

Replication factor

Hints (0/3)

Canvas

Build your design

Drag components from the palette to build your solution for "Distributed File System"