A Highly Available, Fault-Tolerant Distributed Object Storage System
AetherFS is a custom-built distributed systems architecture designed to mirror the core infrastructure concepts of Amazon S3. Built with Python, FastAPI, and Docker, it orchestrates the chunking, parallel distribution, and replication of binary data across an isolated microservices cluster.
AetherFS utilizes an API Gateway to intercept network I/O, generating cryptographic checksums and dynamically routing file chunks to a cluster of storage nodes using a Consistent Hashing algorithm.
graph TD
Client[Client Browser/API] -->|POST /upload| Gateway(API Gateway)
Gateway -->|SHA-256 Hashing| Hashing[Consistent Hash Ring]
Hashing -->|Parallel Replication| NodeA[(Storage Node A)]
Hashing -->|Parallel Replication| NodeB[(Storage Node B)]
Hashing -->|Parallel Replication| NodeC[(Storage Node C)]