Section 4

Distributed Systems

Sharding, replication, CAP, consensus, distributed coordination, and how Kubernetes orchestrates the lot.

11 lessons ยท ~1.7 h reading

Core Concepts

4.1

Distributed Systems Overview

7 min โ†’

How simple systems become distributed systems whether you planned for it or not. The fallacies, the new problem categories, and the modern toolkit that makes it manageable.

4.2

Sharding and Replication

9 min โ†’

The two foundational techniques for scaling distributed data โ€” and how they combine. Single-leader, multi-leader, leaderless. Sharding strategies and the trade-offs.

4.3

CAP Theorem and Practical Implications

8 min โ†’

The fundamental trade-off โ€” and the more useful PACELC refinement. CP vs AP, what consistency actually means, and when the trade-off matters in practice.

4.4

Partitioning and Replication Strategies

9 min โ†’

How different database families scale โ€” relational, document, wide-column, key-value. The architectures, the strengths, and how to pick.

Coordination & Infrastructure

4.5

Distributed Consensus

9 min โ†’

How distributed systems agree without a coordinator. Paxos, Raft, ZAB, and PBFT โ€” the algorithms that power leader election, replicated logs, and atomic broadcast.

4.6

Distributed Coordination and Locking

9 min โ†’

Mutual exclusion across machines that don't share memory. The pitfalls, the safe patterns, and the trade-offs of Redis, Redlock, ZooKeeper, and etcd locks.

4.7

AWS Resource Hierarchy

9 min โ†’

A working tour of how AWS services compose โ€” Organizations, accounts, regions, AZs, compute, storage, security. The mental model for navigating the platform.

4.8

Data Architecture, Pipelines, and ETL

10 min โ†’

The data lifecycle in modern SaaS โ€” ingestion, storage, processing, security, ML. Lakes, warehouses, lakehouses, and the pipelines that connect them.

Kubernetes & Orchestration

4.9

Kubernetes Deep Dive

11 min โ†’

How Kubernetes actually works under the hood. Control plane, data plane, the reconciliation loop, scheduling, and the distributed-systems patterns that make it tick.

4.10

Kubernetes Resource Hierarchy

9 min โ†’

A working tour of the Kubernetes object model โ€” what each resource type is for, how they compose, and the patterns you'll see in production.

4.11

Kubernetes Networking

10 min โ†’

How packets actually flow in a Kubernetes cluster โ€” pod networking, services, ingress, CNI plugins, and the distributed-systems patterns underneath.

Start with 4.1 โ†’