Part I — The Inference Problem

Before anything can be made fast, it must be made legible. Chapter 0 follows one request through one model worker to build concrete intuition; the remaining four chapters fix the vocabulary the rest of the book argues with: what work actually arrives, what a model creates and must remember, where computation and state can physically live, and what the service promised its users.

Chapters 0–4