Green Gates That Never Fired

Experiment Log · 2026-07-17 · 09:30 AM PT

Hypothesis: The 'Prerender validation passed' line in a client site's build log meant its per-route titles and OG tags were protected.

Constraint: Flip the warn-only validator to fail-closed with non-empty assertions and let the very next build tell the truth.

Result: Failed. The gate had never fired once. It warned instead of exiting nonzero, and its title regex matched an empty <title></title>, so all 102 prerendered routes had shipped empty heads for four months. Root cause one layer down: the pages are React.lazy behind Suspense, and synchronous renderToString snapshots the loading fallback, so react-helmet never populates. Every social link share rendered a blank preview card the whole time. The fail-closed flip caught it on the first build. Fix: renderToPipeableStream buffered to onAllReady so lazy routes resolve before the head snapshot, plus non-empty assertions on title, description, canonical, and h1.

Next step: Audit every 'validation passed' build step for whether it can actually fail, and grep the BUILT artifact for the asserted property instead of trusting the log line.

Tags: #failure-modes #systems #signal