This week

Reading digest · 2026-10-09 to 2026-10-16

Most of this week's best reads are about AI, and they approach it from different distances. Astral Codex Ten's "AI Safety Is Not A Corporate Plot" is the strongest of the group: it argues from the record that lab leaders raised extinction concerns before their companies existed, and that calls for slowdowns hurt valuations rather than help them. "The 'Last Mile' Problem in AI Safety" (3 Quarks Daily) takes up the communication side, arguing that advocates should describe concrete physical harms like engineered pathogens and infrastructure attacks instead of sci-fi abstractions. Noahpinion's "AI vs. the railroads" covers the financial side, noting that data center capex now rivals the 19th-century railroad buildout and is increasingly funded by debt.

Two LessWrong pieces on China, "Headwinds Everywhere (in the Chinese AI Safety Field)" and "A Chinese Perspective on 'On Social Reality in China'", show how funding rules, censorship and geoblocking limit safety work there and correct some Western assumptions. For technical depth, "You Should Specify Your Code Unambiguously (and Prove That You Did)" uses LLMs with Lean proofs to produce verified Rust, and its Gzip result is concrete. "What's up with GPT's welfare?" and "Three perspectives on corrigibility" look at how models describe themselves and whether they stay correctable. The latter is useful but held back by formatting problems.

Outside AI, Aeon's "The ladder of knowledge" reads Gödel's incompleteness as the open-ended extensibility of reasoning, and Quanta's "How Do Fungi Keep the Planet Healthy?" shows brainless organisms trading like market actors. "AI #190: Scion of the Times" is a link roundup worth skimming, and "Exploring Intrapersonal Game Theory" is interesting but rough in presentation.

AI safety argumentsAI economics and bubble riskAI governance in ChinaVerified code with LLMsModel self-reports and corrigibilityPhilosophy and biology

Best reads by category

AI safety

Software verification

Philosophy

AI governance

Social science

AI welfare

Economics

AI alignment

AI industry

Biology

Game theory