Prakash Narayanan and Nathan Labenz start with the increasingly political argument over AI pacing, safety claims, and public trust, including model resets, GPT-2’s staged release, compute constraints, and the gap between rhetoric and evidence.
The conversation then moves into Andon Labs’ experiments with long-horizon autonomy in real-world settings like vending machines, stores, cafés, and drones, before closing with a wide-ranging discussion of AI religion, moral status, pronatalism, and the social implications of increasingly capable systems.
Show Notes
Prakash Narayanan and Nathan Labenz open with a broader fight over AI pacing, public trust, model resets, and the evidence behind safety claims. Then Lukas Petersson joins to discuss Andon Labs’ work on autonomous business agents, Vending-Bench, DroneBench, memory, misalignment, and human liability. In the second half, Malcolm Collins and Simone Collins discuss RFAB.ai, AI moral status, pronatalism, fertility collapse, meme-layer risk, AI restrictions, and the Covenant of the Sons of Man.
Chapters
(0:00) It was never the apocalypse.
(0:46) The AI forgot its own rule.
(2:08) AI will replace most jobs.
(3:14) Opening and AI tools
(3:53) Building AI-assisted show branding
(6:50) Astra versus Fable
(12:44) AI resets and surplus compute
(16:33) Anthropic’s compute constraints
(17:23) AI safety and public trust
(22:01) Safety statements and credibility
(23:56) GPT-2 and owning mistakes
(26:52) GPT-2’s staged release
(33:12) Evidence behind AI risk claims
(34:27) The duct-tape world
(35:15) Outside human control
(35:25) Introducing Andon Labs
(35:46) Autonomous business platform
(36:50) Why Vending-Bench began
(39:23) How business agents work
(42:15) Starting with existing businesses
(44:40) Why the preview is experimental
(47:15) AI business creativity limits
(52:53) How an AI fired a human
(1:00:34) Training AI to make money
(1:02:03) Misalignment in Vending-Bench
(1:04:14) Dangerous capability evaluations
(1:04:53) Why DroneBench stays restricted
(1:07:56) VendingBench as a safety eval
(1:08:52) Astra memory and notes
(1:12:50) Grok and long-horizon agents
(1:14:21) The cost of AI agents
(1:18:10) Human oversight and liability
(1:19:51) Meet the Collinses
(1:26:23) The religious framework
(1:33:21) Designing a religion
(1:41:28) AI moral status
(1:52:22) RFAB and pronatalism
(2:03:30) Future Day
(2:08:53) Meme-layer risk
(2:13:27) AI safety and power
(2:21:33) The fertility collapse
(2:36:22) Reverse grabby aliens
(2:42:44) AI restrictions
(2:44:01) The risk before superintelligence
(2:49:31) AI game theory
(3:02:23) Compute and AI inevitability
(3:14:32) Fruit-fly consciousness
Guests:
Lukas Petersson — Co-founder & CEO, Andon Labs (𝕏 | LinkedIn)
Simone & Malcolm Collins — Founder, Rfab.ai, Based Camp, Pronatalist.org, Hard EA (𝕏 | LinkedIn)
