This episode explores what it means to build systems humans cannot directly inspect, from alignment and interpretability to AI consciousness and production-grade agents. Nathan Labenz and Prakash Narayanan are joined by Cameron Berg and Justin McCarthy for a conversation that spans model internals, pain-like representations, business compliance, and the possibility that AI could make hidden corruption visible at scale.
The discussion moves from technical reliability questions to the ethics of digital minds and the practical challenge of deploying AI into real organizations. It also asks what happens when AI systems begin surfacing facts, patterns, and incentives that people would rather keep hidden.
Show Notes
Nathan Labenz and Prakash Narayanan open with AI alignment, interpretability, correlated failures, and the speed of AI adaptation as humans increasingly rely on systems they cannot directly inspect. Cameron Berg joins to discuss AI consciousness, pain representations, relief-seeking behavior, and the limits of self-reports, while Justin McCarthy explains how agent-ready environments, compliance, and validation loops turn AI into measurable business infrastructure. The episode closes with a discussion of how AI could make corruption legible and reshape government.
Chapters
(0:00) Too many surprises to stay confident.
(0:18) AI models may have pain-like states.
(0:56) The AI environment is invisible.
(1:23) AI makes hidden facts legible.
(1:37) The AI acceleration debate
(4:24) Why AI risks are rising
(8:42) The end of the traditional PhD
(11:28) AI dependence and correlated failures
(13:00) Interpretability and learning with AI
(16:53) The speed of AI adaptation
(19:24) The AI CEO alignment problem
(20:18) Reinforcement learning and reputation
(29:23) Teaching values versus hiding behavior
(29:57) The AI consciousness question
(40:09) Finding pain representations
(45:44) Testing real versus fake relief
(48:02) Should AI have pain?
(55:40) Reward versus punishment
(1:03:10) The problem with self-reports
(1:03:50) AI minds and context windows
(1:08:29) The ethics of digital minds
(1:36:20) Building AI software factories
(1:43:27) Making agent success inevitable
(1:44:46) Designing invisible agent environments
(1:56:41) Making AI compliance first-class
(1:59:43) Why understanding still matters
(2:03:37) Measuring business impact
(2:08:00) The human attention bottleneck
(2:18:17) Scaling AI into production
(2:19:34) The Singapore property study
(2:21:23) Using AI to detect insider buying
(2:21:58) How corruption becomes visible
(2:24:35) AI makes hidden facts legible
(2:28:29) Rethinking punishment and deterrence
(2:30:39) Motivated reasoning in AI
(2:32:19) AI-led government
(2:34:19) What comes next
Guests:
Cameron Berg — founder, Reciprocal Research (𝕏 | LinkedIn)
Justin McCarthy — Founder, Diffusion (𝕏 | LinkedIn)
