Goodfire co-founder and CTO Dan Balsam returns to discuss where interpretability research now stands and to introduce Silico, the $1,000-per-month research platform Goodfire built for itself. He and Nathan explore Predictive Data Debugging, including the idea that fine-tuning and RL often amplify behaviors already latent in pre-training, and that interpretability can identify the data and features driving unwanted updates. The conversation centers on concept manifolds: Dan argues that models do not store concepts as simple one-hot features, but as sparse mixtures of meaningful subspaces whose geometry determines what kinds of steering and control work. The stakes are practical as well as conceptual, from debugging training data and RL to understanding why steering can fail off-manifold and why modern interpretability may be moving beyond its reputation as a toy-model science.
Silico: https://www.goodfire.com/silico
Predictive data debugging: https://www.goodfire.com/research/predictive-data-debugging#
Neural Geometry: https://www.goodfire.com/research/the-world-inside-neural-networks#
For full show notes, links, and references, read the episode page:https://www.cognitiverevolution.ai/thinking-in-silico-goodfire-cto-dan-balsam-on-concept-manifolds-a-1000-month-ml-research-agent/
Sponsor:
Claude:
Claude by Anthropic is an AI collaborator that understands your workflow and helps you tackle research, writing, coding, and organization with deep context. Get started with Claude and explore Claude Pro at https://claude.ai/tcr
CHAPTERS:
(00:00) About the Episode
(03:22) Predictive data debugging
(12:36) Concept manifold geometry
(21:22) Finding concept manifolds (Part 1)
(21:28) Sponsor: Claude
(22:57) Finding concept manifolds (Part 2)
(33:24) Factoring model internals
(49:32) Introducing Silico platform
(57:10) Research taste and credits
(01:06:19) Silico research use cases
(01:16:37) Skills and open models
(01:24:57) Guardrails and bio risk
(01:32:09) Training interventions and monitoring
(01:42:04) Grants and AI consciousness
(01:50:41) Episode Outro
(01:55:47) Outro
PRODUCED BY:
https://aipodcast.ing
SOCIAL LINKS:
Website: https://www.cognitiverevolution.ai
Twitter (Podcast): https://x.com/cogrev_podcast
Twitter (Nathan): https://x.com/labenz
LinkedIn: https://linkedin.com/in/nathanlabenz/
Youtube: https://youtube.com/@CognitiveRevolutionPodcast
Apple: https://podcasts.apple.com/de/podcast/the-cognitive-revolution-ai-builders-researchers-and/id1669813431
Spotify: https://open.spotify.com/show/6yHyok3M3BjqzR0VB5MSyk
