About this episode
Don’t let headlines about bubbles distract you from the real avenues of progress being explored in AI every week, including what had been thought to be a long-term blocker - continual learning (learning on the fly). https://app.grayswan.ai/ai-explainedThis, plus models introspecting (hesitate before you berate), Nano Banana 2 possibly spotted, Chinese imagen and more.AI Insiders ($9!): https://www.patreon.com/AIExplainedChapters:00:00 - Introduction01:26 - Continual Learning (Nested Learning / HOPE)07:00 - Introspection10:54 - Image-Gen ProgressNested Learning Post: https://research.google/blog/introducing-nested-learning-a-new-ml-paradigm-for-continual-learning/Nested Learning Paper: https://abehrouz.github.io/files/NL.pdfOriginal Titans Paper: https://arxiv.org/pdf/2501.00663Siri News: https://www.bloomberg.com/news/articles/2025-11-05/apple-plans-to-use-1-2-trillion-parameter-google-gemini-model-to-power-new-siriIntrospection: https://www.anthropic.com/research/introspectionFull Paper: https://transformer-circuits.pub/2025/introspection/index.html#mechanismsEarlier Work: https://www.anthropic.com/research/mapping-mind-language-modelhttps://transformer-circuits.pub/2024/scaling-monosemanticity/index.htmlRelease Post: https://x.com/AnthropicAI/status/1983584136972677319https://lmcouncil.ai Non-hype Newsletter: https://signaltonoise.beehiiv.com/Podcast: https://aiexplainedopodcast.buzzsprout.com/
