AI Can Grade the Transcript—Humans Grow the Coach with Doug Foltz

AI Can Grade the Transcript—Humans Grow the Coach with Doug Foltz

33:35 Mar 5, 2026
About this episode
Doug Foltz explains how he used AI to solve a real coach-development bottleneck: mentor coaching doesn't scale. By building a competency rubric and an AI "agent" that evaluates coaching transcripts, Doug's team reduced hours of expert analysis to minutes—then re-centered the human work where it matters most: reflection, agency, and a short mentor-coaching conversation. The bigger idea: "communal co-intelligence"—AI not just as a personal assistant, but as a tool that helps a whole coaching community preserve culture, build consistency, and scale development without losing what makes coaching human. Episode description How do you scale mentor coaching when you don't have the budget—or the hours? Doug Foltz (Content Engineering & Value Alignment Lead at Gloo, DMin candidate at Asbury, and longtime church-planting coach) shares how he built an AI-supported mentor-coaching loop: a detailed competency rubric + an AI evaluator that reviews transcripts in minutes. But Doug also warns about a hidden danger: AI can bypass reflection, which is essential for adult learning. So they intentionally added "friction" back into the process—reflection first, then AI feedback, then a short human coaching conversation. Along the way, Doug introduces a powerful concept: communal co-intelligence—AI that strengthens a community's shared language, values, and coaching culture. Key moments (timestamps) 0:02–1:20 – Who Doug is + why Brian calls him the "AI guy" 1:49–3:21 – The real problem: coaching training doesn't stick without mentor coaching 3:34–5:06 – Doug's solution: a rubric + AI agent that evaluates transcripts (levels 1–3) 6:44–8:15 – The twist: reflection is essential; AI can accidentally remove it 8:28–9:00 – The human loop: 15–20 minute mentor conversation after reflection + report 10:38–14:35 – Why AI matters: replaces 3–4 hours of expert analysis with minutes 15:04–16:15 – The church's role: protect what's uniquely human; set boundaries 16:27–19:16 – "Communal co-intelligence": AI + a coaching community's culture and standards 21:24–23:00 – What they observed: fast growth from Level 1 ? Lev
Select an episode
0:00 0:00