About this episode
Managing modern data platforms means navigating a web of complex infrastructure, competing team needs and evolving security standards. For data teams to truly thrive, infrastructure must become both accessible and compliant without sacrificing velocity or reliability.In this episode, we’re joined by Cory O’Daniel, CEO and Co-Founder at Massdriver, and Jacob Ferriero, Senior Software Engineer at Astronomer, to unpack what it takes to make data platform engineering scalable, sustainable and secure. They share lessons from years of experience working with DevOps, ML teams and platform engineers and discuss how Airflow fits into the orchestration layer of today’s data stacks.Key Takeaways:(03:27) Making infrastructure accessible without deep ops knowledge.(07:23) Distinct personas and responsibilities across data teams.(09:53) Infrastructure hurdles specific to ML workloads.(11:13) Compliance and governance shaping platform design.(13:27) Tooling mismatches between teams cause friction.(15:13) Airflow’s orchestration role within broader system architecture.(22:10) Creating reusable infrastructure patterns for consistency.(24:13) Enabling secure access without slowing down development.
