Ep 264 Why Memory is the Unsung Hero of AI, with Thomas Coughlin

Ep 264 Why Memory is the Unsung Hero of AI, with Thomas Coughlin

33:10 Jul 26, 2025
About this episode
Guest: Dr. Tom Coughlin, President, Coughlin Associates, IEEE Past President (2025) Website: https://tomcoughlin.com FMS Conference: https://futurememorystorage.com/ Episode Summary: Join us for an enlightening conversation with Dr. Tom Coughlin, a seasoned digital storage analyst and consultant with over 40 years in the industry. Tom, the President of Coughlin Associates and former IEEE President, shares unparalleled insights into the foundational technologies shaping our digital world. We delve into the crucial role of memory in AI's development, the surprising realities of storage demand, and the fascinating world of breakthrough memory technologies. Discover why memory often gets overlooked in AI discussions, critical considerations for data privacy, and the global impact of the IEEE. Tom also previews the upcoming Future of Memory and Storage (FMS) conference and offers invaluable career advice for tech entrepreneurs. Key Discussion Points: Behind-the-Scenes of Storage Innovation: Tom shares a surprising story about the 25-year research journey behind HAMR technology now rolling out in HDDs. Evolving Storage Demands: Learn how SSDs have become primary data center storage and replaced HDDs in personal computers and consumer applications. Understand HDDs' shift to colder storage in data centers—this is their growth market, and much of the world’s data lives on HDDs. Discover magnetic tape's vital role in archiving and backing up cloud data. Explore new archive storage technologies being developed, such as optical recording and DNA storage. Memory's Critical Role in AI: Memory, particularly DRAM, is playing a big role in training AI models. Approaches are emerging that reduce the need for expensive DRAM (especially in HBM) for inference applications, using storage technologies like SSDs (e.g., Kioxia's AiSAQ for tuning LLMs). er optical storage or DNA for long-term data storage and preservation. Why Memory is Overlooked in AI: Insights into why people tend to focus more on processing (GPUs) than on the data itself, despite memory and storage advances being as impressive as those in GPUs. Data Privacy & Security in Storage: Essential considerations include having copies of data on immutable storage for ransomware recovery, using AI for anomaly detection on networked systems to prevent malware, and proper encryption use in storage systems for data security. The Global Impac
Select an episode
0:00 0:00