AI Inference Is a Data Movement Problem: Microsoft's Saurabh Dighe on the Maia 300
Microsoft's Maia 300 is a fully co-designed system, optimized to solve the memory-bound "data movement problem" of emerging agentic AI workloads. Saurabh Dighe, Corporate VP of Azure Hardware Systems at Microsoft, sits down with Austin to detail the architecture, from its TSMC N2P chiplet design enabling 18 TB/s of HBM4 memory bandwidth to its use of AI agents for automated kernel optimization. They discuss how this full-stack approach aims to maximize intelligence per watt and per dollar for Microsoft's planet-scale services. This episode is presented by @CrusoeAI. Crusoe's Serverless Fi…