🔊CEOInterviews

Ion Stoica on AI coding agents

From Distributed systems to AI platforms with Mark Russinovich & Ion Stoica | BRK227 · · Microsoft Developer

“I do think that actually the biggest challenge is that, and this is, it's about how do you know that the code which is generated is going to work correctly for some kind of definition of correctness, right? Is doing what you hope you want to do, right? I think that's the key, right? And the more code degenerates, the harder is to do that, right? Because and and I think this was, you know, this is also was true before, right? Everyone here probably developed a production system, right? Or has been involved in developing a production system. Where do you spend most of the time? You don't spend in the time or most of the time in prototyping or writing the code. You do spend the time in kind of even saying, you know, debugging then maintaining the code. It's easily 12:50 effort. So in some sense what this coding agents are doing are going to commoditize that kind of writing the code, but the bottleneck will be more and more in kind of verifying.”

Ion Stoica
Cofounder, Databricks
AI coding agentssoftware developmentcode verification

On , Ion Stoica, Cofounder at Databricks, spoke about AI coding agents during Distributed systems to AI platforms with Mark Russinovich & Ion Stoica | BRK227 on Microsoft Developer.

Distributed systems to AI platforms with Mark Russinovich & Ion Stoica | BRK227
Watch on YouTube at 34:57
Distributed systems to AI platforms with Mark Russinovich & Ion Stoica | BRK227
Microsoft Developer
Watch on YouTube at 34:57
What will it take to build AI platforms for the agent era? Join Azure CTO Mark Russinovich and UC Berkeley professor Ion Stoica (co-creator of Apache Spark and co-founder of Databricks and Anyscale) to explore how AI infrastructure must evolve as systems become agentic, multimodal, and globally distributed. Get practical insights on next generation architectures, from training to real time serving, and why open source, security, and governance are now core platform concerns. Seating for this session is first-come, first-served. Add it to your schedule to plan your day and arrive early to secure a spot. To learn more, please check out these resources: https://aka.ms/build26/BRK227 𝗦𝗽𝗲𝗮𝗸𝗲𝗿𝘀: Mark Russinovich Ion Stoica 𝗦𝗲𝘀𝘀𝗶𝗼𝗻 𝗜𝗻𝗳𝗼𝗿𝗺𝗮𝘁𝗶𝗼𝗻: This is one of many sessions from the Microsoft Build 2026 event. View even more sessions on-demand and learn about Microsoft Build at https://build.microsoft.com BRK227 | English (US) | Cloud platform & data Breakout | (200) Intermediate #MSBuild Chapters: 0:00 - Introduction and session overview at BUILD conference 00:00:36 - Speaker backgrounds and history in AI systems such as Spark, Ray, and VLLM 00:04:07 - Discussion on fundamentals of distributed systems applied to AI infrastructure 00:10:19 - Evolution of data centers and rise of large-scale AI supercomputing regions 00:13:33 - Modern serverless computing and its role in AI workloads 00:14:25 - Emergence of agentic AI systems and architectural implications 00:19:31 - Optimization layers in AI infrastructure: algorithms, hardware, and architecture 00:22:03 - Open source AI infrastructure stack and challenges of cross-layer optimization 00:29:30 - Security, confidential computing, and protecting sensitive AI data 00:34:48 - Developer experience, code verification challenges, and discussion on future automation limits
Ion Stoica

About Ion Stoica

Cofounder · Databricks

Ion Stoica, cofounder of Databricks and executive chair of Anyscale, spoke at a June 2026 conference about reliability as a major barrier to enterprise AI adoption. He argued that AI systems, particularly those using large language models, lack clear specifications and are difficult to debug because they function as black boxes. Stoica noted that moving an AI feature from prototype to production requires 10 to 50 times more resources than prototyping, and he cited a paper from Stanford and comments by Dario Amodei to support his view that ensuring AI agents are safe, reliable, and predictable is a central challenge. He also discussed LM Arena, a platform he helped create that has hosted over 250 million conversations and evaluates more than 700 models, and presented research showing that excessive use of emojis in AI responses is negatively correlated with user preference. In a May 2026 conversation with UC Berkeley professor Shankar Sastry, Stoica reflected on the founding of Databricks and the current state of AI. He described the proprietary model landscape as inefficient in its use of human capital, with engineers having little incentive to share knowledge. Stoica also commented on humanoid robots, saying the premise is "huge" but that it will take time for the technology to become profitable. He called for universities to adapt to the changing AI landscape and argued that federal taxpayer money should serve as "patient capital" for long-term research, rather than forcing the capitalist system to be more patient.

Profile compiled from Ion Stoica's verified public interviews and appearances. See all quotes & transcripts →

More from Ion Stoica Full Transcript Explore All Executives