Ion Stoica on system design
From Ion Stoica, Berkeley: Reliability, an AI challenge · · The AI Conference™
“It turns out that yes, the power of the LLMs can be a problem, but it's not the only problem. Like I mention specification and system designs are also issues. For instance, here if we are going to change a little bit the protocol and we add a explicit step that the co should make the decision right after the between the co and the CPO, the accuracy increases by 9.5%.”
On , Ion Stoica, Cofounder at Databricks, spoke about system design during Ion Stoica, Berkeley: Reliability, an AI challenge on The AI Conference™.
About Ion Stoica
Ion Stoica, cofounder of Databricks and executive chair of Anyscale, spoke at a June 2026 conference about reliability as a major barrier to enterprise AI adoption. He argued that AI systems, particularly those using large language models, lack clear specifications and are difficult to debug because they function as black boxes. Stoica noted that moving an AI feature from prototype to production requires 10 to 50 times more resources than prototyping, and he cited a paper from Stanford and comments by Dario Amodei to support his view that ensuring AI agents are safe, reliable, and predictable is a central challenge. He also discussed LM Arena, a platform he helped create that has hosted over 250 million conversations and evaluates more than 700 models, and presented research showing that excessive use of emojis in AI responses is negatively correlated with user preference. In a May 2026 conversation with UC Berkeley professor Shankar Sastry, Stoica reflected on the founding of Databricks and the current state of AI. He described the proprietary model landscape as inefficient in its use of human capital, with engineers having little incentive to share knowledge. Stoica also commented on humanoid robots, saying the premise is "huge" but that it will take time for the technology to become profitable. He called for universities to adapt to the changing AI landscape and argued that federal taxpayer money should serve as "patient capital" for long-term research, rather than forcing the capitalist system to be more patient.