CEOInterviews.AI
Start App
Ion Stoica
Cofounder, Databricks

Meta Can Read Your Brain, The AI Science Race & AI Ranking With Ion Stoica | Lightwork

📅 Jul 06, 2026 Lightspeed Venture Partners 56 MIN 39 SEGMENTS · 4 SPEAKERS
Claire Zau and Josh Machiz break down a week where AI pushed into two of the most consequential spaces yet: the human brain ...

What Ion Stoica said

Written from the verified transcript and checked against it. Every figure links to the moment it was said.

Ion Stoica, cofounder of Databricks and Arena, discussed how Arena began as a side project from fine-tuning Llama with ShareGPT data to create Vicuna, evolving into a battle mode where users vote on randomized LLM outputs. He explained Arena's Elo-based rating system, efforts to filter bots and low-quality votes, and the distinction between objective and subjective tasks. Stoica detailed Agent Mode, which evaluates agents by analyzing interaction traces and signals like task completion. He emphasized neutrality as core to Arena's value, noting that trust aligns with their incentive to be a trusted referee. He stated that about 70% of prompts are new within three months, making overfitting impossible. On AGI, he called it ill-defined and said humans will remain in the loop. He announced crossing $100 million in annualized revenue in 8 months, selling evaluations to model providers and offering a free intelligent router. He highlighted reliability and cost-effectiveness as key research areas.

Key takeaways

  1. Arena crossed $100 million in annualized revenue within 8 months of product launch, selling evaluations to model providers.
  2. About 70% of prompts on Arena are new within three months, preventing overfitting to static benchmarks.
  3. Agent Mode evaluates agents using real tasks from real users, analyzing interaction traces for explicit and subtle signals.
  4. Stoica called AGI an ill-defined term and said humans will remain in the loop for the foreseeable future.

Numbers and commitments

FigureWhat it refers toTypeAt
$100 million annualized revenue crossed in 8 months metric 47:39
70% share of prompts new within three months metric 40:42
8 months time to reach $100 million annualized revenue timeline 47:39

Chapters

  1. 0:00Origin of Arena
  2. 27:08How Arena voting works
  3. 29:28Vote integrity and subjectivity
  4. 33:57Agent Mode evaluation
  5. 38:06Neutrality and trust
  6. 40:42Dynamic benchmarks and overfitting
  7. 43:47AGI and measurability
  8. 47:57Business model and revenue
  9. 51:19Research priorities

Questions asked in this interview

10
  1. 19:01What brought you back to the operating seat?
  2. 20:53And what did you see in the two founders you decided to partner with?
  3. 27:02For someone who's never used it, could you explain what happens when someone goes to Arena and passes a vote?
  4. 29:11How do you differentiate likability from actual quality?
  5. 33:46How do you assess an agent's performance?
  6. 37:51How do you stay neutral and be seen as neutral?
  7. 40:12How do you make sure you're picking the right measurements, especially when so much is at stake?
  8. 43:23If we play this out and reach AGI, is there a world where AI might not be measurable in the way that humans aren't measurable?
  9. 47:39Who's paying for it and what are they actually buying?
  10. 50:58What do you hope some of them build in the next couple decades?
Host 0:00 ↗
So, Claire, have you heard about the Ramageddon? I actually was warning about memory inflation back in December. Regular people will first experience the AI boom through higher prices on laptops, iPads, and MacBooks. I explain it with a steakhouse analogy: memory players like Samsung, SK Hynix, Micron have limited capacity and are switching from low-margin regular memory to high-margin high bandwidth memory for AI, driving up prices.
Claire 1:54 ↗
Makes sense. Why flip burgers when you can sell steaks.
Host 2:25 ↗
We're back with another big week. Meta has developed a model to read your brain without an implant. The biggest AI labs are racing into scientific discovery. Then we sit down with Ion Stoica, the Berkeley professor behind Databricks, AnyScale, and Apache Spark to get into Arena. Then we close some deals.
Josh, did you hear that Meta is trying to read our minds now?
Josh 2:52 ↗
I feel like most people think Meta's been reading our minds. They released Brain2Text, a system that decodes non-invasive brain recordings in real time using a MEG scanner. It hit 61% average word accuracy, a massive jump from 8% in prior methods. They frame it as a path to help millions with brain lesions. There are also visions for wearables and ads, but the immediate use case is medical. It's pretty hardware heavy, not scalable yet.
Host 3:59 ↗
I always think about the dystopian sides. Who owns your thoughts? Will there be policy around that?
Josh 4:07 ↗
Regular consumers trade off convenience. Would you let Meta read your brain to avoid typing? That's an interesting UI shift, but also an ad vision. A lot of people are skeptical. Meta open sourced this, likely because it's a long-term medical endeavor. The MEG scanner is huge and expensive, so it's not coming tomorrow. But if scaled down to glasses, it could change interaction.
Host 4:24 ↗
It was pretty interesting that Meta open sourced this. Why did they do that?
Josh 4:28 ↗
My sense is this will be a medical endeavor for the short and medium term. It's hardware heavy, not scalable. Each scanner costs millions and weighs as much as a small car. So we don't have to ring alarm bells tomorrow, but we should prepare for the slippery slope.
Host 4:52 ↗
Yeah, I think that's when it becomes dangerous when you have a device on your head. But there are regulatory responses: Chile introduced neural rights in 2021, and France and Germany are drafting laws to ban mandatory neurotech in employment. So it's moving quickly but not tomorrow.
Josh 5:11 ↗
Yeah, I think for now I'd like to maintain my mental privacy, but I'm open to it down the line.
Host 5:17 ↗
Claire, Anthropic announced Claude Science. What is it and what are the implications for the scientific industry?
Claire 5:20 ↗
Claude Science is an AI workbench for scientists, launched in beta. It integrates into tools, databases, and packages researchers use, and produces auditable artifacts. The innovation is at the product level, not a new model. It connects disparate workflows. For example, a researcher studying why a cancer drug stops working has to go through PubMed, multiple datasets, and code. Claude Science has over 60 built-in integrations. It also solves reproducibility by providing the full chat history and data accessed. Compared to OpenAI's GPT Rosalind, which is a new specialist model for biology, and Google's AlphaFold family, Anthropic is building a product that connects existing tools. The hope is to co-develop drugs with pharma, which is a high-margin buyer. The current drug discovery process is inefficient: a single drug costs $2.6 billion and takes 10-15 years, with 90% failure. AI can tackle the front end of discovery and optimization.
Host 6:34 ↗
Do you think that Claude Science can do what they did with Cloud Code and develop the surface where the scientific community wants to work?
Claire 6:39 ↗
I think that's the hope. I haven't tried it yet, but there's promise. The Anthropic team is savvy with product. All three labs are going after this because of the impact and the big buyer in pharma. Pharma is a super high margin buyer, and switching costs are low for developers but heavy for scientists. If they nail this, they could co-develop drugs.
Host 18:25 ↗
Our guest today is one of the most quietly influential people in computing. Ion Stoica is a Berkeley professor who has spent 25 years turning university research into infrastructure that the AI industry runs on. He co-founded Databricks, AnyScale, and is behind Apache Spark and Ray. He also co-founded and chairs Arena, which began as Chatbot Arena in his Berkeley lab and became the most watched scoreboard in AI. Ion, welcome to Light Work.
We know that Arena started as a research project out of Berkeley in 2023. You're well known for spinning four companies out of your lab, and this fall you're going back to teaching undergrad. What brought you back to the operating seat?
Ion Stoica 19:28 ↗
Everything in my mind is about having a positive impact. By impact I mean doing something that can make life better for some people, building software tools that help people do their job faster and better, or providing a better understanding of how to use tools. In academia and industry, it's about maximizing that impact. Sometimes projects turn into companies to maximize that impact.
Host 20:53 ↗
Zooming back to the Berkeley days, when did you realize this could be something big? And what did you see in the two founders you decided to partner with?
Ion Stoica 21:03 ↗
It started as a side project of another project. When Llama from Meta was released, a group of my students took high-quality data from ShareGPT and fine-tuned Llama to create Vicuna. We deployed it as a chatbot. Then the question was how to show it was better. Static benchmarks didn't capture real human interaction. That's how Arena was born: a battle mode where users ask questions and get answers from two randomized LLMs, then vote which is better. For a long time it was just a measurement project, but it gained traction. Model providers started using it to show performance. It became clear it was an important part of the ecosystem, but it was costly to run. We considered a foundation, but the numbers didn't add up, so we created a company.

19 more exchanges in this transcript

Sign in free to read the rest of this interview. No card required.

Sign in to read the full transcript

Cite this transcript

APA, MLA, BibTeX
APA

Stoica, I. (2026, July 6). Meta Can Read Your Brain, The AI Science Race & AI Ranking With Ion Stoica | Lightwork [Interview transcript]. Lightspeed Venture Partners. CEOInterviews.AI. https://ceointerviews.ai/interview/1065066/

MLA

Ion Stoica. "Meta Can Read Your Brain, The AI Science Race & AI Ranking With Ion Stoica | Lightwork." Lightspeed Venture Partners, 6 Jul. 2026. Transcript, CEOInterviews.AI, https://ceointerviews.ai/interview/1065066/.

BibTeX
@misc{stoica2026_1065066,
  author       = {Ion Stoica},
  title        = {Meta Can Read Your Brain, The AI Science Race \& AI Ranking With Ion Stoica | Lightwork},
  howpublished = {Interview transcript, Lightspeed Venture Partners. CEOInterviews.AI},
  year         = {2026},
  month        = {jul},
  url          = {https://ceointerviews.ai/interview/1065066/},
  note         = {Speaker-attributed transcript with timestamps}
}