CEOInterviews.AI
Start App
Matei Zaharia
Cofounder and CTO, Databricks

1st Spark: Alexy Khrabrov opens the very first Apache Spark meetup in the world with Matei Zaharia

📅 Aug 11, 2026 FunctionalTV 22 MIN 54 VIEWS 39 SEGMENTS · 16 SPEAKERS
On 12/12/2011, Alexy Khrabrov hosted the very first talk by Matei Zaharia at the Scala for Startups meetup at Klout. Alexy founded Scala for Startups and later merged it with SF Scala to build the world's largest Scala meetup. After hosting Matei, Alexy proposed establishing a new meetup, the Bay Area Spark Meetup, which they co-founded. This is the first Apache Spark meetup held at Klout soon after.

What Matei Zaharia said

Written from the verified transcript and checked against it. Every figure links to the moment it was said.

Matei Zaharia, cofounder and CTO of Databricks, opened the first Apache Spark meetup by introducing the AMP Lab at Berkeley, which develops Mesos and Spark. He explained Spark's goals: a general, efficient programming model with in-memory computing that can speed up algorithms 20 to 30 times. He described the stack, including Mesos for cluster management, Spark as the computing framework, and upper-level tools like Bagel (Pregel implementation) and Shark (Apache Hive port). He noted Shark would be released around the end of the month. He demonstrated Spark on EC2, showing how to run examples, use the Spark shell, and work with RDDs, transformations, and actions. He answered audience questions about unions, caching, JVM persistence, and fault tolerance, explaining that Spark recomputes lost data and tolerates node failures.

Key takeaways

  1. Spark can make algorithms 20 to 30 times faster through in-memory computing.
  2. Shark, a port of Apache Hive on Spark, is planned for release around the end of the month.
  3. Spark supports in-memory caching of RDDs, making repeated use very fast.
  4. Spark tolerates node failures by recomputing lost data, ensuring same results.
  5. Spark can run on EC2 via Mesos, with scripts to launch and manage clusters.

Numbers and commitments

FigureWhat it refers toTypeAt
20, 30 times Speedup from in-memory computing in Spark metric 7:02
2.3 megabyte Size of Wikipedia data file for examples other 12:08
20 nodes Size of the EC2 cluster used in demo metric 21:12

Chapters

  1. 0:00Introduction and meetup logistics
  2. 7:02AMP Lab and Spark goals
  3. 8:34Software stack: Mesos, Spark, Shark
  4. 9:49Future work: streaming, ML, debugging
  5. 12:08Installing and running Spark
  6. 15:09Spark shell and EC2 demo
  7. 17:33RDDs, transformations, and actions
  8. 20:15Q&A on Spark usage

Questions asked in this interview

6
  1. 0:08Just to sort of get some stats, like how many of you guys actually tried Spark?
  2. 20:15Can you take multiple sources and treat them as one?
  3. 20:52If you run collect again in the first variable, will it recalculate it, right?
  4. 21:06If you launch a job, does it keep the JVMs alive afterwards once it's launched once, or?
  5. 21:28What happens if one of the nodes dies while you're running the job?
  6. 21:46So does it do checkpointing for that, or?
Unknown 0:02 ↗
You can embed it.
Alexi Kro 0:08 ↗
All right, guys. Let's get started. My name is Alexi Kro. I'm a research engineer here at Cloud. This is the first Spark user group meetup. It's huge. We passed the mark of 100 members in 10 days, which is a record — it's very quick by Meetup standards. We got a kudos email from headquarters saying you do something right. So this is all of course the achievement of Day and his group which made Spark so interesting. Who among those present was here for the first meetup devoted to Spark that we held in December at Scalful Startups? A few. Okay, so this is basically a new group right for most of you. Just to sort of get some stats, like how many of you guys actually tried Spark? Cool. All right. So basically just a few sort of logistic points. So this is the inaugural meeting. We have it here at Cloud. We're very interested in using Spark. We have a bunch of people, hundreds of millions of users basically for influence online. It's called descendant influence. We're very interested in making this process faster. So that's how we actually found Spark and found it interesting. So this is a Spark user group. We actually cover other things. So I was going to suggest to Matei that we may in the future also cover other frameworks such as Scoobi, Scrunch, Scalding — right, so there are other interesting big data frameworks based on Scala. Also there's Cascalog based on Clojure. I sort of put them all in the same league, but nothing actually exists comparable to Spark in terms of memory — right, so it's a memory caching system which makes it all very fast and fascinating. So that's I think what we're all here for. And welcome again.
Matei Zaharia 2:21 ↗
So let me do this. Yeah, it's on. Right. Okay. So thanks a lot for coming to the first Spark user meetup. It's really exciting to see this many people here. When we set up the meeting, we thought we would get, you know, maybe 20 people, 30 people, something like that. And it's really cool to see all you guys. And thanks to Cloud for hosting this and providing, you know, drinks and food. So actually before we get started, I was just curious if everyone would like to introduce themselves just so we kind of know who we are and where we're coming from. So I'm Matei, I'm a grad student at Berkeley. If you just want to say your name and maybe company, that would be great.
Mark Hamstra 3:04 ↗
I'm Mark Hamstra. Some of you may have seen my presentation on Spark a couple of months ago for the power enthusiast.
Unknown 3:13 ↗
I'm from Deadlines.
Matei Zaharia 3:17 ↗
Um, a general request. So we don't have the speaker mic at this point. So please stand up and speak louder and, you know, face the rest of the audience and try to speak as loud as possible.
Unknown 3:27 ↗
Thanks, Michael. How are you?
David 3:33 ↗
David, I work here at Matt. I work at home.
Josh 3:47 ↗
Name's Josh.
Tony 3:49 ↗
Tony, work at Viso.
George 3:57 ↗
I'm George.
Ariel 4:00 ↗
I'm Ariel, a PhD student at Berkeley.
Andy 4:05 ↗
I'm Andy, also PhD student at Berkeley.
Ben 4:09 ↗
I'm Ben. I got to Micron.
Unknown 4:30 ↗
I'm a grad student at Berkeley. I am one of the developers.
Ron 4:36 ↗
I'm Ron. I'm a master student at Berkeley.

16 more exchanges in this transcript

Sign in free to read the rest of this interview. No card required.

Sign in to read the full transcript

Cite this transcript

APA, MLA, BibTeX
APA

Zaharia, M. (2026, August 11). 1st Spark: Alexy Khrabrov opens the very first Apache Spark meetup in the world with Matei Zaharia [Interview transcript]. FunctionalTV. CEOInterviews.AI. https://ceointerviews.ai/interview/1204145/

MLA

Matei Zaharia. "1st Spark: Alexy Khrabrov opens the very first Apache Spark meetup in the world with Matei Zaharia." FunctionalTV, 11 Aug. 2026. Transcript, CEOInterviews.AI, https://ceointerviews.ai/interview/1204145/.

BibTeX
@misc{zaharia2026_1204145,
  author       = {Matei Zaharia},
  title        = {1st Spark: Alexy Khrabrov opens the very first Apache Spark meetup in the world with Matei Zaharia},
  howpublished = {Interview transcript, FunctionalTV. CEOInterviews.AI},
  year         = {2026},
  month        = {aug},
  url          = {https://ceointerviews.ai/interview/1204145/},
  note         = {Speaker-attributed transcript with timestamps}
}