All right, at the end of last year we were like, 'All right, we are quite excited about the progress. We haven't seen the models yet. You know, we're going to write this check for, like, I don't know, $100 billion or $200 billion.' I'm like, 'Alex, I don't know.' I mean, I use it for a ton of stuff. I still — my favorite use case and probably eval for the product is having it coach me in MMA. So I put cameras in my gym, and I basically — it watches the cameras when I'm in there, and it gives me feedback in between the rounds, which is a very hard problem it turns out, because not only does it have to — it basically has to process all the video quickly enough, because you only get one minute in between the rounds.
Oh, it coaches you between the rounds?
Yeah, and I want feedback. I was like, I want feedback on how to win, you know, and it's like, come on.
Did you have to instruct it? I've wondered about this too, because looking at videos is a really good AI use case. It feels like you can't just give it a multi-gigabyte video file. So do you tell it how to slice stills out of it or something?
Basically, yeah, it pulls stills. I think it kind of figured that out by itself.
It turns out that Muse has pretty good native understanding of MMA. So that's good. So like the multi-modal...
Yeah, that's — yeah, someone on the team knew. No, we're just kind of out there in the corpus.
It's a good — I think it's a good test of the kind of coding ability, that — because really, basically what it's doing is, like, you know, within the agent — I mean, I'm not seeing any code, but it basically is writing this whole video processing, image processing pipeline, and I'm constantly telling it like, 'All right, it took you 30 seconds to give me that feedback. I only have a 60-second break. Like, you got to go faster. Just optimize yourself. Optimize yourself.' And it's, um, yeah. Well, so, yeah.
So my 3-year-old daughter loves baking. She loves cooking. And so I'm like, 'All right, I'll start baking stuff.' I'm normally into, you know, smoking meats, but I'll do some baking in order to make Aurelia happy. And so we've gotten into this really cute routine where, you know, I've been playing with Muse's voice mode, which isn't fully rolled out yet, but we're playing with it. And it does this great thing: it segments the voices, so it knows which one is me, and it knows which one is not me based on that. And we just, like, you know, throughout the week we're talking about what we'll want to bake that weekend, and she'll give it ideas, or she'll kind of come up with crazy things that are not real recipes, but bounce it off with Muse, and...
And then Muse will just make sure that every, you know, Saturday when it's time to bake, I get the ingredients from Instacart, and they kind of show up, and they're on time. Which, I mean, the biggest thing is, like, if I were just starting the activity on Saturday, it would — you know, you'd have to get everything, and it would take some time, but now everything's ready whenever we're going to go sit down and do it. Um, this weekend it knew that watermelon was launching, so it threw a watermelon in the bag. It was very, very sweet. It was very heartwarming.
It deduced that the recipe didn't have enough — there was not enough, I guess, expense in it to get the delivery, so it needed something else. And it was like, 'You're going to...' It topped it up with the watermelon. It was like, 'Do you want this watermelon?' I was like, 'Yes.' I'm like, 'Yes, that's very cute.'
Which I think you — did you — is that the watermelon you...
Yeah, yeah, that was on the — I ate it on the live stream.
Okay, but the watermelon on the live stream was the one that you ate.
It got it for me, 'cause I thought it was going to be funny.
It just got it for me. But I think that there's this...
It was a very meme-able moment of that.
Yes, very meme-able situation. So we have Muse to thank for it.
Yeah. So, but here's another interesting thing about the whole thing is I didn't really use Instacart that much before. You know, it's like every once in a while, maybe twice a year, I would use Priscilla's account or something. I went and got an Instacart account to give Muse, and now I use it like once or twice a week, because I'm talking with Aurelia, with Muse, and we're coming up with these recipes, and it's delivering them, and now it's like a core part of my workflow. So I actually think that the opportunity here isn't just, okay, it's going to be 20% more efficient on the conversion rate. Like, I am a new Instacart subscriber, and I just wouldn't have done this before. So I think this is part of the excitement of like booting up a frontier lab now, where it is basically like the ante is extremely high.
And I think this is — and I kind of like viscerally remember this. We were in Hawaii at the end of last year. It's kind of like the whole exec team got together, and yeah, Susan pulled me aside many times and was like, 'You know, I just want to tell you, if this doesn't work, like, you know, this is going to be really, really bad. It's going to be very, very bad in financial terms.' ... 'I really need to impress on you that this model has to work.' It's like, it has to be good. If it's good, it's all good, we're great. But if it's bad, it's really, really, really bad. And Susan...
And that was useful motivation.
It was — well, it was like, it was one of these very funny moments where I was like, you know, obviously the amounts of money are so obscenely large.
What are the amounts of money in training? Order of magnitude — whatever you can share, but just like...
