Not like the sky is falling, China is coming kind of news, but just a periodic reminder that these are serious providers of memory, and they are getting better and bigger pretty quickly.
Hello, everyone. Welcome to another episode of The Circuit. I am Ben Bajarin.
Greetings, programs. I am Jay Goldberg.
Well, we return to our regularly scheduled programming of just Ben and Jay, after back-to-back weeks of guests, which we appreciate the feedback on all of that. But now it's us two cranking away on hot topics of the week.
The two of us and the rooster.
Now my rooster — like, I shut the window, and it's midday. They're not crowing so much. I appreciate their feedback. I know some people don't love it. We have very loud roosters sometimes in the morning, and they're not far from my window. So be it.
All right, let's start with memory, and in particular the — what are we going to say — the fourth and fifth horsemen of the memory apocalypse: the Chinese players, who are obviously ramping capacity. We see a lot of news come across the chattersphere, the Discords and the Slacks that we're in, around that. So they're moving quick. You know, the Chinese memory guys... I know. So you had a take.
Yeah. A lot of headlines this week, or a lot of chatter, about both CXMT, which does DRAM, and YMTC, which does NAND, accelerating various parts of their program. It sounds like CXMT has pulled forward some of its capacity expansion. Yeah. No, sorry. YMTC has pulled forward some of its capacity expansion. CXMT is on track to add another hundred thousand wafers per month by the end of the year, end of next year. So that's a 33% increase for them year on year in capacity. And then CXMT also sounds like they're making a lot of progress in sort of just developing the quality of their product. I've heard different rumblings of what that means, but it sounds like their yields are improving, and they're starting to branch out into different flavors of DRAM. So not like the sky is falling, China is coming kind of news, but just a periodic reminder that these are serious providers of memory, and they are getting better and bigger pretty quickly.
Yeah. Yeah. And I think you're already hearing — I mean, look, at the end of the day, there's a lot of OEMs, and I know it's not just the Chinese OEMs, who would love some release to the pricing pressure. I saw two different forecasts come out earlier in the week, downgrading consumer devices in volume, really across the board. I mean, it was everything. It wasn't just PCs. It was phones and everything, because of the memory price bug, which I think is a fair downgrade in consumer electronics. It's rough. It's rough out there. Like, it's going to be ugly in consumer hardware for the foreseeable future. I don't know. I'm starting to hear different rumblings. Like, I mean, most of this is mostly coming from interested parties, like memory company CEOs, but it sounds to me like there is some plateauing of consumer-grade memory pricing.
Yeah, pricing. Yeah, I've heard that from a couple of people. I don't know how much I believe it, but like, I think the consumer side would really, really appreciate that now. Just a little bit, because I think if the memory makers are smart about it, they'll realize that they really have two very distinct customer groups. One customer group is very price-sensitive consumers, and the other side doesn't really care about price and will take all the memory they can get in the data center. And I think the memory guys will see a way to sort of balance that. I mean, it's not an uncommon problem — market segmentation. So I think there may be, at least — I mean, I don't think memory is getting cheaper in consumer, but maybe prices stop going up again. As opposed to data center pricing, where memory is just going to keep going up. Keep going up. Yeah.
Well, but okay. So here's the nugget that I had found out. So there are certain SKUs of memory size, you know, X gigabytes, that aren't normally in a SKU, or at a base slash entry SKU, that are cheaper than some memory that's less than that in gigabytes. But the OEMs don't want to move up into that price because once you increase your storage or your memory, there's really no backtracking from that, even if it's less expensive than a lower tier of memory. And so you kind of have this dynamic of like future-proofing planning, to make sure that you're not stuck at a certain tier that historically is more expensive than a lower storage or memory tier. And that's creating some really interesting dynamics as to where the pricing increase is happening, what they do with SKUs, how those prices go into certain SKUs. So it's just different navigation, right? You've got to manage through. But I thought that was interesting because it's not necessarily all pockets of memory — it's pockets of memory that someone doesn't want to bring into a certain price point, because that locks them in. You can't downgrade from that going forward.
Yeah, I haven't — I forgot to do the comparison for the iPhone, because the new iPhones of course came out, and if memory serves me correctly, memory tiers on those stayed the same as the last generation.
Okay. But I know that that dynamic is true in China, where you're seeing a lot of phone specs sort of flatline, memory and storage wise, over the last year. Nobody increased theirs — some vendors actually decreased both in a lot of SKUs. Because you don't want to get stuck.
Yeah. Which again is fine. It's just a — you've got to navigate that landscape. But no doubt, right. And even if we see some pricing stabilize — which, I hope you're right — it is a higher pill to swallow. And I think that's the concern in consumer electronics right now: is that we're at an already inflated state, and prices, entry-level prices, have gone up to what you just consider mid-tier, and everybody's having to just navigate how they set these prices. And fall is going to be really interesting. Like, what happens with promos, what happens with things like PCs and smartphones and other consumer electronics in fall — I think it's going to be really interesting to see where they land pricing, what promotions happen. Because yeah, it's going to be rough.
Yeah. Yeah. I think about this strategically. If Samsung, Hynix and Micron are smart about it, they're going to do what they can to protect their longstanding consumer customers. Because if they don't sort of look out for them to some degree, that is going to open the door for those customers to look elsewhere. And I think the fact that, you know, two, three weeks ago, we heard a lot of reports that Apple had tested CXMT memory and was pushing very hard to get a waiver from the US government to be able to buy it. I think that sort of caught a lot of attention at the other memory makers, because if Korea and Idaho can't provide the memory, China can. Wuhan can. But at the end of the day, right? They should be concerned, because once you're in the door with another alternate player, like, Apple's not going to all of a sudden go, 'Oh, we're going to stop using them.' Like, now they're another supplier, and that would hurt.
Yeah, that would hurt. Barn door's open.
Yep. And I think the other thing too is, you think back, what was it, three weeks ago with Hot Chips. One of the big takeaways I heard from a lot of people at Hot Chips was the memory presenters got a lot of very tough... they faced a pretty hostile crowd. People were pretty angry at them. And in particular, this is a technical presentation, and there were a lot of people pushing back saying, 'Why are you moving to hybrid bonded memory? Why are you going higher? We don't need that, because that is just going to be more and more wafers that are going to be needed.' Like, let's try a different approach to memory. It doesn't have to be so high, and so many stacks of HBM — let's try a different path forward. And that was very, very loud feedback I heard. So I think the memory players have to... you'd think they would just sell everything they can in these great times. And no, I think they're going to be a little smarter, a little bit more strategic about it.
Yeah. And I think, you know, we've talked about memory pricing before, and it's interesting when you talk to some folks in the region. Different regions, you hear them be sensitive to this, right? Knowing that margins are going up. And again, there's a different margin profile for all three of your big three, but you know, you hear particularly from the Korean players. And then this is actually true of a lot of folks deep in the semiconductor supply chain, in Taiwan in particular, and even in Europe, where they don't want to press margins to look opportunistic, and trying to take a consumer-friendly view or a customer-friendly view in this will be appreciated by those companies long-term. I mean, just use the example of Apple, right? I mean, if you think these memory players are up in arms or have a grudge against Apple, like, you just wait till you see the grudge that Apple will hold. If you continue to be hostile to them and they are your biggest scale customer — like, this is a non-negotiable — you should try to still be somewhat customer-friendly.
And this is just a fascinating, fascinating dynamic. It's anyway — but yes, you're right. As long as YMTC and CXMT do continue to scale, we know they're going to bring relief to China-based OEMs, who will hopefully have some pricing, because their prices are going up. Their low-end tier to mid-tier is getting rough. But yeah, even for Chinese OEMs, they can't ramp quick enough. So we'll see. Memory dynamics remain extremely, extremely pressed.
Yeah. Fraught. Yeah, it's wild.
OK, let's talk Meta. So I have a couple of broad opinions, and then we could talk about some of the implications of this. So everybody is already like, you know, 'Muse is the greatest thing ever.' I don't know if you all played with Instinct too, but essentially what you're seeing is a very interesting — let's just say maybe more consumer — use cases, although I don't want to say it's only consumer. But things like, what would it look like to have a chatbot that can go do product research for you, or what would it look like to have a chatbot that can help you find cheaper flights or manage this and X, Y and Z. And so people play around with these, and they see that element of this, which, you know, an assistant is trying to, for lack of a better word, be an assistant in a central location. And people have been very favorable to this. Like Muse has sort of taken off. I get it. I've tried it. It has some great value. In fact, one of the things that it does the best — Instinct fails at this, but Muse does this the best — is try to anticipate some things for you. Like, 'Oh, hey, this just happened,' or 'I see this on your calendar. You know, you might be hungry around this time. Should I find you a restaurant?' Like, it syncs together what it knows to try to be helpful, right? Or anticipate, and there's value there. I think you're starting to see the early stages of this.
But I'm going to comment. So our friend Ben Thompson was on TBPN or whatever, and I think he was talking about an article that he had written. In fact, in my last interview with him, he made the same point, which is, you know, consumers don't want to be productive. And to some degree, consumers like shopping, which I agree. You know, he used the example of like people go to Walmart to go to Walmart and look around and shop around. And like for me, that's Costco. Like, I enjoy Costco for some obscene reason, but I really like going to Costco. But those are the things — like, those aren't going to be automated away. And I do think there's some areas for consumers who will engage in these things and be OK with something helping them — again, maybe flights or planning a vacation, or things that aren't enjoyable or tedious. So I don't think it's a blanket statement that consumers don't want help shopping or whatnot, because they want to just go shop themselves. They want to do that for things they care about. They might not do that for things they don't care about.
But I also think that these little agents, or Muse, is actually also showing you what a personal enterprise assistant could look like. And that's where I think things get super interesting, because not all employees have had a true kind of connected assistant who can help them be more deeply productive, do things like manage things they don't want to manage, et cetera. And we haven't really had that before. You wouldn't say that you're engaging with ChatGPT or Claude to do some productivity stuff as a true kind of quote-unquote assistant the way that you're seeing Muse. But I think that's interesting. Right? Just this degree of, you know, could every employee also have their dedicated work assistant that does some of these things?
And then again, the implication of all of this, of course, is that it just creates more compute demand. Right? Muse is doing kind of its own computer. Even tells you that — it says, 'I have my own computer. I can browse the web. I can do all these things.' And that's running in a VM, and it requires a whole host of compute and CPUs and GPUs. But that added dynamic of I'm not just using, you know, a research service — OpenAI, Anthropic, whatever — to kind of use documents, and I am the orchestrator of those things. But now something that could be another part of that, an assistant, a smart assistant from an enterprise standpoint — like, I don't think we really had anything like that before. So I just think that whole 10,000-foot view is interesting.
Yeah, so maybe backing up a second. Facebook had its annual conference this week, and they announced a bunch of AI-related products. Well, the most interesting is a little Tamagotchi AI toy that you have to keep alive. The second most interesting is their AI agent Muse. And first of all, I want to say I called this two months ago. I said this is what the product looks like. This is what the AI consumer product is going to look like. It's an AI assistant that does all these things. And I mention that not just to brag — a little, partly to brag — but also because what I've been saying for a while is, the hard part now for AI is the product side. You have all this great technology. How do you make it into a product that users engage with and want to use more? And I think Muse is a very... like, I think OpenClaw was the first one that, you looked at it and you're like, oh, this is where this is headed. And now you see Muse is a much more refined, usable product that, you know, anybody can sign up for. I still think it's only a step in the right direction. I don't think we're there yet. I don't think the AI models can really, really do it yet.
Yeah. But I think there is immense consumer — and to your point, enterprise — utility. But I really think there's a strong consumer product in the works. Somebody's going to come up with something. It's probably a couple generations of models away, but where it's actually really, really useful to the consumer. And it will do these things. It will. There's a lot more it can do. And I mean, I think your point and Ben Thompson's point is valid. But that's to me just in the category of product definition, right? Figuring out what users actually want. And I also think like you and I aren't necessarily the target demographic here, because I started using Instinct, and the second it started asking me for all my passwords, I was like, 'Who is this?' Like, I still have privacy concerns, but apparently lots of people out there don't.