Like, it was an impossible week.
Impossible week is an understatement.
Hello everyone. Welcome to another episode of The Circuit. I am Ben Bajarin.
Greetings, programs. I am Jay Goldberg.
Well, this was a double event week combined with some juicy earnings, and a lot of busyness on both of our parts. This week had SEMICON West in San Francisco and OCP in San Jose, which next year, SEMICON West is going back to Arizona and OCP is going to San Francisco.
Thankfully, different weeks.
Yes. So we can all be insane in now multiple weeks instead of one giant insane week. There were also three analyst days, or three analyst days-ish, buried in there too. Like, it was an impossible week.
Impossible week is an understatement.
But we were there. So we're going to lump this into a couple of categories. We're going to talk about semicap and wafer equipment, which will combine ASML earnings, TSMC, and the conversations we had at Applied Materials and their investor day. And then we'll talk about OCP on the back of that, and the major themes that we saw.
So, you know, one thing that stood out to me, and I've sort of been saying this fairly frequently — in fact, we've titled multiple episodes to this — but I do find the semicap part of this cycle very interesting, because when you listen to those making the goods or building the cleanroom, you hear a very interesting side of the story. You hear them talking about what's going on in new equipment, where innovation is needed, where that wasn't necessarily the innovation pipe for tooling and machining before. We'll just say in the kind of monolithic designing a mobile and a laptop type chip. That as we push reticle limits and try to develop these giant AI accelerators and all of the things, including much larger and getting larger networking ASICs. So let's not forget that networking ASICs are going to have a whole lot of advanced packaging on them and be bigger, not just GPU XPUs. You hear this interesting theme from semicap saying, you know, we're seeing the challenges in scaling this industry to meet the demands of those who want to use our fabs as fabless, or use our tools in a fab semiconductor, and are investing like no real cycle we've seen before.
And that obviously manifests itself in commentary from ASML, in commentary from TSMC, and really in this commentary from Applied Materials, where you could see the underlying — or this new foundation emerging for the semiconductor industry, who will be able to build very different types of silicon as we scale cleanroom space. And we see innovation in these tools that we haven't seen before. And I just find that kind of interesting. Regardless of what goes on in the market and people's emotions about finances, the semiconductor industry is laying a foundation for a very different shape of capabilities of silicon on the back of semicap. And I just, all things considered, I find that an interesting observation, and not really one we've seen in some time. Perhaps the only historical precedent is when we were chasing Moore's law regularly and doing node shrinks on an 18-month basis. You know, material and testing and lithography was a big part of that. And now it's like it's back in full force, and everybody's talking about having to go and innovate, solve problems, and even do new machines that they didn't have to think about before.
I'm trying to refrain from talking about the market, because there's a lot of bad news in the markets this week, and your point is that that won't matter, because there's so many interesting things going on in semiconductor land right now. And I think that's a fair point. I think semicap is, to me, a lot of fun, because there's so much innovation and there's so much nerdy technical detail there. And, you know, ask a semicap toolmaker how they lay individual atoms of some molecule down one by one — or not one by one, but evenly — it gets to some really interesting conversations. So there's a lot of cool stuff happening in semicap technology. There wasn't a lot of news, I felt, out of SEMICON. I don't know if people break news at conferences anymore, but there wasn't a lot of news. But what little I was able to see of it, it was pretty fascinating. There are a lot of really interesting things taking place.
Yeah. Yeah. I think the underlying theme in general was, you know, the industry is gearing up for growth, right? Depending on whose numbers you believe, it will cross three hundred billion in total TAM somewhere around '29, '30, '31-ish. I mean, I seriously doubt it takes longer than 2030, but that's most people's lines. Which is again a structural changing of this industry, where that kind of tooling is being invested now in a whole lot of new cleanroom space.
But like I said, I think, you know, this came from Applied, and not that ASML is in all of the pockets that someone like Applied is, but even their commentary was the same in terms of their need to ramp and build and bring on as many new equipment as possible, because their customers are basically lining out the door for ASML machines through the end of the decade. It is just a structural change in semicap. And I just think there are, you know, I pointed it out, but I think there's a lot of implications to that observation that haven't been wrestled with, around the shape of the semiconductor industry just being drastically, drastically different going forward than really anything that we've seen before, on the back of all of this new innovation we're seeing, and how these things are made and tested, and how wafer yields are done, advancements in wiring — like all of these things that the industry didn't really have to do before. You know, they kind of did. I'm not saying it didn't want to innovate. It's just these are different problems. And semicap and wafer equipment, the testing, they're all gearing up to meet very challenging demands that didn't exist before in designing semiconductors.
I agree. I think there's a few news items I think we can just hit real quick that I thought were worth noting. One is, a little ahead of SEMICON, TSMC said they're moving to a larger reticle size, which is — you know, the reticle is the size of whatever — look it up. The reticle is the maximum size of a chip on a wafer, right? And they're going to bigger reticles, which sounds, in some sense, kind of small, but that's going to cost, I don't know, tens of billions of dollars of R&D and retrofitting and everything to get that to work. And it's important because the chips are getting bigger. We want bigger and bigger chips. And one of the constraints on some of this is reticle size, and once you start having big reticles, you can do some very powerful things. So it sounds like a relatively small change, but it's going to cost a lot to get it to happen, and it's going to enable bigger and better, more complicated chips. So I thought that was cool.
I spoke to someone who had gotten orders from Terafab. Right. So Elon's out there talking about building Terafab. A lot of us are kind of scratching our heads going, what does this mean? Like, nobody really knows what it's going to entail. TSMC might rent some capacity, Intel might manage it. Maybe none of those things. But they're actually putting in orders for tools. They won't get those tools for a long time, but they're putting in real orders for tools. So there's some realness there.
I heard there was some sourness, though, over this news. Like some people were like, why are you giving him machines when this whole thing could be a farce, when we're going to use these machines? There was some drama that came out of somewhere, I forget where.
Yeah, but they don't understand he has flying cars. He has cars that can do very fun tricks. He's Elon Musk. That's, I guess, why he's going to get some ASML machines. Yeah, I mean, like I'm sure the other side of the conversation is, he's Elon Musk, why isn't he getting more machines? I have no stake in this. I'm just saying there's something actual, tangible happening. It's the first time I've seen anything real happening there.
Applied Materials had the grand opening of their R&D center, their Epic center in Santa Clara. Ben and I were both there. It was a very interesting event. They had a lot of very high profile people. The CEO of Hynix was speaking, and I got a phone call while I was there. It was an important phone call that I had to take, and I was afraid to leave the room because I don't want to anger the memory gods. So I waited and called the person back. But it was like very high profile people, Applied Materials. It was very cool that we could go there. I would just have one sort of constructive criticism: more tools. We would love to see more tools than were on display. To me, I would love to see a room filled with all the tools and robots running around, and that would be fun. So next year maybe.
So, you know, there's a lot happening in the space. I think the other thing is TSMC reported this week. I've given up trying to track what expectations were. I guess it wasn't what people thought. I don't know, numbers look fine to me. But they said a few interesting things on their call.
Right. They talked about Terafab too, but they kind of played it down. I thought the most fascinating thing they said is they actually have their own employees going on site to data centers now, around probably the US, maybe around the world, checking to see how far along these fabs are, which I thought was very fascinating. Right. Here's a foundry. They're multiple layers removed from data centers, but they actually have people doing site inspection, trying to figure out what's real, what's going to get built, on what timeframe. Which is a big change from the world of the past. Right. I remember the days not so long ago when TSMC would just call up the sell side and say, what's your forecast for handsets? What's your forecast for PCs? And that would be their modeling. They're much more engaged now, as I think they have to be, and trying to figure it all out. And then everything else, I think, from their earnings is pretty much as expected. All the timelines are the same, no big changes there. But they're TSMC, so it's good to see they're chugging along.
Yeah, I thought the data center point, to be honest with you, was probably the most interesting. But as a broad thematic for TSMC, I just again — right, I'm trying to keep these things separated. Ben's not in the market. Ben doesn't recommend stocks or try to really analyze the stock market. I'm trying to keep these things separated because TSMC is the one company — I mean, I could argue there's many — but I would just say historically how this company operates and its management operates: this is a very conservative company. And this is why, as a bellwether, having them go and say the things they're saying — that they are talking to customers, they're in the market, they're doing these data center checks to make sure that we have the power to energize the gigawatts that they're going to make and sell — and they're still investing. They didn't announce the capex increase, but people assume that they will before the end of the year or in the early quarter in order to build more factories, more cleanroom space. They just — this is a company that cannot risk having factories sit empty or underutilized. We've talked about this before. So the fact that they're doing this, to me, has to be the most bullish cycle for demand, because they would not risk it. That's not how they operate. And again, I think that plus my points on semicap — you have to wrestle with an entirely new foundation of the semiconductor industry being built on the back of what people are convinced and have deep conviction is a growing demand profile, not an overbuilding profile, I guess is my point.
OK, I'm not quite there yet, but we can debate that on a different day. In terms of demand, there's a lot of... Yeah, I'll save it for another time, but I certainly agree there's a lot of demand right now. It will stick around for a while. And we need — I think the way I look at it is, we under invested. The industry under invested over the last five years, and now we're playing catch up at the very least, and have to get someplace very new. I think the other interesting thing from TSMC was they said that they're converting N5 fabs to N3. Right. And we touched on this a little bit last quarter. I know Ben Thompson on Stratechery talked about this a lot. That's a new thing for them. Usually they would just keep all the N5 fabs running and then build new N3 fabs, and they're actually retrofitting the N5 to N3. Something new for them. Three nanometers in big demand, I guess it's going to be that way for a while going forward.
Yeah, which raises the question — I think we've either asked or noodled about or discussed in private: what happens to all of the demand for five nanometer and below? Because it is still there. There is still demand for, let's just say, trailing-ish edge. And as TSMC does this, that creates opportunities for others, likely GlobalFoundries, who again is raising capex and moving to new nodes and benefiting from this cycle that once wrote off, is now seizing an opportunity as well.
I think if we talk about the trailing edge mature processes, that's a different conversation. There's a lot of factors pulling on that market. Again, a bigger topic for a different day. But I think trailing edge is going to be less exciting economically.
Oh, for sure. Demand is still very strong. There's an awful lot of that capacity coming on stream everywhere, especially in China, and how that all works out is still to be determined.
Right. And certainly, for all of the new fabs coming online in China, nobody really talked that much about trailing edge at SEMICON. I think people wanted to talk about...
I was going to say, that's what new leading edge or new nodes is what drives new equipment. So that's kind of why I think SEMICON was — it's good for equipment makers. But I've been reading up about this: trailing edge equipment is in shortage too now. In fact, in China, there's a very healthy secondhand semicap tool market, and that has gotten so tight that people are stealing equipment. Right. You know, you're a broker, you sell used edge tools, you have a warehouse somewhere, somebody pulls up a truck, presumably with ten guys and a forklift, and steals equipment. That's how much demand there is. Organized crime has moved from robbing banks and other things to robbing semiconductor equipment. That is the day we live in.
Yeah. Yeah, interesting stuff. I mean, for sure. But like I said, I think there's a lot to noodle on around the shape of the semiconductor industry post 28, 29, on the back of all of this additional capacity and new tooling innovation and process and reticle limits and packaging and all those things. It's going to be super interesting to see.
I think there's a couple of other things I picked up and I think are worth mentioning. One is, ASML is apparently going to have a new tool to do hybrid bonding. Right. Which is interesting, because we usually think of ASML as strictly a lithography company, but they have other products, and they're getting into hybrid bonding. I haven't dug too deeply into this, just haven't had time. But my sense is that they have a ways to go. It took Besi ten years. AMAT took ten years to get to where they are. So I think there's still a little bit of learning there. But it's interesting that ASML is branching out in that way. Certainly hybrid bonding is here to stay and can be more and more important.
But that also leads to this sort of interesting debate that's taking place in the memory world, which is: how high do you want to stack HBM? And this is like the one place where — there are a few — like I said, Applied Materials had an analyst event, and they had a breakfast for a broad audience, and they had a separate Q&A for the sell side, and digging into those weeds, this is the one place where I see a little bit of light in between my view and what Applied is saying, because they seem to be very bullish on this idea that we're going to hybrid bond HBM wafers to each other to get increasingly high stacks of HBM, which is very, very different than what we heard at Hot Chips back in August, where people kept saying, no, no, no, don't do that. And when I say people, I mean end customers who are buying HBM — they're saying, don't do that, don't stack it higher, just give us more of it. And Applied seems pretty certain that we're going to get stacked HBM. I don't think I agree, but they have good reasons for thinking it's real.
I'll comment on this only as an observation — you know, let's watch for this, because the question did come up from our friend Vivek Arya of BofA, and he basically asked them, you know, this point, right? And they made a comment that I think is worth watching and thinking about, which was essentially that it depended on the workload. That there are workloads — and they erred toward a training workload, which can better utilize higher stacks of memory for its advantage. And then there's other workloads — he called them light inference workloads, or maybe medium reasoning workloads — that while they could use 12-high, are not going to use it at capacity effectively for, you know, call it sustained use. So I don't know the answer to this, because I think there's all sorts of variables. But what I would say is, I think this is a model point — like, where models go can either necessitate higher stacks of memory or not. I think that's a software point. The software has to take advantage of it. If it can't take advantage of it, then it doesn't make any sense. If it can take advantage of it, then I can see a point. Now, again, is that every workload? Is it twenty percent of workloads that can take usage of 12 or more? Is it more or less like that? We don't know. But I think that was kind of how they answered that. I've heard others deep in the weeds on this say a similar point. So I would just say dig into that and keep an eye on the workload, and whether the workload can demand a higher stack of memory or not, as a greater proportion of how it's utilized on a daily basis by the masses.
OK. I'll, you know, we'll see. Before we go into OCP, I wanted to share an anecdote that I shared with you, and I want to share with everybody. I witnessed a fairly fascinating event in San Diego this weekend as I was walking in the neighborhood with my child, who goes to school there. You know, as any good technical person or analyst does, right? You walk past somebody chatting, and they say a couple of buzzwords that catch your ear, and you hone in. And so I heard 'data center' get talked about by these two gentlemen who were having a conversation, and one guy was pretty upset about this, and the other one was kind of talking reason and trying to talk about the benefits of data center by having a calm conversation, but clearly some emotion involved. And I turned around and just kind of looked, and the guy who was in the pro data center camp had all these pamphlets. And it hit me that this person is evangelizing data centers door to door in the neighborhoods of San Diego. And I thought this was fascinating. I really wish I would have gone back and been like, you know, give me your story. Who's behind this? Is this the energy companies? Is it AWS? Like, who's paying you to do this? But just — sign of the times again, right? That weird, weird timeline we're in, that there are apparently people door to door evangelizing the positives of data centers to communities because of the community backlash. So I thought that was very interesting and entertaining at the same time.
I wonder if the guy will still be doing it after the election.
It's a great point. I mean, I don't know. I think as long as there's this kind of hostility, I can see these types of evangelistic things trying to just help communities, because where else are they going to hear? I mean, think about it. But you're right. It feels like an election issue, because this is the kind of thing you do to educate people who you want support for, for things like this. It's Playbook 101 of how to change minds. But it's just interesting to me that that's the tactic, because again, where are you going to hear it? You probably won't see a reasoned argument on Facebook or Instagram or the news. And so it's actually an interesting medium to try to have more informed conversations. So you're right, I don't know, but I found that an interesting tactic that's going on to attempt to soften communities around data centers.
You know, to show up at your door, it's not a religious person, right? Or somebody selling something. It's, hey, did you hear about how good data centers are for our city and the technological future? Brother, can I give you the good word of Sam Altman? The data centers of our intelligence future.
OK, anyway, I thought that was a fun anecdote. OK, and no one in my family is in technology, so I was the only one that appreciated this situation. But there you go.
OK, let's go. That's why you have a podcast.
That's right. That's why I texted you immediately.
OK, all right. OCP. I actually really like.
Wait, wait, before you start talking about the show, can I just flex a little bit?
Day two of OCP, I got street parking.
Yeah, I got street parking.
It was the best. It was so crowded.
Yeah, it was. I mean, just to even give you more of a sense — for anyone who's been involved in events, you can sort of judge how hard it is to get an Uber by the density of something. And I had to wait twenty-five minutes to get an Uber. In fact, I didn't think I was going to get one. I was like, this guy doesn't want to drive me fifteen miles away, because they just want to do his little short drives. Like, I'm going to be stranded here and have to call a family member to come pick me up from downtown San Jose. And that was how busy it was. It was GTC-level busy, which was pretty interesting.
Yeah, not quite, but pretty close. And GTC was almost 30,000 people.
All right. So I actually really like this show for a lot of different reasons. The Open Compute Project is really something that is standards-based, which I think is good. So you talk to a lot of people on the floor, you talk about rack design, you talk about cohesiveness, and they're talking about that this is an OCP spec, and so it makes sense. You want an industry to have cohesity across its ecosystem for support and growth and standards, even though there's no standards in optical yet, but we will probably get there. But I like having these kinds of conversations, especially around some interesting pockets, some around networking, because again, there was a lot of what's going on in Ethernet, what's going on in different types of networking that is standardized, as well as what was going on in liquid cooling, which I thought was super interesting, because one hundred percent that actually does need more ubiquity than it has today. And then the 800 VDC conversation that was starting to come up with, again, pockets of fragmentation, but these things need to be standardized so data centers can install them, operate, all of the things.
But again, my point is, this show is around people trying to build together on standards, on a baseline way of doing things so that there is interoperability, as far as that can go one way or another, with differentiation. So that's like the center of it. And when you talk to people and their themes, it's like, yeah, it's OCP compliant, or working with OCP to make this more of a standard. For things like the one I thought was most interesting, which is the shift from copper to optical backplanes — which, once you go to optical in a rack, whether that's compute or ASIC, you're not going to have copper on the back side of that. At least you shouldn't. So you want to slide this tray in with an optical backplane; it has to align up once you slide it in. And so these were interesting discussions talking about future rack design for scale-up and scale-out type of networking compute domain. So that was just one example of rack compliance, size standardization, the way in which you plug things in. Anyway, that's extending now also to liquid cooling and 800 VDC, which is positive, positive for the industry.