Hello and welcome to this very special edition of Voices from the Valley. I'm Shireen Bhan. Well, we've been talking about AI and we can't talk about AI without talking about what's happening at AMD. My guest today has over four decades of engineering experience. He's been at AMD since 2011. Joining us now to talk to us about what's new and what's next at AMD is the CTO Mark Papermaster. Mark, it's an absolute pleasure to have you here joining us on Voices from the Valley. You know, 2024 was a great year as far as AMD was concerned. You doubled your data center revenues, closed the year at almost 26 billion in terms of revenue. But let's start by talking about what's new and what's next. You've had a big event in the last few weeks here in San Jose in the Bay Area. What are you most excited about?
Well, Shireen, it's great to see you again and thanks for having me on with you today. It is absolutely an incredibly exciting time at AMD. So, we had a big event last week where we announced our next AI data center GPU, the MI 350 family. And so it's following the success we had as frankly a new entrant in December 2023 that we announced our first foray to take on the market leader who's got basically dominant share of the GPU for AI computing. As you said, we had a banner year last year. Of that revenue that you stated, 5 billion of that was data center GPU from virtually zero the previous year. So we went from zero to about 5% share and so it's a great start. And the event last week really showed the world that we had committed to annual updates and we had rolled out that MI300. We had done an update called the MI325 and here we are in mid of 2025 rolling out our MI350. Not only that, we shared our future plans for our next two systems which are coming up in 2026 and shared as well that we're on track for our 2027 system. So, we are here to compete. We're gaining share and we're creating an alternative and it's a very exciting time in AI as well as the rest of our portfolio which is growing quite nicely.
Mark, I want to talk about the partners that you've been able to onboard, whether it's Meta, Microsoft, OpenAI. In fact, Sam Altman was there at your event in early June as well. So take me through how crucial this era of partnerships is going to be and what it eventually means as far as the customer is concerned.
When you look at what we did as we grew that revenue from 0 to 5 billion US over the course of 2024, it was done through partnership with those hyperscalers. These customers are at the absolute cutting edge of AI. They understand the workloads. Many of them are creating their own large language models that have amassed this vast information and it's evolved so quickly. So by deeply partnering with them, we really understood their needs. We were testing our MI300 product with them as it ramped up. So in doing so, they said this is great but here's what we need one year, two years, three years from now, four years from now. Please build that in your roadmap. So those partnerships and why we focus first on those largest of large customers is that they informed us as to what we need to be where AI is going in the future. And now as we are in 2025, we're very focused on expanding to support the broad community. So 2024 was all about ramping those largest of large customers and now we're attending to the community, getting regular software updates out, making it easier and easier to run AI on AMD not just on the big GPUs in the data center but right down into your laptops or your Radeon gaming card.
But Mark, as you speak to the likes of Sam Altman and look at what's happening at companies like Microsoft and OpenAI, what are you picking up in terms of just how wide and large this opportunity is and where we find ourselves on the map today? Everyone's talking about potential. Everyone's talking about riding this wave. We've seen the kind of exponential numbers that OpenAI has been able to deliver in barely two years. So what are we talking about? What are you bracing yourself for in terms of growth?
Yeah, Shireen, it's a great question. You know, when Lisa Su, our CEO, talked about there being hundreds of billions of dollars of applicable market TAM in 2028, people thought, oh my god, that's just such a large number. How can this be? But it truly is an insatiable demand of compute capacity that's required. And the reason is that at first all that computation was needed to train those big large language models. So if you're running ChatGPT, Gemini, or any of these large language models, you probably already have it starting to be an indispensable piece of your life. When you have a question, even a really tough question, you can go to these generative AI applications and get very thoughtful answers. And it's starting to really help people be productive. And so what this is shifting from is all the spend, all that opportunity for us as a chip developer being on training those largest models, it's shifting over to running those models, getting those answers to you in ever more thoughtful ways as the AI algorithms evolve. That's why we see such an exponential growth for this market going forward.
Mark, that brings me to the question of cost. What are we talking about with this exponential growth? One of the key constraints of course is the high cost. With the changes that we're seeing with the advances that we've already made, what can we realistically expect in terms of taking cost out?
Yeah, cost and power is a huge issue because again for those largest models, it's very expensive. So you have to think about what's the cost to be for the biggest companies to offer that general purpose generative AI application like ChatGPT. And I think we'll end up having a handful of those. We'll have the hyperscalers we have today and I think sovereign nations will establish some of their own because they're going to want natural language generative AI. So we're going to see that but it won't be a huge number and those costs get amortized across the millions of users. So you may have seen that OpenAI just crossed $10 billion in revenue and that just tells you people are really using and paying for the service. So the costs get spread over a massive amount of users and there's also innovation that's going to drive down the cost. So even though so much more cost and power of GPUs and our CPUs power the engines underneath this capability, the cost per token is actually dropping dramatically and we're figuring out how to bring applications into much less expensive applications. Think about an application that you need to help you be more effective at running these broadcasts, yet it could run right on your PC. You weren't asking about all the questions in the world, but it was specific to a broadcast that you're doing, the information that you need. You likely can run those AI applications right on your PC going forward to assist you in post-processing and handling all that. So there's a lot of innovation going on to drop the cost and we're seeing that bear out in the industry.
Well, yeah, that is the hope at this point in time. But speaking of collaborations, I want to understand from you how you are seeing this collaboration that AMD has with Humane. I mean, it's a $10 billion commitment being made and I think this is an issue that many countries including India are grappling with at this point in time. When we talk about the need for sovereign models, how do we fund sovereign models? Take me through what the bet is here.
Well, we're very excited about our joint venture with Humane. It's going to be investment with partners to really grow that compute capacity. Humane and the Kingdom of Saudi Arabia has power, they have energy source, they have the willingness to invest as do we. So it allows us to create a partnership to really build out that capacity, that compute capacity to address that insatiable demand going forward. And I do think it's one we're certainly involved in discussions like that, maybe not the magnitude of what we just announced with Humane, but exactly discussions like that we have going on in over 40 countries where we're engaging with them and they want choice. Many of them are actually writing in their bids, saying, 'Hey, we're going to create a sovereign AI capability, but we don't want it all one vendor. We don't want to be locked in.' They're actually writing in the requirement that it be multi-sourced. So I think every company, every country is grappling with this and certainly includes India. We've been very excited by the attention from Ministry of Science and others that are giving to build up AI capability in India.
You know, talking about India and you said you're in conversation with the government in India along with conversations that you're having with governments across 40 other countries. But India's rolled out its semiconductor mission. 10,000 GPUs now, 30,000 is what the government is looking at. How do you see India today, Mark, and from a semiconductor mission point of view, as you look at how things have panned out, are there things that you believe the government needs to put on the table to ensure that this picks up pace and we see further acceleration on the back of the measures already taken?
Well, we're very pleased to see the initiatives of what's going on not only in the AI investment but overall making India investment which is driving up the technology capabilities there. And it's very important for us. We have a very strong presence in India, Shireen, as you know, and we've been very active there. We pledged in 2023, I had the opportunity to pledge a $400 million investment that we were making in India at the Semicon conference, and we are well along on that investment from 2023 to 2028. Likewise, discussions on computing have proceeded very well. It turns out we've had some excellent engagements on supercomputing. We have two of the top supercomputers powered by AMD compute technology and actually in engagements we have with multiple universities including Indian Institute of Science where we've just stood up a test cluster where students and faculty can run AI across different types of devices and push the edges of research. And then of course as you said, there'll be tenders that the government's putting out as they're growing their GPU capabilities. And our ask of the Indian government in doing these tenders is please open it up. Make sure you don't get tied in and locked in with just one vendor, the dominant competitor in our field. Please open it up for AMD and others to compete.
