About Vik Malyala
Vik Malyala, Senior Vice President, Managing Director and President of the EMEA Division at Supermicro, has been discussing the company's role in scaling AI infrastructure for a range of customers. He stated that Supermicro is working to "democratize this whole AI adoption" by making hardware accessible to developers and customers through partnerships with AMD and neo-cloud providers such as Vulture, Tensor Wave, Cruso, and Digital Ocean, as well as through a jump start program. Malyala noted that refresh cycles have shortened from three years to less than one year, requiring faster innovation. He highlighted Supermicro's vertically integrated approach to design, development, and manufacturing, and described the company's focus on bringing OCP-inspired designs to market, including a 2U design based on the B300 that can support up to 144 GPUs per rack.
Malyala has also addressed the challenges of deploying AI infrastructure, including power, cooling, and data center readiness. He stated that data centers are not always equipped for the latest technology and that Supermicro works with customers to audit facilities for factors like floor tile weight capacity and power drops. He noted that efficient data centers are already reaching 200 kilowatts per rack and predicted that 500 kilowatts to a megawatt per rack could become common within a year to a year and a half. Malyala emphasized the importance of sustainability, stating that data centers consume 2 to 3% of total energy and that liquid cooling is being used to reject 75 to 85% of heat in AI infrastructure. He also discussed the company's consideration of "Make in India" initiatives, saying Supermicro is evaluating what makes sense to manufacture locally, either directly or through partners.
Source: AI-verified profile updated from Vik Malyala's recent appearances.
Browse all interviews →
✨ AI-enhanced transcript with speaker attribution
S
Safi Fishov0:00
Hi, here we are at Mobile World Congress in Barcelona 2024, at the AMD stand. My name is Safi Fishov, I'm the Corporate Vice President for Telecom Infrastructure Sales at AMD, and we're here to talk about our partnership with our good friends at Super Micro.
V
Vik Malyala0:15
Thanks, Safi. I am Vik Malyala, I'm President and Managing Director for Super Micro EMEA, and also I'm a Senior Vice President for Technology and AI at Super Micro. Thanks for having us here.
M
Mory0:26
Thank you, and I'm Mory, a Vice President for the IoT and H Computing Super Micro and dedicated for the telco business. We're happy here to talk more about AMD solutions.
S
Safi Fishov0:37
Great. Thanks Vic, thanks Mory for being here. Two of the trends that I've noticed since we arrived are, of course, the spread of AI within telecom networks, both wired and wireless, and the second trend that I've really heard people talk about is the move towards virtualized RAN. In both those cases, you guys have solutions using AMD CPUs, Siena for example for the virtualized RAN, our MI300A and MI300X GPU solutions for AI. Maybe you guys can talk a little bit about that.
M
Mory1:08
Yes, definitely. I think the great chance here through the Siena solution, you can recognize the solution we are able to virtualize with a higher call count, and then there will be other possibilities through the accelerators, like here you got a T2 card, and it's all possible combined together to help the virtualization at the RAN. As Safi said, it's also possible extended to the storage, and later on we'll talk about the AI things, because the machine itself here actually also have extension to the more M device as well. So I think we have more possibilities coming here. Yeah, we're excited about it, right Vic?
V
Vik Malyala1:44
Yeah, the amazing thing is that in this market right now, it's performance, efficiency, and security. I think these are the key three main factors, and what we have been doing is bringing those kinds of functionality into this platform. So number one, the processor needs to be efficient and performant, and also be able to support all kinds of security, and at the system level we are able to bring those features as well. And when we bring these things together, it's going to provide the best value for customers. So we are super excited for this partnership, and really, really excited for what value it will bring for our customer base.
S
Safi Fishov2:17
Yeah, I think one thing you hit on that's important in the partnership is what customers care about and the way we're serving our customers. One, AMD CPUs have the highest core counts, best TCO, and lowest power consumption for any particular performance level, and Super Micro brings not just engineering development and AI talent but your own manufacturing, which helps us with time to market which in a market like this is critical. So thank you for that.
V
Vik Malyala2:41
Absolutely, thank you. I mean, you said it right, because we design, develop, and manufacture everything in-house. That actually gives us the flexibility to adopt a so-called building block solution, which will bring the technology first to market, and we are able to optimize at any level. And that's basically the way that we bring the best value for customers.
S
Safi Fishov3:02
One problem I've observed here that our mutual customers are trying to resolve is how to generate further revenue and monetize their networks as they are today. Moving to a virtualized solution is one step with your server and our CPU, but there's also an AI component that we think can help our customers do even more. What are your guys' thoughts on that?
V
Vik Malyala3:22
I mean, AI is an absolute important factor of this entire equation, and you may very well know that we've been working closely with AMD in bringing these technologies related to AI. So for example, for a small workload, you can typically use EPYC AI for certain inferencing applications, but at the same time for people who are looking for larger workloads, whether it's training or inference, we do need to work on a larger project, which is why we are working with AMD with MI300X. So this is something that we have already launched and we've been seeding to different customers, and feedback has been extremely positive. At the same token, we also have MI300A, which is actually used for HPC but can be used for other applications as well. So the way the industry is evolving, as more people start porting their applications and start working on this, is going to bring incredible value for our customer base. So again, super excited about that.
S
Safi Fishov4:13
All right, thank you Vic, thanks Mor for being here. Really appreciate your time.
