CEOInterviews.AI
Start App
Sid Sheth
Founder, President and CEO, d-Matrix

NVIDIA Challenger on Why Inference is the Next Multi-Trillion Dollar AI Market

📅 Nov 14, 2025 The Information 8 MIN 505 VIEWS 29 SEGMENTS · 2 SPEAKERS
Sid Sheth, CEO of d-Matrix, explains why the inference stage of AI—where monetization and productivity happen—is not a "one size fits all problem." He details how d-Matrix's chip is optimized for efficiency and smaller language models. TITV airs on YouTube, X and LinkedIn at 10AM PT / 1PM ET. Or check us out wherever you get your podcasts. Subscribe to: The Information on YouTube:    / @theinformation   The Information: https://www.theinformation.com/subscr...

Questions asked in this interview

7
  1. 0:28Let's talk chess. How about that?
  2. 0:34You talk about faster, more cost-efficient, it's cheaper. How are you doing this?
  3. 3:41Have you sold the chip to customers?
  4. 3:59So you sold the Corsair chip to customers. Who's using it?
  5. 4:45Any challenges actually getting or finding capacity from their end to make the chip for you?
  6. 6:05I can't imagine that every flagship venture firm has the expertise to really know what it takes to make a chip, right?
  7. 6:55Does it not scare you? Does it inspire you?
Host 0:00 ↗
Another Nvidia challenger is picking up steam and raising new funds for its rival chip. d-Matrix announced this week it has raised $275 million at a $2 billion valuation. The company says its technology is 10 times faster, three times cheaper, and three to five times more energy efficient than GPU-based systems. Joining me now is Sid Sheth, the CEO of the company. Sid, welcome to the show. It's great to have you here.
Sid Sheth 0:27 ↗
Yeah, how are you? Pleasure to be here.
Host 0:28 ↗
I'm doing well. Let's talk chess. How about that?
Sid Sheth 0:32 ↗
People love it. I can talk it 24/7.
Host 0:34 ↗
Well, I trust you're pretty good at it because you just raised a lot of money [laughter], and so clearly some folks believe in the way that you talk about it. Tell me, why is d-Matrix's chip better than Nvidia, as I talked about the stats up front? Okay. You talk about faster, more cost-efficient, it's cheaper. How are you doing this?
Sid Sheth 0:55 ↗
Yeah. So I think let's peel the onion on that a little bit, right? And let's take a step back. So first of all, d-Matrix is focused on inference, right? We don't focus on training, which is the other piece of AI computing which, you know, Nvidia GPUs are extremely good at, right? When we started the company in 2019, we had a singular mission: focus on the other piece, which is inference — where AI actually gets deployed, where monetization of AI happens, decisions get made, productivity is unleashed.
And, you know, back in 2019, I'll be honest, you know, when I would visit investors and talk to them about inference, it was a word that most people didn't even understand, right? They were like, what is inference? And now, post ChatGPT, post DeepSeek, the whole world is talking about inference. How do we make inference available to all of humanity? Every human on the planet wants to use compute for inference specifically. Very few people want to train models, but everybody wants to use AI and use inference, right? So it's not really a one-size-fits-all problem. It is not like you can build one chip that serves all of humanity's needs for inference, right? So you really need something that is different strokes for different folks.
And when we talk about how we are better than GPUs at certain types of workloads, certain types of applications, you know, the 10x faster, 3x energy efficient, 3x cost efficient — again, the whole premise of the platform that we built at d-Matrix was around optimizing for efficiency. And when we talk about efficiency, it's about doing more with less, right? And what are the three most critical resources that humankind cares about? Well, it's time, it's energy, and it's money, right? So if you find a way to do more compute, more inference compute, with less time, with less dollars, with less energy, that would be a clear win.
Now, we also realized that we really can't do this for every single application out there, right? Because, you know, the GPU today is a more general-purpose acceleration engine. What we were building is a more dedicated accelerator for inference, and we started our journey with a focus on what we call specific applications that run on smaller language models. That's what we focused on today, and...
Host 3:09 ↗
So really narrowing in on a specific application.
Sid Sheth 3:12 ↗
That's right. That's right. What we're hearing from most customers is like, look, you know, most applications, enterprise applications today, run on these smaller sub-100-billion-parameter models, right? The frontier models that are, you know, call it trillion-parameter models, you know, more suited for AGI, right? More general-purpose AI. So there is going to be a segment of companies that chase AGI, frontier models — that is not what d-Matrix is focused on. We're really focused on the enterprise-class smaller models.
Host 3:41 ↗
Let me ask you: where is the product at now in its development? Have you finished the development of a chip? Have you sold the chip to customers?
Sid Sheth 3:51 ↗
Yes. Yes. Yes. All of the above. The product is in customers' hands. They are testing the product. It's being piloted.
Host 3:59 ↗
Okay. The Corsair chip is the flagship chip you have. So you sold the Corsair chip to customers. Who's using it?

12 more exchanges in this transcript

Sign in free to read the rest of this interview. No card required.

Sign in to read the full transcript

Cite this transcript

APA, MLA, BibTeX
APA

Sheth, S. (2025, November 14). NVIDIA Challenger on Why Inference is the Next Multi-Trillion Dollar AI Market [Interview transcript]. The Information. CEOInterviews.AI. https://ceointerviews.ai/interview/3026857/

MLA

Sid Sheth. "NVIDIA Challenger on Why Inference is the Next Multi-Trillion Dollar AI Market." The Information, 14 Nov. 2025. Transcript, CEOInterviews.AI, https://ceointerviews.ai/interview/3026857/.

BibTeX
@misc{sheth2025_3026857,
  author       = {Sid Sheth},
  title        = {NVIDIA Challenger on Why Inference is the Next Multi-Trillion Dollar AI Market},
  howpublished = {Interview transcript, The Information. CEOInterviews.AI},
  year         = {2025},
  month        = {nov},
  url          = {https://ceointerviews.ai/interview/3026857/},
  note         = {Speaker-attributed transcript with timestamps}
}