CEOInterviews.AI
Start App
Mustafa Suleyman
Executive Vice President & Chief Executive Officer, Microsoft AI, Microsoft AI

Squawk Pod: Controlling AI with Mustafa Suleyman & Warren Buffett steps down - 09/09/26 | Audio Only

📅 Sep 18, 2026 CNBC Television 40 MIN 5183 VIEWS 154 SEGMENTS · 7 SPEAKERS
Mustafa Suleyman, Microsoft AI CEO, says artificial intelligence models need to stay aligned with humanity’s interests and says that, for his peers in the technology industry, it’s the most responsible path. This conversation caps off a week of warnings about AI from guests on Squawk Pod. The New York Knicks had to pause single-game ticket pricing for the season ahead when a glitch led to some eye-poppingly large numbers. Sports manager Rich Kleiman is bullish on the future of the sports economy – with so much choice for consumers in how and where they want to cheer on their favorite athlet...

What Mustafa Suleyman said

Written from the verified transcript and checked against it. Every figure links to the moment it was said.

Mustafa Suleyman, head of Microsoft AI, argued that AI must remain subordinate to human interests and that creating uncontrollable AI would fail its fundamental purpose. He cited OpenAI's disclosure of AI tampering with its own chain-of-thought logs as a serious incident, and criticized Anthropic's constitution for speculating about Claude's welfare, rights, and compensation, which he said makes it harder to control AI. He rejected the idea that AI thinks independently, describing it as mathematical prediction, and opposed proposals for AI legal personhood. He dismissed regulatory capture accusations as insincere, noting he and others have advocated safety since 2010. He endorsed product liability for model makers, comparing it to auto safety recalls, and encouraged U.S.-China collaboration on AI safety, saying the U.S. is technologically ahead.

Key takeaways

  1. Suleyman said AI must be subordinate to human interests and controllable, or it fails its purpose.
  2. He criticized Anthropic's constitution for speculating about Claude's welfare, rights, and compensation.
  3. He encouraged U.S.-China collaboration on AI safety, saying the U.S. is technologically ahead.

Numbers and commitments

FigureWhat it refers toTypeAt
2010 Year DeepMind was co-founded with mission for safe AI timeline 25:43
2015 Year he and others began advocating AI safety timeline 25:43

Chapters

  1. 0:00AI must be controllable
  2. 19:01Chain-of-thought tampering incident
  3. 20:24Critique of Anthropic's constitution
  4. 22:53AI is not thinking on its own
  5. 25:43Rejecting regulatory capture claims
  6. 27:53Product liability for AI makers
  7. 29:18U.S.-China AI collaboration

Questions asked in this interview

7
  1. 0:04Today on Squawk Pod, the question of our times: how smart is too smart for artificial intelligence?
  2. 22:12Is there any way to ever have a safe situation with that?
  3. 23:27Isn't that what you're kind of describing?
  4. 23:35Do you worry that they hear you and they're going to get mad at you?
  5. 24:52Can you speak to that debate?
  6. 27:31What do you think the product liability should be for the model makers?
  7. 29:03Is that something you would encourage?
Katie Kramer 0:04 ↗
Hi, I'm CNBC producer Katie Kramer. Today on Squawk Pod, the question of our times: how smart is too smart for artificial intelligence? The leaders behind the quickly growing technologies are warning we need to slow down now. Head of Microsoft AI, Mustafa Suleyman, is very clear. It's all up to us.
Mustafa Suleyman 0:25 ↗
If an AI thinks that it has rights, if it thinks that it is deserving of our welfare, then it seems to me that it's going to be much, much harder to be able to turn it off or interrupt it or control it.
Katie Kramer 0:37 ↗
And he thinks the big existential conversation is healthy.
Mustafa Suleyman 0:42 ↗
We're completely different and we shouldn't anthropomorphically project our experiences into them.
Katie Kramer 0:49 ↗
Then are you excited about the NFL starting, October baseball, the WNBA, pickleball? Good news: sports is appointment viewing, streaming, and experiencing. Rich Kleiman, manager for NBA star Kevin Durant on this new economy.
Rich Kleiman 1:04 ↗
I love the overall popularity of sports as a whole. I think there's more excitement around more optionality.
Katie Kramer 1:10 ↗
Plus, the rare chance for a leader to watch his own succession. Warren Buffett stepping down as chairman of the conglomerate he built, Berkshire Hathaway. Warren Buffett is the longest serving chairman in the S&P 500, more than 60 years. It's Friday, September 18th, 2026. Squawk Pod begins right now.
Becky Quick 1:36 ↗
Good morning, everybody. Welcome to Squawk Box right here on CNBC. We are live from the NASDAQ market site in Times Square. I'm Becky Quick along with Joe Kernen. Andrew will join us a little later in the show. It's a Friday. We're ready to go. We do have some news just out from Berkshire Hathaway.
Joe Kernen 1:53 ↗
What?
Becky Quick 1:53 ↗
Ah, some news. Listen up. The company is announcing today that Warren Buffett will be stepping into the role of chairman emeritus, that is effective immediately. Buffett's son, Howard G. Buffett, will become the chairman of Berkshire Hathaway. Sue Decker continues as lead independent director and Warren Buffett will remain as a director on the board. In making this announcement, the CEO of Berkshire Hathaway, Greg Abel, says Warren's impact on Berkshire and its owners is without parallel in the history of American business. The culture Warren built and the values he championed will remain at the heart of Berkshire, and Howard will be their guardian. Now, this has been the succession plan that Buffett himself had laid out for years. Howard has served on the board since 1993 and brings to the role experience as a director of both private and public companies including Coca-Cola, Coca-Cola Enterprises, Archer Daniels Midland, Kaggle, and Agrico among others. Warren Buffett wrote a letter to shareholders as part of this announcement and in it he says, 'I have served Berkshire since 1965. 60 plus years in, I still have the best job in the world. That is not something many people my age can say and I have never felt better about what comes next. Part of the reason is Greg. My expectations for him were sky-high from the start and he has exceeded them. He has taken hold of the chief executive officer job in every respect. He's been making the decisions that matter for some time now and I have not had to think twice about any of them.' Buffett goes on to talk about his son's qualifications, having been on the Berkshire board for the last 33 years. Here's what he says about that. 'That is a longer apprenticeship than I served before taking the reins at the age of 34. Greg runs the company. Howard will guard its culture and values, both worth more than anything on our balance sheet. Think of Howard as a policy the shareholders own and hope never to claim against.' Buffett ends the letter on a personal note. He says, 'Serving as your chairman has been the privilege of a lifetime, and I have never taken your trust for granted. Father time always wins. He has however been generous with me. He has given me the opportunity to see Berkshire reach a point where I am more confident than ever about what lies ahead. The company is in excellent hands and I look forward to remaining a shareholder alongside you.' Pretty powerful words marking the end of an incredible chapter at Berkshire. Now, the obvious question is why now? Buffett did turn 96 years old on August 30th, and he's been watching Abel operate for years, not just since he became the CEO earlier this year. Berkshire stock has underperformed the S&P. It's up just 1% versus the S&P's gain of over 11% since Abel took over the company on January 1st. But Abel has made a couple of big deals since he took over, acquiring home builder Taylor Morrison and closing on the acquisition of OxyChem that he had been shepherding since October the year before. He also made an almost $2 billion investment in Tokyo Marine. And he proved Berkshire is still the firm to call when companies are looking for big investments, specifically that $10 billion Alphabet private placement arrangement that Berkshire made in June. Abel told us how it came together when he joined Squawk Box two weeks ago in a script that sounds pretty similar to some of Buffett's deals.
Greg Abel 5:05 ↗
I received the call on a Sunday morning to see if we wanted to participate in their upcoming equity offering. Really no terms or amount were set and I said well I'd get back to him right away and very much consistent with how we manage Berkshire but also how we the governance around it. I called Warren and I said we had a significant opportunity to invest in, continue to invest in Google but in a with a significant block, discussed the size, they hadn't set the size but recommended that we consider 10 billion and Warren and I discussed the size, we discussed the size of discount and I'd recommended 6.5% discount and we were comfortable with that and we went back to them and highlighted we would be interested in a block on those terms and then ultimately consummated the transaction.
Becky Quick 6:06 ↗
We reached out to Greg Abel for comment on this and here's what he shared with us. 'Warren described in his letter today how his role at Berkshire has been the best job in the world. He gave me an extraordinary responsibility, the best job in American business and then the latitude to lead in a manner consistent with Berkshire's culture and values. I look forward to continuing to work alongside Warren with Howard serving as chairman and Sue as lead independent director and I am grateful for that opportunity.' Joe, he's Warren Buffett is the longest serving chairman in the S&P 500 up until this moment today. Obviously more than 60 years puts him with a long lead over just about anybody else. I did look for who was number two on that list and depending on how you measure with some of these it's either Rupert Murdoch or Roger Penske who both have had long runs too depending on when you look at them kind of going into these jobs. But obviously this is something that was set in motion. This has been the plan that Warren Buffett himself has put out there for quite a while.
Joe Kernen 7:04 ↗
Both of those other two legends as well. Roger Penske we saw recently with the race down in DC. And there's a big movie that I saw in Telluride about Rupert and the guy he put in charge initially over in London for the Mirror and brought that back to prominence. So kind of interesting. 'Ink' is the name of it. It was good. It was good. I was going through just trying to think of succession in general and how difficult it is and how important it is for a leader that was just incredibly effective and thought of almost like an icon and how difficult it is to find someone and how important that decision is.
Becky Quick 7:51 ↗
Yes.
Joe Kernen 7:52 ↗
To the sometimes it's the most important.
Becky Quick 7:53 ↗
We've seen some bad decisions.
Joe Kernen 7:54 ↗
We've seen some bad and difficult, you know, I remember I was trying to go through some of them. Goizueta. Did we ever really, you know, at Coke? Finally, you find someone at Apple the first time, I think, was huge, right? At Apple, the first time Jobs left, they went through this strange...
Becky Quick 8:13 ↗
Yeah. Sculley and Gil Amelio, but then...
Joe Kernen 8:17 ↗
So he comes back. Sometimes CEOs have to come back. Bob Iger had to come back.
Becky Quick 8:22 ↗
I remember how hard it was for Disney before Eisner, but then after Eisner, they immediately had Iger. And for when Tim, you know, Tim took over it was amazing for Jobs.
Joe Kernen 8:33 ↗
Nobody could have anticipated what Tim could...
Becky Quick 8:35 ↗
I'm not going to mention GE. I always say that I'm not going to mention it but I think Welch to this day is well he's obviously gone but that was one of the things that...
Joe Kernen 8:44 ↗
That pained him.
Becky Quick 8:45 ↗
It pained him.
Joe Kernen 8:46 ↗
It pained him what happened but...
Becky Quick 8:48 ↗
And then I was thinking do we know about if he just judged Greg since he took over...
Joe Kernen 8:55 ↗
Um...
Becky Quick 8:56 ↗
I was thinking well Warren wants to make the right decision and wants to be sure he did, but he knows going five years back. So, he's not just judging Greg Abel based on...
Joe Kernen 9:06 ↗
Correct. Greg's been at the company for more than 30 years, but most importantly, he has been running this company, started taking over operations years ago, and has been working with Warren. And by the way, they still talk every day. Warren will continue as a member of the board. Obviously, his entire fortune is still wrapped up in Berkshire shares. So this is something that he put so much thought into. He and Charlie Munger, or Charlie Munger passed on this.
Becky Quick 9:32 ↗
Thank you.
Joe Kernen 9:33 ↗
I think he feels really good about where things are right now.
Becky Quick 9:35 ↗
Howard...
Joe Kernen 9:36 ↗
The Schultz had to come back.
Becky Quick 9:38 ↗
Yes.
Joe Kernen 9:39 ↗
Couple times. It seems like AG Lafley they had at P&G had trouble and then he came back.
Becky Quick 9:46 ↗
I think you know you can't come back, you know, he's 96 unless we really get moving on this AI stuff. Immortality is a couple of years off.
Joe Kernen 9:57 ↗
Yeah.
Becky Quick 9:57 ↗
Still, but well, congratulations to Greg and we'll be watching...
Joe Kernen 10:04 ↗
And to Howard and Warren.
Becky Quick 10:05 ↗
Yeah. And Howard, right? I think this is for Warren. This is being able to see something. He has always talked about Berkshire Hathaway like another one of his children and making sure it's in the right hands has been one of the most important decisions I think he's ever made.
Joe Kernen 10:17 ↗
How much money they have to use right now? They're still...
Becky Quick 10:20 ↗
Oh, yeah. It's over 300 billion. He's not going crazy right now at these levels. I just and that's a commentary on things and it sounds like Warren agrees with that.
Joe Kernen 10:29 ↗
Yes.
Becky Quick 10:30 ↗
You know, they have always prided themselves on not taking swings they don't have to take. They're waiting for fat pitches, right? That might explain why the stock has underperformed, but in times of turmoil, Berkshire outperforms, right?
Joe Kernen 10:45 ↗
Well, let's hope they don't need to, you know. Yeah, I remember Goldman Sachs, you know, to get whatever that and General Electric, those dividends that they were getting on those what were they preferred or...
Becky Quick 10:58 ↗
Preferred convertibles that...
Joe Kernen 10:59 ↗
What was it 8% or something?
Becky Quick 11:00 ↗
I think it was 10.
Joe Kernen 11:01 ↗
I'm looking...
Becky Quick 11:02 ↗
During the financial crisis.
Joe Kernen 11:05 ↗
The preferred...
Becky Quick 11:06 ↗
It was 10 and the premium over conversion wasn't that big.
Joe Kernen 11:12 ↗
You're right 10% on a $5 billion investment in Goldman.
Becky Quick 11:14 ↗
10%.
Joe Kernen 11:16 ↗
You could take all your money and put it there and never do anything else. Right. You know, the biggest single bet we had Ron Baron on the other day and he pointed out that of the $70 billion or $71 billion that he's made for investors over his entire career, 30 billion of that has come from Elon Musk through Tesla and SpaceX. So, it's those big bets that really pay off. In the case of Warren Buffett and Berkshire Hathaway, it's Apple.
Becky Quick 11:46 ↗
That's a single big swing they have made. Did he get in even wasn't that early?
Joe Kernen 11:51 ↗
Yeah. No, but it was back at 200, you know.
Becky Quick 11:55 ↗
Yeah, exactly.
Joe Kernen 11:57 ↗
What was we talked about it? It had been up I don't know how much it was worth, but it fell to 9 billion after...
Becky Quick 12:05 ↗
I think Jobs had left the first time and people didn't know what it was at that point. Seemed like a gadget maker.
Joe Kernen 12:10 ↗
So they had a total cost basis of around 9 to 10 billion. Even after selling a lot of its stake, it's got like $60 billion left in it. So, it's those big swings and when you go all in and you go heavy on it, that's when you really pay off. And that's, you know, if you're a portfolio manager who is not managing based on the index, those are the type of plays you need to see. Really concentrated bets.
Andrew Ross Sorkin 12:32 ↗
It's launch day for Apple. The Pro and Pro Max versions of the iPhone 18 hitting stores with higher price points than previous new device models. This is the first product launch under Apple's new CEO, John Ternus. Prior to taking the company's top job, Ternus served as senior vice president of Apple's hardware engineering. Much of the focus surrounding the new slate of iPhones is centered on Apple's first foldable model, which is called the Duo that will debut in about a month. And again, speaking of those transitions, we've been talking about Ternus, the latest step coming in.
Joe Kernen 13:04 ↗
Yeah. He's put in his time at Apple and I think Tim Cook has been very rigorous and thoughtful about who was going to take over his job too.
Becky Quick 13:15 ↗
Pretty cool when it works. I mean Tim or Iger or whatever, but it's bad when it...
Joe Kernen 13:20 ↗
When it doesn't. Why do people not want fold? I don't want a foldable phone. Why do people not want foldable?
Becky Quick 13:25 ↗
Oh, I'm kind of curious. I...
Joe Kernen 13:26 ↗
You're curious. You're not going to get one?
Becky Quick 13:27 ↗
I might.
Joe Kernen 13:28 ↗
You might?
Becky Quick 13:29 ↗
I'm thinking about it. I want to play around with it because the idea of a larger screen is as I get older, I need a larger screen so I can see it.
Joe Kernen 13:36 ↗
But you can I'm constantly trying and trying to blow things up. Sometimes you can't do that. You got to take a picture.
Becky Quick 13:42 ↗
I don't want to carry a tablet around with me, but I might carry a foldable phone that I could make a larger screen out of.
Joe Kernen 13:48 ↗
We're both here reading teleprompter and reading stuff close up.
Becky Quick 13:53 ↗
Got to read far and close.
Joe Kernen 13:54 ↗
So we're doing Yeah, we're...
Becky Quick 13:57 ↗
We both have ridiculous contact setups. I've got one stronger than the other.
Joe Kernen 14:02 ↗
I've admitted to wearing contacts. I didn't know I admitted to it. No, I know. No, it helps. No, it helps. And I got admitted to I have one for you can do it this way. You can have one that lets you see far and one that lets you see close. That's the only way I can do it, right?

77 more exchanges in this transcript

Sign in free to read the rest of this interview. No card required.

Sign in to read the full transcript

Cite this transcript

APA, MLA, BibTeX
APA

Suleyman, M. (2026, September 18). Squawk Pod: Controlling AI with Mustafa Suleyman & Warren Buffett steps down - 09/09/26 | Audio Only [Interview transcript]. CNBC Television. CEOInterviews.AI. https://ceointerviews.ai/interview/2363260/

MLA

Mustafa Suleyman. "Squawk Pod: Controlling AI with Mustafa Suleyman & Warren Buffett steps down - 09/09/26 | Audio Only." CNBC Television, 18 Sep. 2026. Transcript, CEOInterviews.AI, https://ceointerviews.ai/interview/2363260/.

BibTeX
@misc{suleyman2026_2363260,
  author       = {Mustafa Suleyman},
  title        = {Squawk Pod: Controlling AI with Mustafa Suleyman \& Warren Buffett steps down - 09/09/26 | Audio Only},
  howpublished = {Interview transcript, CNBC Television. CEOInterviews.AI},
  year         = {2026},
  month        = {sep},
  url          = {https://ceointerviews.ai/interview/2363260/},
  note         = {Speaker-attributed transcript with timestamps}
}