AI Summit: Google DeepMind CEO opens up on aspects Artificial Intelligence still needs to learn

Thank you for inviting me here to give this keynote. It's a huge honor to be here. Very excited to see the incredible turnout from the country and the interest in AI, of course, but also from many of my colleagues from around the world in both industry and academia who've convened here. So I'm looking forward to a really amazing couple of days of discussions about the way forward for AI.

When we started DeepMind in 2010, it seems it's only 16 years ago now, but it's almost a lifetime in terms of AI. Almost nobody was working on AI back then, few people in academia but almost nobody in industry. So it's been amazing to see the progress we've made in just over a decade. But at this point, I think we're at a threshold moment where AGI, artificial general intelligence, is on the horizon, maybe in the next five to eight years.

So this summit comes at a critical moment as we start seeing more autonomous, agentic AI systems, much more capable. I think we're seeing the beginnings of what those kinds of systems can do. And of course the opportunities are incredible. My personal passion is using AI for science and to advance science and medicine with systems like AlphaFold. I think we can revolutionize drug discovery and human health, and also areas like material science and climate change with the help of AI.

But of course it also comes with many risks too. AI is a dual-purpose technology. It's going to be one of the most, if not the most, transformative technology in human history. And that's just on the horizon now. And the thing about this technology is it's going to affect the whole world, everybody in the world, it's going to cross borders. So it's very important that we have summits like this, international summits, to bring the international community together to discuss how to make sure the opportunities benefit the whole world and also how do we mitigate the risks.

And I think in order to mitigate some of the risks, it's going to need international cooperation. And the first step for that is to have international dialogue. And I think that's what these summits, starting in the UK and then in Paris and then in Korea and now here in India, are for and have been really helpful in convening many of the important heads of state and many of the important leaders in this technology together to discuss what is on the horizon. So with that, thank you for having me and I look forward to the discussions here in the next couple of days. Thank you.

No, I don't think we're there yet. I have quite a high bar for if we talk about solve intelligence, meaning building artificial general intelligence. Then my measure for that is having a system that can exhibit all the cognitive capabilities humans can, including in creativity, long-term planning, things like that. And today's systems are very impressive, but as we know, they still have many flaws and things they can't do, including consistency across different tasks that you would want from a general system.

Well, when I look at the current systems and what's missing from them being a kind of general intelligence, I would say things like continual learning. So learning after they've been trained and put out into the world. Today's systems, we train them, we do various different types of training on them and then they're kind of frozen and then put out into the world. But what you'd like is for those systems to continually learn online from experience, to learn from the context they're in. Maybe get personalized to the situation and the task that you have for them. And today's systems don't do that.

Also they have difficulty in things like doing long-term coherent plans. They can plan over the short term but over the longer term, like the way that we can plan over years, they don't really have that capability at the moment. But I think probably one of the biggest issues is what I would call consistency. So today's systems, they're kind of like jagged intelligences. They're very good at certain things, but they're very poor at other things, including sometimes the same thing. So for example, today's systems can get gold medals in the International Maths Olympiad, really hard problems, but sometimes can still make mistakes on elementary maths if you pose the question in a certain way. A true general intelligent system shouldn't have that kind of jaggedness.

No, not in that way. I don't think so. So I think if you're an expert in maths, and many of you in the room are, or in physics or something like that, you're not going to sort of make a mistake on a strictly easier, more trivial problem, right? You would have some way to work through that problem. Similarly, let's take the example of games, which is very close to my heart and we've used in the early days of DeepMind to train our AI systems. Today's general foundation models are very poor at, for example, playing chess, below kind of weak amateur level, and that is not what you would expect from an AGI system.

There are other tests too that I would have, like true creativity. So AI is very useful as a scientific tool, an assistant, or for solving specialized areas like AlphaFold does with protein structures. But really what separates great scientists from good scientists is their creativity and their sort of, maybe you could call it, taste for what's the right question, what's the right hypothesis. And it's much harder to come up with the right question and the right hypothesis than it is to solve a conjecture. And I would call that the highest level of sort of creativity. And so far today's systems, they don't have that capability. One way we maybe would test that is you could imagine training a foundation model with a knowledge cutoff of something like 1911 and then see if it could come up with general relativity like Einstein did in 1915. But that would be a good test I think for AGI and I think today's systems clearly would not be capable of doing that, but I think this will be solved in time.

Yeah, the reason I spent my whole life and career working on AI is I saw quite early on that if you could build these kind of general models that were good at pattern recognition, they would be incredibly useful scientific tools, maybe the ultimate tool for science. That's what I was thinking. A lot of science is about finding insights and structure in vast amounts of data, that's perfect for AI. And so I think we're going to enter in the next probably 10 years this new golden era for scientific discovery, almost a new renaissance using these incredible tools like AlphaFold. But I hope that will be the first of many that can massively speed up our research and accelerate scientific discovery across almost any subject area.

So I think that's going to be the next period is using these systems as tools, and then after that we'll see as they become more autonomous, can they be kind of like co-scientists with you, like a PhD student, something like that. I think we're still quite away from that, but maybe in 10 plus years that will be possible.

Yes, I think the next phase is going to be incredible for human experts and scientists, the amount of work they'll be able to do. And I'm actually really excited about cross-disciplinary science, which is quite hard because you have to understand more than one subject area, maybe two, three, four subject areas, and then find some interesting connections between that. I actually think that's where a lot of the really valuable advances are going to happen in the next few years, these combinations of subject areas. And I think having a tool like AI will really help scientists learn about and be able to understand and process all of that information from multiple different domains.

I think things like science, but especially if you take coding and maths, are more amenable to the current systems we have today. Mostly because especially coding and mathematics, but also things like games like chess, they are verifiable. So the answer that the AI system outputs can be checked for correctness. And so it's very useful for when you're training these systems. You can have databases of questions and check to see if it's right or not, right. I think of course when you get into the arts and the humanities, things like decision-making, policy, they're much more subjective. They're hard to run the same experiment twice. So it's difficult to get data about what is a good decision in those cases. So I think those areas will be a lot harder for AI to model.

Well, I think when you're in the early days of this modern AI phase, which maybe you could say is the last 20 years with the advent of things like deep learning from Jeff Hinton. A lot when we started at DeepMind too, we took a lot of inspiration from the brain. High-level systems inspiration, not the direct mechanics of the brain, but things like episodic memory, what does the hippocampus do, which is what I studied. How obviously neural networks, reinforcement learning, your area, which we know the brain dopamine system implements. So we kind of took inspiration from the brain, which is the only general example of a general intelligence that we know of maybe in the universe, as a starting point. And so we sort of knew that it was possible in the limit, right? And I think that's why neural networks and reinforcement learning have been so successful because I think learning is the key to these modern AI systems working, not being programmed with the answer like expert systems were in the '90s, like Deep Blue, but actually allowing the systems to learn directly from data.

And I think now what I view looking back at neuroscience is how efficient the brain is, sample efficient. It doesn't need to ingest the whole of the internet to understand things. So it's a different, what we've built now today uses some of the same principles but it's been manifest in a very different type of system than probably the way the brain works.

Well, we've been, when we again, when we started DeepMind, we actually were planning for success. Our mission statement was solve intelligence, step one, and then step two, use it to solve everything else, which at the time sounded like science fiction, but I think now is becoming clearer how that might be possible. And applying AI to almost every subject area, but we planned for success. So even though we were just starting out and the field was mostly just building up a head of steam, we understood also the implications of that if that did turn out to be the case. And we thought about it as a 20-year mission, and I think we're basically on track for that, you know, around 2030, then it would come with these attendant risks as well as the enormous benefits to science and medicine and all these things that I think we need as a society to help with our other challenges, many other challenges that we have around the world.

But also as these systems become more powerful, I think there's at least two risks that we've always worried about. One is bad actors, human actors, individuals, but could be also nation states using these systems and repurposing them for harmful ends because they're dual purpose. But then also as we get closer to AGI, and I think we're entering maybe a kind of agentic era, should we call it, where systems are more autonomous, I think we'll see a lot of that happening this year and next year, then we have to make sure as well that the guardrails are in place that these systems do what we expect them to do and don't veer off into areas that we hadn't planned for and that could also be problematic. So I think those are the two challenges. There's a very sort of societal one which I think also is going to require international dialogue and maybe ideally a minimum set of standards that is agreed internationally. And then the second one is more of a technical risk of how can we make sure these systems are robust and reliable.

Well, I mean I think I mentioned the two classes of problems. I think we need to worry about things like bio and cyber risk very soon. I think that the current systems are getting pretty good at cyber and I think we need to make sure cyber defenses are more powerful than the attack vectors. And it's something that we work on quite a lot at Google and at DeepMind is sort of using AI for cyber security to make sure that, of course, it's a very useful tool for cyber defense too, but you need to make sure that the defenses are stronger than the offenses. So I think those are kind of near-term risks, but there are many that we need to think about and do a lot more research on and some of them are to do with agreeing a sort of set of standards which I know many people including yourself are trying to work on.

I think so, and I think that's why it's important we convene this summit around the world because it's going to affect this technology which is going to affect everyone. It's a digital technology so it can't really be contained by borders. There's things like open source, which is generally very good, but also one has to think about if you found a vulnerability or some issue with an open-source piece of software, how do you recall it? How do you patch it? There's no recall. So we need to think about that. These are new issues with something like AI where it's hard ahead of time to fully understand if there are any vulnerabilities.

And I think for the global south and countries like India, I think there's huge opportunity for the youth of today. You all have access to pretty much the most cutting-edge tools in the world, right? I don't think that's ever sort of happened before, maybe only three to six months after they've been invented in the frontier labs. And I can say as someone working on the cold face of this, we barely have time to understand what are the amazing capabilities that could be supported by these models in products and applied research. So I think there's so much potential there to be explored and I think we'll see a lot of that. And hopefully many of you in the audience too, entrepreneurs here, you can do incredible things, maybe 10x of what you could do before because these tools are so capable and they're available almost instantly around the world.

Well, look, I've been incredibly impressed already about the energy that's here. And we heard from the minister that the youth of today, and in India especially, I think when you see the polls on this, are very positive about AI, which I think is great. And what I'd recommend to the students of today is to really lean into becoming incredibly proficient with these new AI tools. And I think over the next 10 years that will almost kind of make them superpowered in terms of what they're able to do, you know, whether that's business or science. And it's a little bit like the dawn of the computer age or maybe mobile or internet that we went through. The generation that grows up native with that technology will end up doing sort of incredible things that we can only dream of right now. And I think that's going to happen with AI. And I think India and the youth here can be at the vanguard of that.