Welcome back, everyone. In this segment, we have a special guest, Sam Altman, who will tell us all about AI as a career choice. Sam is a founder and CEO of OpenAI. Before OpenAI, Sam was the president of Y Combinator. Before that, he was the founder and CEO of Loopt, and before that he was a student at Stanford. I have to tell you one story about Sam. In my courses at Stanford, I often pose hard problems for the students to think about. And I can tell you that in all my years of teaching, Sam was the only undergraduate who ever came up with a novel research idea on any of these problems. So that's Sam for you. Sam, welcome and thank you so much for taking the time to speak with us.
Of course. Really happy to get to do this.
Awesome. OK. We have a lot of questions to discuss, so why don't we dive right in? So I wanted to start with a high-level question, just to kind of set the tone. And so just in your mind, what would you say are the biggest open questions in AI for people to work on?
There's still so much. I mean, I think we've identified this one incredible thrust of deep learning, and we've seen how far that can go. But I think we're still in the very early innings. The way we do these systems gets so much better every year. I think that'll keep going for a long time. Data efficiency is still a huge problem. That's still one thing that humans can do very different than these systems. I think the way that we separate these concepts of pre-training and RL, somehow there's something new to discover there. But I think we could go on for a long time about all the things we still don't know. We have one piece of magic, which is this algorithm that can learn, and we keep finding new ways to do more impressive things with that. It's only been two and a half years since ChatGPT launched, and if you go back and use that original version, it's quite bad. So the rate of progress is still super steep, but the list of problems in front of us and the list of unknowns still just is huge. What it's going to take to build a system that can go autonomously, discover new science, which for me is very important to go build? Still a lot of work to do.
So a lot of people talk about the training data problem, that we're kind of running out of training data. Is that do you think in an area where there's a need for a lot more work?
That's another way of saying the data efficiency problem. We're not running out of data if we can learn way, way more from each terabyte of data. How is it that we are able to learn from just our senses? I would like to know that. That's an interesting it-- clearly, the way these systems are learning and the way we learn is a little bit-- at least a little bit different. Maybe it's very different. But yeah, the human ability to learn from a single data point, quite impressive. Yeah, just a few data points, and we're able to generalize. Yeah. These things need-- for some reason they need a lot of data points and they generalize from that. So I guess there's a lot more to do in terms of figuring out exactly how we are able to do it.
Yeah. It's interesting, one of the questions that comes up is, are we just trying to build human abilities or are we trying to go beyond human abilities?
I think in many ways these systems are already beyond human abilities. Not in every, but there's certainly vastly superhuman at some things.
Yeah, it's funny, one of our AI faculty likes to say that the goal of AI is not to build humans. We already know how to make humans. The question is basically, how do we build something different? And I guess that's kind of where you're going.
In some sense you can tell a story of human civilization, which is what matters-- the superintelligence that already exists is not any one genius's brain, but it's the scaffolding and the sort of technology tree and tool chain that we all create between us. So it's all of the accumulated knowledge, artifacts, tool chain that builds on each other over time. And no one person could go from digging stuff out of the ground to producing a computer. There's a lot of stuff that has to go into that. But collectively, society is able to do this crazy thing. And we make scientific discoveries. We can manipulate matter in new ways. We can do all these amazing things. And AI will just, in some deep sense, be another contributor to that scaffolding outside of anyone's neural network, human or artificial. And if the AI goes off and discovers novel physics, and then humans can use that to do new things, like, is that going to feel like the AI was the superintelligence? Is that going to feel like the scaffolding just got taller? I don't know.
Oh my god. I can't wait until an AI actually writes the first research paper that gets published in a journal.
Maybe not that long. Yeah, that would be awesome.
So I want to switch gears a little bit, and clearly there's a lot more to do in AI. I would say it sounds like-- you're saying also that we're really only at the beginning of this journey.
It feels like it. The area is going to grow dramatically. There's no fear of lack of things to do in AI.
So if students decide to go into AI, it sounds like there's a lot to do.
Look, I'm biased and you should always be skeptical of anyone talking up their own book, but I think it is the best field to go into right now.
OK, great. I'm glad you said that because that's exactly what I wanted to ask about. So the people that are taking this class, they have obviously-- generally folks who work in computer science have a lot of different areas they can work in. So people can work in finance, they can work on consumer apps, they can work on biotech, maybe they can work on a technology for education. There's lots of different areas that once you have CS knowledge, you can contribute to society with. So what advice would you give to someone who, say, is considering an offer from an AI company or an AI startup versus, say, a company that's working in finance or biotech? Or how do you decide which of these areas you would like to go into?
First of all, you should do whatever you most want, and you should work with the people that you're excited about the problem that speaks to you or whatever. And I think that is more important than any piece of generic advice. But if you want the generic advice, at any given time in human history, there are only a small handful of most important scientific frontiers to push on. And at different times in history, it's been physics or biology or parts of computer science or building out the internet. Right now, I think the top one is building our knowledge and understanding and deployment of artificial intelligence. I think it's the most important trend right now. It's probably the most important trend of this generation. It might be the most important thing of a much longer period of time. And it's very lucky to be alive and working during such a incredibly huge tectonic shift. And my biased and generic advice is you have the opportunity for this to be the most important work you ever touch in your life, and you should jump on that.
Yeah, so this is kind of a unique time. It feels like a very special time.
Yeah, where AI is the main technology that's being developed. So why would you not be part of this? The main technology that's being developed, it's also the thing that will have probably the biggest sort of total impact on everything else.
Yeah, that actually makes total sense. And so I guess our audience, when they evaluate different job offers, I guess it kind of makes sense to think about-- obviously you want to be in a company that's leading developments.
Yeah, makes complete sense. And so let's try to fast-forward a few years, and say, it's always hard to predict the future, but let's try to predict the future. I'm just curious how you think of this. So if we fast forward five, maybe 10, maybe even 20 years, do you think AI is going to be as hot as it is today, or do you think at some point it's going to peak and some other area will take over? Of course that's going to happen eventually, but how long is it going to take?
The world will be more dependent on it, but the world may be so used to it that we don't think about it in the same way. I remember in-- we were at the App Store launched like 2008 or something. There were a couple of years right after that where everybody was talking about, I'm going to be a mobile first, whatever. I'm a mobile company, I'm a mobile this, I'm this, but mobile. And then if you go back 10 years earlier towards the internet boom, I've heard that everybody-- it was the dotcom boom. Everyone was dotcom. It was like the hot thing. And then there was a moment where each of those got an incredible amount of hype and focus, but pretty quickly after you didn't talk about being an internet company anymore, because every company that had an internet strategy. And only a few years after that App Store launched on the iPhone, no one talked about being a mobile company anymore because it was just like, if you weren't, it didn't make sense. I hope that in five or 10 years AI, like that, and no one talks about being an AI company anymore. We expect every product and service to be really smart, and I'm excited for that world. It might mean that AI has less hype than it does today, but it'll be way more powerful and way more integrated into our lives and everything will be using AI. What's interesting is the definition of technology, which is everything that was invented after you were born. So it's kind of amazing that kindergarteners today, they are not going to know a world without ChatGPT. I have a baby, and I spend a lot of time thinking about how he will never be smarter than AI. But he will also never grow up in a world where he does not expect computers, products and services, whatever, not to be really smart and understand him and do whatever he needs.
Since you brought it up, I'm really curious, how would you think about preparing your child for a world like that?
I mean, he'll be able to do things that are just astonishing. When I was a kid, computers were this amazing thing. I was much better at them. I was much better at using them than my parents were. They were still kind of-- they were not new, but they were not as integrated into life as they are now. And I don't think my parents would have known what to do to prepare me for a world with computers other than say, this feels like it's going to be important. You seem interested and I will encourage that. And I don't know what else I can do for my kid besides say, I think it's going to be important, learn to use it. You'll be able to do more things with it than I could have done without it, and that's great. I want you to accomplish way more than I could accomplish if you want. But I think that's the answer. There's the big things to do, teach kids to be resilient and adaptable and curious and creative and all that. But the tactical thing to do is just trust that with new tools, people will do more and encourage our kids to be very fluent with these tools, which they probably will be anyway.
It's interesting you say this because, for example, when cars came along, most of the population basically knew how to drive a car, how to use a car, but they couldn't tell you how a car works. And a small fraction of the population actually dove into actually building engines and understanding exactly-- tinkering. There was a whole subculture of people tinkering with engines and making cars do all sorts of things they weren't designed to do and so on. And the same thing, by the way, with computers. Most of the population knows how to use the internet, but they couldn't tell you how a computer works. And then there's a segment that actually focuses on playing and pushing computers to the limits. I'm curious if you think the same thing is going to be about with AI. The population will be used to using AI, they'll see it everywhere, but probably only a smaller segment will actually understand how deep neural networks work, how to push it to do new things.
For sure. And I think that's great. Like most people who use-- people do incredible things with computers without knowing how every detail of it works. But that's how specialization of labor and this sort of shared tool chain of progress work. I think the most important skill in the future will not be able to be-- will not be being able to build AI, but being able to use AI to do amazing things with it. Just like today. Maybe researchers at OpenAI don't know everything that it would take to go build a computer from the ground up, but they know how to use that computer to create AGI. And that's the next valuable layer to build. And then on top of AGI, there will be a new thing to build, and someone will have to go figure that out. But they may not need to know how to train a neural network.
OK, I was actually hoping you would say that there's actually a need to know the technology and understand how it works. For some people, there is.
Yeah. And I think it's like an incredible-- for now, it's maybe the most valuable skill in the world. Even going forward, it will still, I think, be valuable. My point was just, as we try to imagine 10 years, 20 years out, there may be even more exciting new things we can't imagine yet.
I see. That's actually a really interesting point. So for a computer scientists today, it's kind of valuable to know how DNNs work and how to train them and so on, maybe coming up with new ideas for how to build DNNs or other types of learning algorithms. But you think further out, this is just going to be a tool in our toolbox.
I think so. Yeah. We're all going to just assume it works. I don't know how to make a calculator or maybe I could do it, but it would be like the very limits of what I remember about electrical engineering and such. But I never think about how to make a calculator. I still use one a lot, and there's a bunch of important things in there for me. But it's like a tool that lets me go think about higher-level problems or go work on more impactful stuff. I really don't know how to go make a computer.
Yeah. No, that makes perfect sense. So it makes sense for people to come focus on new applications for AI, new things that we haven't seen before. And maybe that's the cutting edge of where things will go. Yeah, this is amazing. It's really interesting to see what kind of moving into a really interesting future. So I guess the next five, 10 years are going to be pretty exciting.
Yeah. Great. So I want to change gears a little bit and actually talk about the topic of this course. So this course is really about the security of AI systems. So what does it mean for an AI system to be secure? What does it mean for even trying to make it do things it wasn't designed to do? And so during the course, we talked about various attacks like, I'm sure you know, prompt injection attacks, things called adversarial examples. They try to confuse the model. Things like model extraction where you're able to extract the model by interacting with it. And there's a whole list of these. It's kind of a-- AI security is kind of a big topic. Of course, we also talked about defenses, how do we protect AI systems from prompt injections and other attacks like that. So I'm curious, how you, of all the areas of AI-- it's a pretty broad field. It has a lot of sub areas. Some people work on training, some people work on inference. And how do you think of AI security? I guess the concrete question I want to ask is, among all the different things we can do with AI, this course is about learning one sliver of the field. Is this a good area? Should people go?
I think this is one of the best areas to go study. I think we are soon heading into a world where a lot of the AI safety problems that people have traditionally talked about are going to be recast as AI security problems in different ways. I also think that given how capable these models are getting, if we want to be able to deploy them for wide use, the security problems are going to get really big. You mentioned many areas that I think are super important to figure out. Adversarial robustness in particular, seems like it's getting quite serious. One more that I will mention that you touched on a little bit, but just it's been on my mind a lot recently. There's two things that people really love right now that taken together are a real security challenge. Number one, people love how personalized these models are getting. So ChatGPT now really gets to know you. It personalizes over your conversational history, your data you've connected to it, whatever else. And then number two is you can connect these models to other services. They can go off and call things on the web and do stuff for you that's helpful. But what you really don't want is someone to be able to exfiltrate data from your personal model that knows everything about you. And humans, you can trust to be reasonable at this. If you tell your spouse a bunch of secrets, you can sort of trust that they will know in what context, what to tell to other people. The models don't really do this very well yet. And so if you're telling a model all about your private healthcare issues and then it is off and you have it buying something for you, you don't want that e-commerce site to know about all of your health issues or whatever. But this is a very interesting security problem to solve this with 100% robustness. Yeah, so that's an example of something that you could literally make a career out of this. It's like focus your entire attention. AI security I think is probably a very, very undervalued field right now.
Yeah. So I guess the reason I'm asking this is, when you look at the web companies, traditional technology companies like Google, Amazon, they literally have thousands of engineers working on securing the platform. And it sounds like the AI companies are going to have to start investing pretty heavily in building AI security teams. So when you look at our audience, they're wondering what area should they focus on. Suppose they want to switch to AI, what should they focus on? You're saying that probably there's going to be a lot of demand for expertise in AI security?
Yeah, that's fantastic. I'm so happy to hear you say that.
I guess on the question of AI security, there's the flip side of it. I'm curious how you think about this. So far we've talked about security for AI. There's also this question of AI for security, which is really interesting.
Yeah, it's really interesting the fact that ChatGPT is amazing at finding bugs in software. It's really cool. We're starting to do a lot more work on this here. I think that we should be like a superhuman AI security analyst, whatever you want to call it. Pretty soon.
Right. That's like using-- so that sounds like a pretty serious growth area, right? Using basically AI to test software.
Yeah. By the way, it works both directions. You can use it to secure systems. I think it's going to be a big deal for cyber attacks of various.
Oh my god, I'm so glad you said that. Yeah. I'm so glad you said that. So it's kind of odd, when we talk about AI finding vulnerabilities, people immediately think about, oh my god, the offensive capabilities. But the reality is, before you ship your code, you're now going to use an AI system to test your code to find vulnerabilities, and then you're going to fix them. Yeah. So perhaps this is kind of an opportunity for OpenAI that you guys can actually do software testing.
So you see that as potential area where people could focus a lot of their time on?
Yeah. Yeah. Amazing. OK, cool.
So this is wonderful. I wanted to also talk a little bit about your opinion of the impact of AI generally on computer science. And so this touches on what we just discussed. But I have to say, it's really kind of remarkable. Whenever I need to write code, I actually don't write code anymore. I write pseudo code. And then I go to ChatGPT or any of the other engines and convert my pseudocode into real code. My PhD students use this all the time. It's amazing to see this in action. It accelerates their life dramatically and it made life so much easier for them. So I'm really curious since a lot of our audience are developers, people who write code-- I'm kind of curious to hear your thoughts on what do you think software development would look like in two, five, 10 years?
Really different than it looks right now. I think it'll mostly be like talking to a computer. Maybe you express pseudocode, maybe you express something much closer to English.
But if I'm a company building, I don't know, line an app for whatever, deciding on which books to buy or whatever. Yeah. Today, I hire product managers that write specs, and then I hire an army of developers that implement the specs. How do you think that's going to change in the future?