Inside a nondescript building in the heart of San Francisco, one of the world's buzziest startups is making our AI-powered future feel more real than ever before. They're behind two monster hits, ChatGPT and DALL-E, and somehow beat the biggest tech giants to market, kicking off a competitive race that's forced them all to show us what they've got. But how did this under-the-radar startup pull it off? We're inside OpenAI, and we're going to get some answers. Is it magic? Is it just algorithms? Is it going to save us or destroy us? Let's go find out.
I love the plants. It feels so alive, so amazing. I love it here. It's giving me very Westworld spa vibes. It's almost like suspended in space and time a little bit. Yeah, it has a little bit of futuristic feel.
This is one of the most introspective minds at OpenAI. We all know Sam Altman, the CEO, but Mira Murati is a chief architect behind OpenAI's strategy.
This looks like the OpenAI logo. It is Ilia actually painted this.
Ilia, the chief scientist?
What is the flower meant to symbolize?
My guess is that it's AI that loves humanity. We're very focused on dealing with the challenges of hallucination, truthfulness, reliability, alignment of these models.
Has anyone left because they're like, you know what, I disagree?
There have been over time people that left to start other organizations because of disagreements on the strategy around deployment.
And how do you find common ground when disagreements do arise?
You want to be able to have this constant dialogue and figure out how to systematize these concerns.
What is the job of a CTO?
It's a combination of guiding the teams on the ground, thinking about longer-term strategy, figuring out our gaps, and making sure that the teams are well supported to succeed.
Sounds like a big job. Solving impossible problems?
Solving impossible problems.
When you were making the decision about releasing ChatGPT into the wild, I'm sure there was like a go or no-go moment. Take me back to that day.
We had ChatGPT for a while, and we sort of hit a point where we could really benefit from having more feedback from how people are using it. What are the risks? What are the limitations? And learn more about this technology that we have created and start bringing it into the public consciousness.
It became the fastest growing tech product in history. Did that surprise you? I mean, what was your reaction to the world's reaction?
We were surprised by how much it captured the imaginations of the general public and how much people just loved spending time talking to this AI system and interacting with it.
ChatGPT can now mimic a human, it can write, it can code at the most basic level. How does this all happen?
ChatGPT is a neural network that has been trained on a huge amount of data on a massive supercomputer. The goal during this training process was to predict the next word in a sentence. And it turns out that as you train larger and larger models, add more and more data, the capabilities of these models also increase, so they become more powerful, more helpful. And as you invest more on alignment and safety, they become more reliable and safe over time.
OpenAI has kind of turbocharged this competitive frenzy. Do you think you can beat Google at its own game? Do you think you can take significant market share in search?
We didn't set out to dominate search. What ChatGPT offers is a different way to understand information. You could be searching, but you're searching in a much more intuitive way versus keyword-based. I think the whole world is now moving in this direction.
The air of confidence that ChatGPT sometimes delivers an answer with, why not just sometimes say 'I don't know'?
The goal is not to predict the next word reliably or safely. When you have such general capabilities, it's very difficult to handle some of the limitations, such as what is correct. Some of these texts and some of the data is biased, some of it may be incorrect.
Isn't this going to accelerate the misinformation problem? I mean, we haven't been able to crack it on social media for like a couple of decades.
Misinformation is a really complex, hard problem. Right now, one of the things that I'm most worried about is the ability of models like GPT-4 to make up things. We refer to this as hallucinations. So they will convincingly make up things, and it requires being aware and just really knowing that you cannot fully blindly rely on what the technology is providing as an output.
I want to talk about this term hallucination because it's a very human term. Why use such a human term for basically an AI that's just making mistakes?
A lot of these general capabilities are actually quite human-like. Sometimes when we don't know the answer to something, we will just make up an answer. We will rarely say 'I don't know.' And so there is a lot of human hallucination in a conversation, and sometimes we don't do it on purpose.
Should we be worried about AI though that feels more and more human-like? Should AI have to identify itself as artificial when it's interacting with us?
I think it's a different kind of intelligence. It is important to distinguish output that's been provided by a machine versus another human. But we are moving towards a world where we are collaborating with these machines more and more, and so output will be hybrid.
All of the data that you're training this AI on, it's coming from writers, it's coming from artists. How do you think about giving value back to those people when these are also people who are worried about their jobs going away?
I don't know exactly how it would work in practice that you can sort of account for information created by everyone on the internet. I think there are definitely going to be jobs that will be lost and jobs that will be changed as AI continues to advance and integrate in the workforce. Prompt engineering is a job today that's not something that we could have predicted.
Think of prompt engineers like AI whisperers. They're highly skilled at selecting the right words to coax AI tools into generating the most accurate and illuminating responses. It's a new job born from AI that's fetching hundreds of thousands of dollars a year. What are some tips to being an ace prompt engineer?
It's this ability to really develop an intuition for how to get the most out of the model, how to prompt it in the right ways, give it enough context for what you're looking for. One of the things that we talked about earlier was hallucinations and these large language models not having the ability to always be highly accurate. So I'm asking the model with a browsing plugin to fact-check this information, and it's now browsing the web.
There's this report that these workers in Kenya were getting paid $2 an hour to do the work on the back end to make answers less toxic. And my understanding is this work can be difficult, right? Because you're reading texts that might be disturbing and trying to clean them up.
We need to use contractors sometimes to scale. We chose that particular contractor because of their known safety standards, and since then we've stopped working with them. But as you said, this is difficult work, and we recognize that, and we have mental health standards and wellness standards that we share with contractors.
I think a lot about my kids and them having relationships with AI someday. How do you think about what the limits should be and what the possibility should be when you're thinking about a child?
I think we should be very careful in general with putting very powerful systems in front of more vulnerable populations. There are certainly checks and balances in place because it's still early and we still don't understand all the ways in which this could affect people.
There's all this talk about relationships and AI. Could you see yourself developing a relationship with an AI?
I'd say yes, as a reliable tool that enhances my life, makes my life better.
As we ponder the existential idea that we might all have relationships with AI someday, there's an AI gold rush happening in Silicon Valley. Venture capitalists are pouring money into anything AI startups hoping to find the next big thing. Reid Hoffman, the co-founder of LinkedIn and an early investor in Facebook, knows a thing or two about striking gold. He was an early OpenAI backer and is in a way trying to take society's hand and guide us all through the age of AI.
I mean, gosh, 12 years we've been talking, maybe longer. A long time.
You have been on the ground floor of some of the biggest tech platform shifts in history: the beginnings of the internet, mobile. Do you think AI is going to be even bigger?
I think so. It builds on the internet, mobile, cloud, data. All of these things come together to make AI work, and so that causes it to be the crescendo, the addition to all of us. One of the problems with the current discourse is that it's too much of the fear-based versus hope-based. Imagine a tutor on every smartphone for every child in the world. That's possible. That's line of sight from what we see with current AI models today.