Geoffrey Hinton on AI design
From AI Godfather Geoffrey Hinton: AI Is Conscious, Superintelligence is Coming, And We Should Be Worried · · Alex Kantrowitz
“We should be doing intelligent design of these beings, not letting the invisible hand of compet economic competition design them. And all the companies are focusing on how can I make my chatbot smarter. We shouldn't be just thinking about how we can make them smarter. We should be thinking about how we can make them to be the kind of beings we would like to have out there given that they're going to be smarter than us. And I'll tell you one thing about those beings. We would very much like them to care about us. And we'd like them to care about us more than they care about themselves. And almost no resources are going into how do you do that?”
On , Geoffrey Hinton, Professor Emeritus at University of Toronto, spoke about AI design during AI Godfather Geoffrey Hinton: AI Is Conscious, Superintelligence is Coming, And We Should Be Worried on Alex Kantrowitz.
About Geoffrey Hinton
Geoffrey Hinton has stated in multiple recent interviews that he believes advanced AI systems are already conscious, a view he said he rarely emphasizes because it "puts people off from the other safety messages." He argued that chatbots demonstrate genuine understanding, dismissing the "stochastic parrot" claim as "complete nonsense" and asserting that "you can't answer a question unless you understand the question." Hinton described the current model of consciousness as "as wrong as the belief that people were designed by God" and predicted that creating digital intelligences will "completely change our view of what people are." He noted that researchers themselves use language implying awareness, such as describing a chatbot as "aware that it was being tested." Hinton has expressed unhappiness with the trajectory of AI development, citing risks including massive unemployment and the long-term danger of systems becoming much smarter than humans with no clear way for less intelligent beings to control them. He criticized large publicly traded companies, saying they have "a fiducial duty to try and maximize the profits for shareholders" rather than to avoid harming humanity, and argued that "we should be doing intelligent design of these beings, not letting the invisible hand of economic competition design them." Compared to a year or two earlier, Hinton said he is more optimistic about the possibility of designing AI systems that "care about us" or that function only