... for this session I have a feeling we could go on for the next 6 hours uh but thank you so much Ilia for the talk it was wonderful.
Questions asked in this interview
4
0:14Um, now in 2024, are there other biological structures that are part of human cognition that you think are worth exploring in a similar way or that you're interested in anyway?
1:41I mean, maybe that's too esoteric of a question, but the model will be able to reason and understand when a hallucination is occurring. Does the question make sense?
3:33I have an unrelated question to that: how do you create the right incentive mechanisms for humanity to actually create it in a way that gives it the freedoms that we have as Homo sapiens?
5:40I wanted to ask: do you think LLMs generalize multi-hop reasoning out of distribution?
Thank you. Um, now in 2024, are there other biological structures that are part of human cognition that you think are worth exploring in a similar way or that you're interested in anyway?
So the way I'd answer this question is that if you are or someone is a person who has a specific insight about, hey, we are all being extremely silly because clearly the brain does something and we are not, and that's something that can be done, they should pursue it. I personally don't... well, depends on the level of obstruction you're looking at. Maybe I'll answer it this way: there's been a lot of desire to make biologically inspired AI, and you could argue on some level that biologically inspired AI is incredibly successful, which is all of the PL is biologically inspired AI. But on the other hand, the biological inspiration was very, very, very modest. It's like, let's use neurons. This is the full extent of the biological inspiration: let's use neurons. And more detailed biological inspiration has been very hard to come by. But I wouldn't rule it out. I think if someone has a special insight, they might be able to see something and that would be useful.
I have a question for you about sort of autocorrect. So here's the question: you mentioned reasoning as being one of the core aspects of maybe the modeling in the future and maybe a differentiator. What we saw in some of the poster sessions is that hallucinations in today's models are the way we're analyzing... I mean, maybe you correct me, you're the expert on this, but the way we're analyzing whether a model is hallucinating today, without because we know of the dangers of models not being able to reason, that we're using a statistical analysis, let's say some amount of standard deviations or whatever away from the mean. In the future, wouldn't it... do you think that a model given reasoning will be able to correct itself, sort of autocorrect itself, and that will be a core feature of future models so that there won't be as many hallucinations because the model will recognize when... I mean, maybe that's too esoteric of a question, but the model will be able to reason and understand when a hallucination is occurring. Does the question make sense?
Yes, and the answer is also yes. I think what you described is extremely highly plausible. Yeah, I mean, you should check... I mean, for yeah, I wouldn't rule out that it might already be happening with some of the early reasoning models of today. I don't know, but longer term, why not? Yeah, I mean, it's part of like Microsoft Word like autocorrect, it's a core feature. Yeah, I just... I mean, I think calling it autocorrect is really doing it a disservice. I think when you say autocorrect, you evoke... it's far grander than autocorrect. But other than that, the point aside, the answer is yes. Thank you.
5 more exchanges in this transcript
Sign in free to read the rest of this interview. No card required.
Sutskever, I. (2024, December 17). Q&A for Ilya Sutskever at NeurIPS 2024 (Test of Time Award) [Interview transcript]. DSAI by Dr. Osbert Tay. CEOInterviews.AI. https://ceointerviews.ai/interview/429940/
MLA
Ilya Sutskever. "Q&A for Ilya Sutskever at NeurIPS 2024 (Test of Time Award)." DSAI by Dr. Osbert Tay, 17 Dec. 2024. Transcript, CEOInterviews.AI, https://ceointerviews.ai/interview/429940/.
BibTeX
@misc{sutskever2024_429940,
author = {Ilya Sutskever},
title = {Q\&A for Ilya Sutskever at NeurIPS 2024 (Test of Time Award)},
howpublished = {Interview transcript, DSAI by Dr. Osbert Tay. CEOInterviews.AI},
year = {2024},
month = {dec},
url = {https://ceointerviews.ai/interview/429940/},
note = {Speaker-attributed transcript with timestamps}
}
