×
you are viewing a single comment's thread.

view the rest of the comments →

[–]gwerngwern.net 12 points13 points  (9 children)

Hassabis: yeah I think certainly we as humans use language as our main generalization communication tool so I think we end up thinking in language and expressing our solutions in language um so it's going to be very powerful uh uh mode in which to uh explain you know the system to explain what it's doing um but I don't think it's the only uh uh modality that matters so I think there's gonna be a lot of you know there's there's a lot of different ways to express uh capabilities uh other than just language

Fridman Yeah vision robotics body language um yeah action is the interactive aspect of all that that's all part of it

Hassabis: but what's interesting with Gato is that it's a it's it's it's sort of pushing prediction to the maximum in terms of like you know mapping arbitrary sequences to other sequences and sort of just predicting what's going to happen next so prediction seems to be fundamental to intelligence

Fridman: and what you're predicting doesn't so much matter

Hassabis: yeah it seems like you can generalize that quite well so obviously language models predict the next word, um, Gato predicts potentially any uh action or any token uh and it's just the beginning really, it's our most general agent one could call it so far but um you know that itself can be scaled up massively more than we've done so far obviously we're in the in the middle of doing that.

Fridman: But the big part of solving AGI is creating benchmarks that help us get closer and closer sort of creating benchmarks that test the generalizability and it's just still interesting that this fella Alan Turing was one of the first and probably still one of the only people that was trying maybe philosophically but was trying to formulate a benchmark that could be followed it is even though it's it's fuzzy it's still sufficiently rigorous to where you can run that test and I still think something like the Turing test will at the end of the day be the thing that truly impresses other humans so that you can have a close friend who's an AI system for that friend to be a good friend they're going to have to be able to uh play Starcraft and they're going to have to do all of these tasks - um get you a beer so the robotics tasks, uh play games with you use language, humor, all those kinds of things, but that ultimately can boil down to language. It feels like not in terms of the AI community but in terms of the actual impact of general intelligence on the world it feels like language will be the place where it truly shines

Hassabis: I think so because it's such an important kind of input output for us. I think you're right. I think the Turing Test that what the the kind of the the philosophy behind it which is the idea of can can a machine mimic the behaviors of a human and men and I would say wider than just language, any text, then you know in terms of actions and everything else creativity all these things then um if it can sort of match or exceed human cognitive capabilities then I think we have a you know true intelligence so I thought from that perspective - you're right, I think he did formulate the right uh kind of uh setup.

Fridman: I just I think there'll be a kind of humor in the AI systems of the future looking back to this conversation and thinking about the Turing test and uh also thinking about by that time they would know which year they were finally able to sort of cross the threshold of human level intelligence and think how funny it is that we humans were still confused about this whole problem that has been long ago been solved. Well hello to the AI agents of the future.

(Emphasis added. Only mention of Gato in the YouTube transcript.)

[–]adt 4 points5 points  (5 children)

um so it's going to be very powerful uh uh mode in which to uh explain you know the system to explain what it's doing um but I don't think it's the only uh uh modality that matters so I think there's gonna be a lot of you know there's there's a lot of different ways to express uh capabilities uh other than just language

Harsh transcript, makes him sound so eloquent!

[–]gwerngwern.net 10 points11 points  (4 children)

That's natural language for you, the YT NN transcribes what he says, not some essay-ified version. I could have tried to clean it up, but I'm a little wary of injecting that much editorializing.

[–]visarga 24 points25 points  (1 child)

Let's ask GPT-3 for help here:

(setting T=0)

Task: Rewrite the text from free speech to written style.

Text: um so it's going to be very powerful uh uh mode in which to uh explain you know the system to explain what it's doing um but I don't think it's the only uh uh modality that matters so I think there's gonna be a lot of you know there's there's a lot of different ways to express uh capabilities uh other than just language

Reformatted text: So, it's going to be very powerful to explain the system using language. But I don't think that's the only way that matters. I think there are going to be a lot of different ways to express capabilities, other than just language.

[–]habitofwalking 4 points5 points  (0 children)

Now this is a good application for GPT-3

[–]Lone-Pine 4 points5 points  (0 children)

I wish youtube would just s/u[hm]\s+//g

[–]Environmental_Pool70 2 points3 points  (0 children)

Well done for doing it. Find Fridman interviews painfully off point. There is so much to go after but usually it's missed.

[–]CremeEmotional6561 1 point2 points  (2 children)

I find it funny how Demis Hassabis accurately paraphrases the Total Turing Test in words, but writhes like a snake not to utter the evil taboo word.

Edit: Just learned that there is a word for it: It's called a "Career Limiting Move" (CLM).

[–]Plane_Evidence_5872 0 points1 point  (1 child)

Why is it a taboo.

[–]CremeEmotional6561 1 point2 points  (0 children)

Because candidates cannot cheat. It requires a robot body, but you cannot lie to physics. The unpredictable human judge makes sure that the developers cannot optimize to a narrow task, and the human control candidate makes sure that the judge doesn't set impossible tasks. So the only chance to pass it would be to educate a real humanoid robot in the real world with real teachers and real classmates. Of course, to speed up learning, one could pretrain it on tons of 3rd person view YouTube videos with audio.

But the Total Turing Test is not perfect. In order to measure progress, I would omit the human control candidate and let the judge communicate with the robot candidates directly, so they can see their non-human body. The audience would then watch and vote which robot behaved most human-like, and the number of votes would measure progress. I would also measure if the robot gets better on the task the next day, just as humans, when they have practiced it on their own a few times.