The Thinking Game (2024) Movie Script
Hi, Alpha.
Hello.
Can you
help me write code?
I was trained
to answer questions,
but I'm able to learn.
That's very
open-minded of you.
Thank you.
I'm glad you're happy with me.
What's this guy doing?
That's a developer.
What do you think
he's working on?
That's a tough question.
He might be working
on a new feature,
a bug fix or something else.
It's quite possible.
Yes.
Do you see my backpack?
That's a badminton racket.
It's a squash racket,
but that's pretty close.
That's a badminton racket.
No, but you're not
the first person
to make that mistake.
AI, the technology
that has been advancing
at breakneck speed.
Artificial
intelligence is all the rage.
Some are now
raising alarm about...
It is definitely concerning.
This is an AI arms race.
We don't know
how this is all
going to shake out,
but it's clear
something is happening.
I'm kind of restless.
Trying to build AGI
is the most exciting journey,
in my opinion, that humans
have ever embarked on.
If you're really going
to take that seriously,
there isn't a lot of time.
Life's very short.
My whole life goal is to solve
artificial
general intelligence.
And on the way,
use AI as the ultimate tool
to solve all the world's
most complex
scientific problems.
I think that's bigger
than the Internet.
I think that's bigger
than mobile.
I think it's more like
the advent
of electricity or fire.
World leaders
and artificial
intelligence experts
are gathering
for the first ever
global AI safety summit,
set to look at the risks
of the fast growing technology
and also...
I think
this is a hugely
critical moment
for all humanity.
It feels like
we're on the cusp
of some incredible things
happening.
Let me take you through
some of the reactions
in today's papers.
AGI is pretty close,
I think.
There's clearly huge interest
in what it is capable of,
where it's taking us.
This is the moment
I've been living
my whole life for.
I've always been fascinated
by the mind.
So I set my heart
on studying neuroscience
because I wanted
to get inspiration
from the brain for AI.
I remember asking Demis,
"What's the end game?"
You know?
So you're going to come here
and you're going
to study neuroscience
and you're going to maybe
get a Ph.D. if you work hard.
And he said,
"You know, I want
to be able to solve AI.
"I want to be able
to solve intelligence."
The human brain
is the only existent proof
we have, perhaps
in the entire universe,
that general intelligence
is possible at all.
And I thought
someone in this building
should be interested
in general intelligence
like I am.
And then Shane's name
popped up.
Our next speaker today
is Shane Legg.
He's from New Zealand,
where he trained in math
and classical ballet.
Are machines actually
becoming more intelligent?
Some people say yes,
some people say no.
It's not really clear.
We know they're getting
a lot faster
at doing computations.
But are we actually
going forwards
in terms
of general intelligence?
We were both
obsessed with AGI,
artificial
general intelligence.
So today I'm going
to be talking about
different approaches
to building AGI.
With my colleague
Demis Hassabis,
we're looking at ways
to bring in ideas
from theoretical neuroscience.
I felt like we were
the keepers of a secret
that no one else knew.
Shane and I knew
no one in academia
would be supportive
of what we were doing.
AI was almost
an embarrassing word
to use in academic circles,
right?
If you said
you were working on AI,
then you clearly weren't
a serious scientist.
So I convinced Shane
the right way to do it
would be to start a company.
Okay,
we're going to try to do
artificial
general intelligence.
It may not even be possible.
We're not quite sure
how we're going to do it,
but we have some ideas
or, kind of, approaches.
Huge amounts of money,
huge amounts of risk,
lots and lots of compute.
And if we pull this off,
it'll be the biggest thing
ever, right?
That is a very hard thing
for a typical investor
to put their money on.
It's almost like
buying a lottery ticket.
I'm going to be speaking about
the system of neuroscience
and how it might be used
to help us build AGI.
Finding initial funding
for this was very hard.
We're going to solve
all of intelligence.
You can imagine
some of the looks I got
when we were
pitching that around.
So I'm a V.C.
and I look at about
700 to 1,000 projects a year.
And I fund
literally 1% of those.
About eight projects a year.
So that means 99% of the time,
you're in "No" mode.
"Wait a minute.
I'm telling you,
"this is the most important
thing of all time.
"I'm giving you
all this build-up
"about how... explain
"how it connects
with the brain,
"why the time's right now,
and then you're asking me,
"'But what's your, how are you
going to make money?
"'What's your product?'"
It's like,
so prosaic a question.
You know?
"Have you not been listening
to what I've been saying?"
We needed investors
who aren't necessarily
going to invest
because they think
it's the best
investment decision.
They're probably
going to invest
because they just think
it's really cool.
He's the Silicon Valley
version of the man
behind the curtain
inThe Wizard of Oz.
He had a lot to do
with giving you
PayPal, Facebook,
YouTube and Yelp.
If everyone says "X,"
Peter Thiel suspects
that the opposite of X
is quite possibly true.
So Peter Thiel
was our first big investor.
But he insisted that
we come to Silicon Valley
because that
was the only place we could...
There would be the talent,
and we could build
that kind of company.
But I was pretty adamant
we should be in London
because I think
London's an amazing city.
Plus, I knew there were
really amazing people
trained at Cambridge
and Oxford and UCL.
In Silicon Valley,
everybody's founding
a company every year,
and then if it doesn't work,
you chuck it
and you start something new.
That is not conducive
to a long-term
research challenge.
So we were totally
an outlier for him.
Hi, everyone.
Welcome to DeepMind.
So, what is our mission?
We summarize it as...
DeepMind's mission is to build
the world's first
general learning machine.
So we always stress the word
"general" and "learning" here
are the key things.
Our mission
was to build an AGI,
an artificial
general intelligence.
And so that means that we need
a system which is general.
It doesn't learn to do
one specific thing.
That's a really key part
of human intelligence.
We can learn to do
many, many things.
It's going to, of course,
be a lot of hard work.
But one of the things
that keeps me up at night
is to not waste this
opportunity to, you know,
to really make
a difference here,
and have a big impact
on the world.
The first people
that came
and joined DeepMind
really believed in the dream.
But this was, I think,
one of the first times
they found a place
full of other dreamers.
You know, we collected
this Manhattan Project,
if you like,
together to solve AI.
In the first two years,
we were in total stealth mode.
And so we couldn't
say to anyone
what were we doing
or where we worked.
It was all quite vague.
It had
no public presence at all.
You couldn't
look at a website.
The office
was at a secret location.
When we would interview people
in those early days,
they would show up
very nervously.
I had at least one candidate
who said,
"I just messaged my wife
to tell her exactly
"where I'm going just in case
"this turns out to be some
kind of horrible scam
"and I'm going
to get kidnapped."
Well, my favorite new person
who's an investor,
who I've been working
for a year, is Elon Musk.
So for those of you
who don't know,
this is what he looks like.
And he hadn't really thought
much about AI
until we chatted.
His mission is to die on Mars
or something.
But not on impact.
So...
We made some big decisions
about how we were going
to approach building AI.
This is a reinforcement
learning setup.
This is the kind of setup
that we think about
when we say we're building,
you know, an AI agent.
It's basically the agent,
which is the AI,
and then there's
the environment
that it's interacting with.
We decided that games,
as long as
you're very disciplined
about how you use them,
are the perfect
training ground
for AI development.
We wanted
to try to create one algorithm
that could to be
trained up to play
several dozen
different Atari games.
So just like a human,
you have to use the same brain
to play all the games.
You can think of it
that you provide the agent
with the cartridge.
And you say,
"Okay, imagine you're born
into that world
"with that cartridge,
and you just get to interact
"with the pixels
and see the score.
"What can you do?"
So what you're going to do is
take your Q function. Q-K...
Q-learning
is one of the oldest methods
for reinforcement learning.
And what we did was combine
reinforcement learning
with deep learning
in one system.
No one had ever combined
those two things together
at scale to do
anything impressive,
and we needed
to prove out this thesis.
We tried doingPong
as the first game.
It seemed like the simplest.
It hasn't been told
anything about
what it's controlling
or what it's supposed to do.
All it knows
is that score is good
and it has to learn
what its controls do,
and build everything...
first principles.
It wasn't really working.
I was just
saying to Shane,
"Maybe we're just wrong,
and we can't even doPong."
It was a bit
nerve-racking,
thinking how far we had to go
if we were going
to really build
a generally
intelligent system.
And it felt like
it was time
to give up and move on.
And then suddenly...
We got our first point.
And then it was like,
"Is this random?"
"No, no, it's really
getting a point now."
It was really exciting
that this thing
that previously
couldn't even figure out
how to move a paddle
had suddenly been able
to totally get it right.
Then it was getting
a few points.
And then it won
its first game.
And then three months later,
no human could beat it.
You hadn't told it the rules,
how to get the score, nothing.
And you just tell it
to maximize the score,
and it goes away and does it.
This is the first time
anyone had done
this end-to-end learning.
"Okay, so we have this working
in quite a general way.
"Now let's try another game."
So then
we triedBreakout.
At the beginning,
after 100 games,
the agent is not very good.
It's missing the ball
most of the time,
but it's starting to get
the hang of the idea
that the bat should go
towards the ball.
Now, after 300 games,
it's about as good as
any human can play this.
We thought,
"Well, that's pretty cool,"
but we left the system playing
for another 200 games,
and it did this amazing thing.
It found the optimal strategy
was to dig a tunnel
around the side
and put the ball
around the back of the wall.
Finally, the agent
is actually achieving
what you thought
it would achieve.
That is a great feeling.
Right?
Like, I mean,
when we do research,
that is the best
we can hope for.
We started generalizing
to 50 games,
and we basically
created a recipe.
We could just take a game
that we have
never seen before.
We would run
the algorithm on that,
and DQN could train itself
from scratch,
achieving human level
or sometimes better
than human level.
We didn't build it
to play any of them.
We could just give it
a bunch of games
and would figure it out
for itself.
And there was something
quite magical in that.
Suddenly you had something
that would respond and learn
whatever situation
it was parachuted into.
And that was like a huge,
huge breakthrough.
It was in many respects
the first example
of any kind of thing
you could call
a general intelligence.
Although we were
a well-funded startup,
holding us back
was not enough compute power.
I realized that
this would accelerate
our time scale
to AGI massively.
I used to see Demis
quite frequently.
We'd have lunch, and he did...
say to me that
he had two companies
that were involved
in buying DeepMind.
And he didn't know
which one to go with.
The issue was,
would any commercial company
appreciate the real importance
of the research?
And give the research time
to come to fruition
and not be breathing down
their necks,
saying, "We want some kind of
commercial benefit from this."
Google has bought DeepMind
for a reported 400,000,000,
making the artificial
intelligence firm
its largest
European acquisition so far.
The company was founded
by 37-year-old entrepreneur
Demis Hassabis.
After the acquisition,
I started mentoring
and spending time with Demis,
and just listening to him.
And this is a person
who fundamentally
is a scientist
and a natural scientist.
He wants science to solve
every problem in the world,
and he believes it can do so.
That's not a normal person
you find in a tech company.
We were able
to not only join Google
but run independently
in London,
build our culture,
which was optimized
for breakthroughs
and not deal with products,
do pure research.
Our investors
didn't want to sell,
but we decided
that this was the best thing
for the mission.
In many senses,
we were underselling
in terms of value
before it more matured,
and you could have sold it
for a lot more money.
And the reason is because
there's no time to waste.
There's so many things
that got to be cracked
while the brain
is still in gear.
You know, I'm still alive.
There's all these things
that gotta be done.
So you haven't got--
I mean, how many...
How many billions
would you trade for
another five years of life,
you know,
to do what you set out to do?
Okay, all of a sudden,
we've got this massive scale
compute available to us.
What can we do with that?
Go is the pinnacle
of board games.
It is the most complex game
ever devised by man.
There are more possible
board configurations
in the game of Go than there
are atoms in the universe.
Go is the holy grail
of artificial intelligence.
For many years,
people have looked
at this game
and they've thought,
"Wow, this is just too hard."
Everything we've ever
tried in AI,
it just falls over when
you try the game of Go.
And so that's why
it feels like
a real litmus test
of progress.
We had just bought DeepMind.
They were working
on reinforcement learning
and they were the world's
experts in games.
And so when
they introduced the idea
that they could beat
the top level Go players
in a game that was thought
to be incomputable,
I thought, "Well,
that's pretty interesting."
Our ultimate next step
is to play the legendary
Lee Sedol
in just over two weeks.
A match like no other
is about to get underway
in South Korea.
Lee Sedol
is getting ready to rumble.
Lee Sedol is probably
one of the greatest players
of the last decade.
I describe him
as the Roger Federer of Go.
He showed up,
and all of a sudden
we have a thousand Koreans
who represent
all of Korean society,
the top Go players.
And then we have Demis.
And the great
engineering team.
He's very famous
for very creative
fighting play.
So this could be
difficult for us.
I figured Lee Sedol
is going to beat these guys,
but they'll make
a good showing.
Good for a startup.
I went over
to the technical group
and they said,
"Let me show you
how our algorithm works."
If you step
through the actual game,
we can see, kind of,
how AlphaGo thinks.
The way we start off
on training AlphaGo
is by showing it 100,000 games
that strong amateurs
have played.
And we first initially
get AlphaGo to mimic
the human player,
and then through
reinforcement learning,
it plays against
different versions of itself
many millions of times
and learns from its errors.
Hmm, this is interesting.
All right, folks,
you're going to see
history made.
So the game starts.
He's really concentrating.
If you really look at the...
That's a very surprising move.
I think we're
seeing an original move here.
Yeah, that's an exciting move.
I like...
Professional commentators
almost unanimously said
that not a single human player
would have chosen move 37.
So I actually had a poke
around in AlphaGo
to see what AlphaGo thought.
And AlphaGo actually agreed
with that assessment.
AlphaGo said there was a one
in 10,000 probability
that move 37 would have been
played by a human player.
The game of Go
has been studied
for thousands of years.
And AlphaGo discovered
something completely new.
He resigned.
Lee Sedol has just resigned.
He's beaten.
The battle
between man versus machine,
a computer just came out
the victor.
Google
put its DeepMind team
to the test against
one of the brightest minds
in the world and won.
That's when we realized
the DeepMind people knew
what they were doing
and to pay attention
to reinforcement learning
as they have invented it.
Based on that experience,
AlphaGo got better
and better and better.
And they had a little chart
of how much better
they were getting.
And I said,
"When does this stop?"
And Demis said,
"When we beat the Chinese guy,
"the top-rated player
in the world."
Ke Jie versus AlphaGo.
And I think we will see
AlphaGo pushing through there.
AlphaGo is ahead quite a bit.
About halfway
through the first game,
the best player in the world
was not doing so well.
What can black do here?
Looks difficult.
And at a critical moment...
the Chinese government
ordered the feed cut off.
It was at that moment
we were telling the world
that something new
had arrived on earth.
In the 1950s
when Russia'sSputnik
satellite was launched,
it changed
the course of history.
It is a challenge
that America must meet
to survive in the Space Age.
This has been
called theSputnik moment.
The Sputnikmoment created
a massive reaction in the US
in terms of funding
for science and engineering,
and particularly
of space technology.
For China,
AlphaGo was the wakeup call,
the Sputnikmoment.
It launched an AI space race.
We had this
huge idea that worked,
and now the whole world knows.
It's always easier
to land on the moon
if someone's already
landed there.
It is going to matter
who builds AI,
and how it gets built.
I always feel that pressure.
There's been
a big chain of events
that followed on from all
of the excitement of AlphaGo.
When we played
against Lee Sedol,
we actually had a system
that had been trained
on human data,
on all of the millions
of games
that have been played
by human experts.
We eventually found
a new algorithm,
a much more elegant approach
to the whole system,
which actually stripped out
all of the human knowledge
and just started
completely from scratch.
And that became a project
which we called AlphaZero.
Zero, meaning having zero
human knowledge in the loop.
Instead of learning
from human data,
it learned from its own games.
So it actually
became its own teacher.
AlphaZero is an experiment
in how little knowledge
can we put into these systems
and how quickly
and how efficiently
can they learn?
But the other thing is AlphaZero
doesn't have any rules.
It learns through experience.
The next stage
was to make it more general,
so that it could play
any two-player game.
Things like chess,
and in fact,
any kind of two-player
perfect information game.
It's going really well.
It's going
really, really well.
- Oh, wow.
- It's going down, like fast.
AlphaGo used
to take a few months to train,
but AlphaZero could start
in the morning
playing completely randomly
and then by tea
be at superhuman level.
And by dinner it will be
the strongest chess entity
there's ever been.
- Amazing, it's amazing.
- Yeah.
It's discovered its own
attacking style, you know,
to take on the current
level of defense.
I mean, I never
in my wildest dreams...
I agree. Actually, I was not
expecting that either.
And it's fun for me.
I mean, it's inspired me
to get back into chess again,
because it's cool to see
that there's even more depth
than we thought in chess.
I actually got
into AI through games.
Initially, it was board games.
I was thinking,
"How is my brain doing this?"
Like, what is it doing?
I was very aware of that
from a very young age.
So I've always been thinking
about thinking.
The British
and American chess champions
meet to begin
a series of matches.
Playing alongside them
are the cream
of Britain and America's
youngest players.
Demis Hassabis
is representing Britain.
When Demis was four,
he first showed
an aptitude for chess.
By the time he was six,
he became London
under-eight champion.
My parents
were very interesting
and unusual, actually.
I'd probably describe them
as quite bohemian.
My father
was a singer-songwriter
when he was younger,
and Bob Dylan was his hero.
Yeah, yeah.
What is it
that you like about this game?
It's just a good
thinking game.
At the time,
I was the second-highest rated
chess player in the world
for my age.
But although I was on track
to be a professional
chess player,
I thought that was what
I was going to do.
No matter how much
I loved the game,
it was incredibly stressful.
Definitely was not fun
and games for me.
My parents used to, you know,
get very upset
when I lost the game
and angry
if I forgot something.
And because it was quite high
stakes for them, you know,
it cost a lot of money
to go to these tournaments.
And my parents
didn't have much money.
My parents thought, you know,
"If you interested
in being a chess professional,
"this is really important.
It's like your exams."
I remember
I was about 12-years-old
and I was at this
international chess tournament
in Liechtenstein
up in the mountains.
And we were in this
huge church hall
with, you know,
hundreds of international
chess players.
And I was playing
the ex-Danish champion.
He must have been
in his 30s, probably.
In those days,
there was a long time limit.
The games could
literally last all day.
- We were into our tenth hour.
And we were in this
incredibly unusual ending.
I think it should be a draw.
But he kept on trying
to win for hours.
Finally, he tried
one last cheap trick.
All I had to do
was give away my queen.
Then it would be stalemate.
But I was so tired,
I thought it was inevitable
I was going to be checkmated.
And so I resigned.
He jumped up.
Just started laughing.
And he went,
"Why have you resigned?
It's a draw."
And he immediately,
with a flourish,
sort of showed me
the drawing move.
I felt so sick to my stomach.
It made me think of
the rest of that tournament.
Like, are we wasting
our minds?
Is this the best use
of all this brain power?
Everybody's, collectively,
in that building?
If you could somehow plug in
those 300 brains
into a system,
you might be able
to solve cancer
with that level
of brain power.
This intuitive feeling
came over me
that although I love chess,
this is not the right thing
to spend my whole life on.
Demis and myself,
our plan was always
to fill DeepMind
with some of the most
brilliant scientists
in the world.
So we had the human brains
necessary to create
an AGI system.
By definition, the "G"
in AGI is about generality.
What I imagine is being able
to talk to an agent,
the agent can talk back,
and the agent is able to solve
novel problems
that it hasn't seen before.
That's a really key part
of human intelligence,
and it's that
cognitive breadth
and flexibility
that's incredible.
The only natural
general intelligence
we know of as humans,
we obviously learn a lot
from our environment.
So we think that
simulated environments
are one of the ways
to create an AGI.
The very early humans
were having to solve
logic problems.
They were having to solve
navigation, memory,
and we evolved
in that environment.
If we can create
a virtual recreation
of that kind of environment,
that's the perfect
testing ground
and training ground
for everything
we do at DeepMind.
What they were doing here
was creating environments
for childlike beings,
the agents to exist
within and play.
That just sounded like
the most interesting thing
in all the world.
A child
learns by tearing things up
and then throwing food around
and getting a response
from mommy or daddy.
This seems like an important
idea to incorporate
in the way you train an agent.
The humanoid
is supposed to stand up.
As his center
of gravity rises,
it gets more points.
You have a reward
and the agent
learns from the reward,
like, you do something well,
you get a positive reward.
You do something bad,
you get a negative reward.
It looks like it's standing.
It's still a bit drunk.
It likes to walk backwards.
Yeah.
The whole algorithm
is trying to optimize
for receiving as much rewards
as possible,
and it's found that
walking backwards,
it's good enough
to get very good scores.
When we learn to navigate,
when we learn to get around
in our world,
we don't start with maps.
We just start
with our own exploration,
adventuring off
across the park,
without our parents
by our side,
or finding our way home
from school when we're young.
A few of us
came up with this idea
that if we had an environment
where a simulated robot
just had to run forward,
we could put all sorts of
obstacles in its way
and see if it could manage
to navigate
different types of terrain.
The idea would be like
a parkour challenge.
It's not graceful,
but was never trained to hold
a glass whilst it was running
and not spill water.
You set this objective
that says,
"Just move forward,
forward velocity,
"and you'll get
a reward for that."
And the learning algorithm
figures out
how to move
this complex set of joints.
That's the power of
reward-based
reinforcement learning.
Our goal
is to try and build agents
which, we drop them in,
they know nothing,
they get to play around in
whatever problem you give them
and eventually figure out how
to solve it for themselves.
Now we want something
which can do that
in as many different types
of problems as possible.
A human needs diverse skills
to interact with the world.
How to deal
with complex images,
how to manipulate
thousands of things at once,
how to deal
with missing information.
We think all of these things
together
are represented
by this game calledStarCraft.
All it's being trained
to do is,
given this situation,
this screen,
what would a human do?
We took inspiration from
large language models
where you simply train
a model
to predict the next word,
which is exactly the same as
predict the next
StarCraft move.
Unlike chess or Go,
where players take turns
to make moves,
inStarCraft there's a
continuous flow of decisions.
On top of that,
you can't even see
what the opponent is doing.
There is no longer
a clear definition
of what it means
to play the best way.
It depends on
what your opponent does.
This is the way
that we'll get to
a much more fluid,
more natural, faster,
more reactive agent.
This is a huge challenge
and let's see how far
we can push.
Oh!
Holy monkey!
I'm a pretty
low-level amateur.
I'm okay, but I'm
a pretty low-level amateur.
These agents have
a long ways to go.
We couldn't
beat someone of Tim's level.
You know, that was
a little bit alarming.
At that point, it felt like
it was going to be, like,
a really big long challenge,
maybe a couple of years.
Dani is the best
DeepMind StarCraft 2 player.
I've been playing the agent
every day for a few weeks now.
I could feel that the agent
was getting better
really fast.
Wow, we beat Danny.
That, for me,
was already
like a huge achievement.
The next step is
we're going to book in
a pro to play.
It feels a bit unfair.
All you guys against me.
We're way
ahead of what I thought
we would do, given where
we were two months ago.
Just trying to digest it all,
actually.
But it's very, very cool.
Now we're in
a position where
we can finally share
the work that we've done
with the public.
This is a big step.
We are really putting
ourselves on the line here.
- Take it away. Cheers.
- Thank you.
We're going to be live
from London.
It's happening.
Welcome to London.
We are going to have
a live exhibition match,
MaNa against AlphaStar.
At this point now,
AlphaStar, 10 and 0
against professional gamers.
Any thoughts
before we get into this game?
I just want to see
a good game, yeah.
I want to see a good game.
Absolutely,
good game. We're all excited.
All right. Let's
see what MaNa can pull off.
AlphaStar is definitely
dominating the pace
of this game.
Wow. AlphaStar
is playing so smartly.
This really looks like
I'm watching
a professional human gamer
from the AlphaStar
point of view.
I hadn't really seen
a pro playStarCraft up close,
and the 800 clicks per minute.
I don't understand how anyone
can even click 800 times,
let alone doing
800 useful clicks.
Oh, another good hit.
- AlphaStar is just
completely relentless.
We need to be careful
because many of us grew up
as gamers and are gamers.
And so to us,
it's very natural
to view games
as what they are,
which is pure vehicles
for fun,
and not to see
that more militaristic side
that the public might see
if they looked at this.
You can't look at gunpowder
and only make a firecracker.
All technologies inherently
point into certain directions.
I'm very worried about
the certain ways in which AI
will be used
for military purposes.
And that makes it even clearer
how important it is
for our societies
to be in control
of these new technologies.
The potential for abuse
from AI will be significant.
Wars that occur faster
than humans can comprehend
and more powerful
surveillance.
How do you keep power forever
over something that's
much more powerful than you?
Technologies can be used
to do terrible things.
And technology can be used
to do wonderful things
and solve
all kinds of problems.
When DeepMind
was acquired by Google...
- Yeah.
- ...you got Google to promise
that technology you developed
won't be used by the military
- for surveillance.
- Right.
- Yes.
- Tell us about that.
I think technology
is neutral in itself,
um, but how, you know,
we as a society
or humans and companies
and other things,
other entities and governments
decide to use it
is what determines whether
things become good or bad.
You know, I personally think
having autonomous weaponry
is just a very bad idea.
AlphaStar is playing
an extremely intelligent game
right now.
There is an element to
what's being created
at DeepMind in London
that does seem like
the Manhattan Project.
There's a relationship between
Robert Oppenheimer
and Demis Hassabis
in which they're unleashing
a new force upon humanity.
MaNa is fighting back, though.
Oh, man!
I think that Oppenheimer
and some of the other leaders
of that project got caught up
in the excitement
of building the technology
and seeing if it was possible.
Where is AlphaStar?
Where is AlphaStar?
I don't see AlphaStar's units
anywhere.
They did not think
carefully enough
about the morals of what
they were doing early enough.
What we should do
as scientists
with powerful new technologies
is try and understand it in
controlled conditions first.
And that is that.
MaNa has defeated AlphaStar.
I mean, my honest feeling is
that I think it is
a fair representation
of where we are.
And I think that part feels...
feels okay.
- I'm very happy for you.
- I'm happy.
So well... well done.
My view is that the approach
to building technology
which is embodied by
move fast and break things,
is exactly what
we should not be doing,
because you can't afford
to break things
and then fix them afterwards.
- Cheers.
- Thank you so much.
Yeah, get... get some rest.
You did really well.
- Cheers, yeah?
- Thank you for having us.
When I was eight,
I bought my first computer
with the winnings
from a chess tournament.
I sort of had this intuition
that computers
are this magical device
that can extend
the power of the mind.
I had a couple
of school friends,
and we used to have
a hacking club,
writing code, making games.
And then over
the summer holidays,
I'd spend the whole day
flicking through
games magazines.
And one day I noticed
there was a competition
to write an original version
of Space Invaders.
And the winner won a job
at Bullfrog.
Bullfrog at the time was the
best game development house
in all of Europe.
You know, I really wanted
to work at this place
and see how they build games.
Bullfrog,
based here in Guildford,
began with a big idea.
That idea turned into the game
Populous,
which became
a global bestseller.
In the '90s, there was
no recruitment agencies.
You couldn't go out and say,
you know,
"Come and work
in the games industry."
It was still not even
considered an industry.
So we came up with the idea
to have a competition
and we got
a lot of applicants.
And one of those was Demis's.
I can still remember clearly
the day that Demis came in.
He walked in the door,
he looked about 12.
I thought, "Oh, my God,
"what the hell are we going
to do with this guy?"
I applied to Cambridge.
I got in but they said
I was way too young.
So...
So I needed to take a year off
so I'd be at least 17
before I got there.
And that's when I decided
to spend that entire gap year
working at Bullfrog.
They couldn't even
legally employ me,
so I ended up being paid
in brown paper envelopes.
I got a feeling of being
really at the cutting edge
and how much fun that was
to invent things every day.
And then you know,
a few months later,
maybe everyone... a million
people will be playing it.
In those days
computer games had to evolve.
There had to be new genres
which were more
than just shooting things.
Wouldn't it be amazing
to have a game
where you design and build
your own theme park?
Demis and I started to talk
aboutTheme Park.
It allows the player
to build a world
and see the consequences
of your choices
that you've made
in that world.
A human player
set out the layout
of the theme park and designed
the roller coaster
and set the prices
in the chip shop.
What I was working on was
the behaviors of the people.
They were autonomous
and that was the AI
in this case.
So what I was trying to do
was mimic
interesting human behavior
so that the simulation
would be
more interesting
to interact with.
Demis worked
on ridiculous things,
like you could place down
these shops
and if you put a shop too near
a very dangerous ride,
then people on the ride
would throw up
because they'd just eaten.
And then that would make
other people throw up
when they saw the throwing-up
on the floor,
so you then had to have
lots of sweepers
to quickly sweep it up
before the people saw it.
That's the cool thing
about it.
You as the player tinker with
it and then it reacts to you.
All those nuanced
simulation things he did
and that was an invention
which never really
existed before.
It was
unbelievably successful.
Theme Park actually turned out
to be a top ten title
and that was the first time
we were starting to see
how AI could make
a difference.
We were doing
some Christmas shopping
and were waiting for the taxi
to take us home.
I have this very clear memory
of Demis talking about AI
in a very different way,
in a way that we didn't
commonly talk about.
This idea of AI being useful
for other things
other than entertainment.
So being useful for, um,
helping the world
and the potential of AI
to change the world.
I just said to Demis,
"What is it you want to do?"
And he said to me,
"I want to be the person
that solves AI."
Peter offered me 1 million
to not go to university.
But I had a plan
from the beginning.
And my plan was always
to go to Cambridge.
I think a lot of
my schoolfriends
thought I was mad.
Why would you not...
I mean, 1 million,
that's a lot of money.
In the '90s,
that is a lot of money, right?
For a...
For a poor 17-year-old kid.
He's like this little seed
that's going to burst through,
and he's not going to be able
to do that at Bullfrog.
I had to drop him off
at the train station
and I can still see
that picture
of this little elven character
disappear down that tunnel.
That was an incredibly
sad moment.
I had this romantic ideal
of what Cambridge
would be like,
1,000 years of history,
walking the same streets
that Turing,
Newton and Crick had walked.
I wanted to explore
the edge of the universe.
When I got to Cambridge,
I'd basically been working
my whole life.
Every single summer,
I was either playing chess
professionally,
or I was working,
doing an internship.
So I was, like, "Right,
I am gonna have fun now
"and explore what it means
to be a normal teenager."
Come on! Go, boy, go!
It was work hard
and play hard.
I first met Demis
because we both attended
Queens' College.
Our group of friends,
we'd often drink beer
in the bar,
play table football.
In the bar,
I used to play speed chess,
pieces flying off the board,
you know, the whole game
in one minute.
Demis sat down opposite me.
And I looked at him
and I thought,
"I remember you
from when we were kids."
I had actually been
in the same chess tournament
as Dave in Ipswich,
where I used to go and try
and raid his local chess club
to win a bit of prize money.
We were studying
computer science.
Some people,
who at the age of 17
would have come in and made
sure to tell everybody
everything about themselves.
"Hey, I worked at Bullfrog
"and built the world's
most successful video game."
But he wasn't like that
at all.
At Cambridge,
Demis and myself
both had an interest
in computational neuroscience
and trying to understand
how computers and brains
intertwined
and linked together.
Both David and Demis
came to me for supervisions.
It happens just by coincidence
that the year 1997,
their third and final year
at Cambridge,
was also the year when
the first chess grandmaster
was beaten by
a computer program.
Round one today
of a chess match
between the ranking
world champion Garry Kasparov
and an opponent named
Deep Blue
to test to see if the human
brain can outwit a machine.
I remember the drama
of Kasparov
losing the last match.
Whoa!
Kasparov has resigned!
When Deep Blue
beat Garry Kasparov,
that was a real
watershed event.
My main memory of it was
I wasn't that impressed
with Deep Blue.
I was more impressed
with Kasparov's mind.
That he could play chess
to this level,
where he could compete
on an equal footing
with the brute of a machine,
but of course, Kasparov can do
everything else humans can do,
too.
It was a huge achievement.
But the truth
of the matter was,
Deep Blue
could only play chess.
What we would regard
as intelligence
was missing from that system.
This idea of generality
and also learning.
Cambridge was amazing,
because of course, you know,
you're mixing with people
who are studying
many different subjects.
There were scientists,
philosophers, artists...
...geologists,
biologists, ecologists.
You know, everybody is talking
about everything all the time.
I was obsessed with
the protein folding problem.
Tim Stevens used
to talk obsessively,
almost like religiously
about this problem,
protein folding problem.
Proteins are, you know,
one of the most beautiful and
elegant things about biology.
They are the machines of life.
They build everything,
they control everything,
they're why biology works.
Proteins are made from strings
of amino acids
that fold up to create
a protein structure.
If we can predict
the structure of proteins
from just their amino acid
sequences,
then a new protein
to cure cancer
or break down plastic
to help the environment
is definitely something
that you could begin
to think about.
I kind of thought,
"Well, is a human being
clever enough
"to actually fold a protein?"
We can't work it out.
Since the 1960s,
we thought that in principle,
if I know what the amino acid
sequence of a protein is,
I should be able to compute
what the structure's like.
So, if you could
just press a button,
and they'd all come
popping out, that would be...
that would have some impact.
It stuck in my mind.
"Oh, this is
a very interesting problem."
And it felt to me
like it would be solvable.
But I thought
it would need AI to do it.
If we could just solve
protein folding,
it could change the world.
Ever since
I was a student at Cambridge,
I've never
stopped thinking about
the protein folding problem.
If you were
to solve protein folding,
then the potential
to help solve problems like
Alzheimer's, dementia
and drug discovery is huge.
Solving disease is probably
the most major impact
we could have.
Thousands of very smart people
have tried
to solve protein folding.
I just think now
is the right time
for AI to crack it.
We needed
a reasonable way
to apply machine learning
to the protein folding
problem.
We came across
this Foldit game.
The goal is to move around
this 3D model of a protein
and you get a score
every time you move it.
The more accurate
you make these structures,
the more useful
they will be to biologists.
I spent a few days
just kind of seeing
how well we could do.
We did reasonably well.
But even if you were
the world's
best Foldit player,
you wouldn't
solve protein folding.
That's why we had
to move beyond the game.
Games
are always just
the proving ground
for our algorithms.
The ultimate goal was not just
to crack Go and StarCraft.
It was to crack
real-world challenges.
I remember
hearing this rumor
that Demis was
getting into proteins.
I talked to some people
at DeepMind and I would ask,
"So are you doing
protein folding?"
And they would
artfully change the subject.
And when that happened twice,
I pretty much figured it out.
So I thought
I should submit a resume.
All right, everyone,
welcome to DeepMind.
I know some of you,
this may be your first week,
but I hope you all set...
The really appealing
part for me about the job
was this, like,
sense of connection
to the larger purpose.
If we can crack
some fundamental problems
in science,
many other people
and other companies
and labs and so on
could build
on top of our work.
This is your chance now
to add your chapter
to this story.
When I arrived,
I was definitely
quite a bit nervous.
I'm still trying to keep...
I haven't taken
any biology courses.
We haven't spent
years of our lives
looking at these structures
and understanding them.
We are just going off the data
and our machine learning
models.
In machine learning,
you train a network
like flashcards.
Here's the question.
Here's the answer.
Here's the question.
Here's the answer.
But in protein folding,
we're not doing the kind
of standard task at DeepMind
where you have unlimited data.
Your job is to get better
at chess or Go
and you can play
as many games of chess or Go
as your computers will allow.
With proteins,
we're sitting on
a very thick size of data
that's been determined
by a half century
of time-consuming experimental
methods in laboratories.
These painstaking methods
can take months or years
to determine
a single protein structure,
and sometimes, a structure
can never be determined.
That's why we're working
with such small datasets
to train our algorithms.
When DeepMind
started to explore
the folding problem,
they were talking to us about
which datasets they were using
and what would be
the possibilities
if they did
solve this problem.
Many people have tried,
and yet no one on the planet
has solved protein folding.
I did think to myself,
"Well, you know, good luck."
If we can solve
the protein folding problem,
it would have an incredible
kind of medical relevance.
This is the cycle of science.
You do a huge amount
of exploration,
and then you go
into exploitation mode,
and you focus and you see
how good
are those ideas, really?
And there's nothing better
than external competition
for that.
So we decided
to enter CASP competition.
CASP, we started
to try and speed up
the solution to
the protein folding problem.
CASP is when we say,
"Look, DeepMind
is doing protein folding,
"this is how good we are,
"and maybe it's better
than everybody else.
"Maybe it isn't."
CASP is a bit like
the Olympic Games
of protein folding.
CASP is
a community-wide assessment
that's held every two years.
Teams are given
the amino acid sequences
of about 100 proteins,
and then they try
to solve this folding problem
using computational methods.
These proteins have
already been determined
by experiments
in a laboratory,
but have not yet
been revealed publicly.
And these known structures
represent the gold standard
against which
all the computational
predictions will be compared.
We've got a score
that measures the accuracy
of the predictions.
And you would expect
a score of over 90
to be a solution to
the protein folding problem.
Welcome, everyone,
to our first, uh, semifinals
in the winners' bracket.
Nick and John
versus Demis and Frank.
Please join us, come around.
This will be an intense match.
When I learned that Demis was
going to tackle
the protein folding issue,
um, I wasn't at all surprised.
It's very typical of Demis.
You know,
he loves competition.
And that's the end
of the first game, 10-7.
The aim for CASP would be
to not just
win the competition,
but sort of, um,
retire the need for it.
So, 20 targets total
have been released by CASP.
We were thinking maybe
throw in the standard
kind of machine learning
and see how far
that could take us.
Instead of having a couple
of days on an experiment,
we can turn around
five experiments a day.
Great. Well done, everyone.
Can you show me the real one
instead of ours?
The true answer is
supposed to look
something like that.
It's a lot more
cylindrical than I thought.
The results
were not very good.
Okay.
We throw
all the obvious ideas to it
and the problem laughs at you.
This makes no sense.
We thought
we could just throw
some of our best algorithms
at the problem.
We were slightly naive.
We should be learning this,
you know,
in the blink of an eye.
The thing
I'm worried about is,
we take the field from
really bad answers
to moderately bad answers.
I feel like we need
some sort of new technology
for moving around
these things.
With only
a week left of CASP,
it's now a sprint
to get it deployed.
You've done your best.
Then there's
nothing more you can do
but wait for CASP
to deliver the results.
This famous thing of Einstein,
the last couple of years
of his life,
when he was here,
he overlapped with Kurt Godel
and he said one of the reasons
he still comes in to work
is so that
he gets to walk home
and discuss things with Godel.
It's a pretty big compliment
for Kurt Godel,
shows you how amazing he was.
The Institute
for Advanced Study
was formed in 1933.
In the early years,
the intense scientific
atmosphere attracted
some of the most brilliant
mathematicians and physicists
ever concentrated
in a single place and time.
The founding
principle of this place,
it's the idea of unfettered
intellectual pursuits,
even if you don't know
what you're exploring.
Will result
in some cool things,
and sometimes that then
ends up being useful,
which, of course,
is partially what I've been
trying to do at DeepMind.
How many big breakthroughs
do you think are required
to get all the way to AGI?
And, you know,
I estimate maybe
there's about
a dozen of those.
You know, I hope
it's within my lifetime.
- Yes, okay.
-But then,
all scientists
hope that, right?
Demis has
many accolades.
He was elected Fellow to
the Royal Society last year.
He is also a Fellow
of Royal Society of Arts.
A big hand for Demis Hassabis.
My dream
has always been to try
and make
AI-assisted science possible.
And what I think is
our most exciting project,
last year,
which is our work
in protein folding.
Uh, and we call this system
AlphaFold.
We entered it into CASP
and our system, uh,
was the most accurate,
uh, predicting structures
for 25 out of the 43 proteins
in the hardest category.
So we're state of the art,
but we still...
I have to make... Be clear,
we're still a long way from
solving the protein
folding problem.
We're working hard
on this, though,
and we're exploring
many other techniques.
Let's get started.
So kind of
a rapid debrief,
these are
our final rankings for CASP.
We beat the second team
in this competition
by nearly 50%,
but we've still got
a long way to go
before we've solved
the protein folding problem
in a sense that
a biologist could use it.
It is area of concern.
The quality
of predictions varied
and they were no more useful
than the previous methods.
AlphaFold didn't
produce good enough data
for it to be useful
in a practical way
to, say, somebody like me
investigating
my own biological problems.
That was kind of
a humbling moment
'cause we thought we'd worked
very hard and succeeded.
And what we'd found is
we were the best in the world
at a problem
the world's not good at.
We knew we sucked.
It doesn't help
if you have the tallest ladder
when you're going to the moon.
The opinion of quite
a few people on the team,
that this is sort of
a fool's errand in some ways.
And I might have been wrong
with protein folding.
Maybe it's too hard still
for where we're at
generally with AI.
If you want to do
biological research,
you have to be
prepared to fail
because biology
is very complicated.
I've run a laboratory
for nearly 50 years,
and half my time,
I'm just
an amateur psychiatrist
to keep, um, my colleagues
cheerful when nothing works.
And quite a lot of the time
and I mean, 80, 90%,
it does not work.
If you are
at the forefront of science,
I can tell you,
you will fail a great deal.
I just felt disappointed.
Lesson I learned is that
ambition is a good thing,
but you need
to get the timing right.
There's no point being
50 years ahead of your time.
You will never survive
fifty years of
that kind of endeavor
before it yields something.
You'll literally die trying.
When we talk about AGI,
the holy grail
of artificial intelligence,
it becomes really difficult
to know what
we're even talking about.
Which bits
are we gonna see today?
We're going
to start in the garden.
This is the garden looking
from the observation area.
Research scientists
and engineers
can analyze and collaborate
and evaluate
what's going on in real time.
So in the 1800s,
we'd think of things like
television and the submarine
or a rocket ship to the moon
and say these things
are impossible.
Yet Jules Verne
wrote about them and,
a century and a half later,
they happened.
We'll be
experimenting
on civilizations really,
civilizations of AI agents.
Once the experiments
start going,
it's going to be
the most exciting thing ever.
So how will we get sleep?
I won't be able to sleep.
Full AGI
will be able to do
any cognitive task
a person can do.
It will be at a scale,
potentially, far beyond that.
It's really impossible for us
to imagine the outputs
of a superintelligent entity.
It's like asking a gorilla
to imagine, you know,
what Einstein does
when he produces
the theory of relativity.
People often ask me
these questions like,
"What happens if you're wrong,
and AGI is quite far away?"
And I'm like,
I never worry about that.
I actually
worry about the reverse.
I actually worry
that it's coming faster
than we can
really prepare for.
It really feels
like we're in a race to AGI.
The prototypes and the models
that we are developing now
are actually transforming
the space of what
we know about intelligence.
Recently,
we've had agents
that are powerful enough
to actually start
playing games in teams,
then competing
against other teams.
We're seeing
co-operative social dynamics
coming out of agents
where we haven't
pre-programmed in
any of these sorts
of dynamics.
It's completely learned
from their own experiences.
When we started,
we thought we were
out to build
an intelligence system
and convince the world
that we'd done it.
We're now starting
to wonder whether
we're gonna build systems
that we're not convinced
are fully intelligent,
and we're trying to convince
the world that they're not.
Hi, Alpha.
Hello there.
Where are we today?
You're at the Museum of
Modern Art in New York City.
Kind of.
Um, what painting is this?
This isThe Creation of Adam
by Michelangelo.
I don't think that painting
is in New York City.
You are right.
It's in the Vatican City.
Do you think
that's where we are?
No.
Then how
am I looking at this?
You're looking at
a digital copy
of the painting.
Yes.
Who lives
in this house?
An astronaut.
What's this astronaut's name?
His name is Mark.
This is a famous equation
by Albert Einstein.
It shows that energy and mass
are equivalent.
How would you explain it
to a five year old?
Well, imagine
you have a big rock,
and you want to know
how much it weighs.
Is Mark in danger?
No.
Mark is not in danger.
Why is that?
Because the dinosaur
is not real.
All right.
Why could you
not answer my question?
I think I couldn't
answer your question
because I don't know
enough about the subject.
Okay.
How could you learn
more about the subject?
I can learn more
about the subject
by reading books,
articles, and websites.
You can teach me.
My conclusion is,
if you now think about
what we're doing,
is learning from all humans,
all their knowledge at once
put on the Internet,
you would actually
know a lot about the world.
Like a significant portion
of everything humans can do.
And now,
I think it's more like,
"Well, it might just work."
This is a big moment.
Who is this?
This is God
reaching out to Adam.
The advent of AGI
will divide human history
into two parts.
The part up to that point
and the part after that point.
Why is he reaching out
to touch Adam?
God is
reaching out to touch Adam
to give him life.
It will give us a tool
that can completely reinvent
our entire civilization.
What does
this painting mean to you?
The painting
means a lot to me.
Okay. Like what?
I think
the painting is a reminder
that we are all
connected to each other
and that we are
all part of something
bigger than ourselves.
That's pretty nice.
When you cross
that barrier of
"AGI might happen
one day in the future"
to "No, actually, this could
really happen in a time frame
"that is sort of, like,
on my watch, you know,"
something changes
in your thinking.
...learned to orient
itself by looking...
We have to be
careful with how we use it
and thoughtful about
how we deploy it.
You'd have to consider
what's its top level goal.
If it's to keep humans happy,
which set of humans?
What does happiness mean?
A lot of our collective goals
are very tricky,
even for humans to figure out.
Technology always
embeds our values.
It's not just technical,
it's ethical as well.
So we've got
to be really cautious
about what
we're building into it.
We're trying to find
a single algorithm which...
The reality is
that this is an algorithm
that has been created
by people, by us.
You know, what does it mean
to endow our agents
with the same kind of values
that we hold dear?
What is the purpose
of making these AI systems
appear so humanlike
so that they do
capture hearts and minds
because they're kind of
exploiting a human
vulnerability also?
The heart and mind
of these systems
are very much
human-generated data...
Mmm-hmm.
...for all the good
and the bad.
There is a parallel
between
the Industrial Revolution,
which was an incredible
moment of displacement
and the current technological
change created by AI.
Pause AI!
We have to think
about who's displaced
and how we're going
to support them.
This technology
is coming a lot sooner,
uh, than really
the world knows or kind of
even we 18, 24 months
ago thought.
So there's
a tremendous opportunity,
tremendous excitement,
but also
tremendous responsibility.
It's happening so fast.
How will we govern it?
How will we decide
what is okay
and what is not okay?
AI-generated images are
getting more sophisticated.
The use of AI
for generating disinformation
and manipulating
human psychology
is only going to get
much, much worse.
AGI is coming,
whether we do it here
at DeepMind or not.
It's gonna happen,
so we better create
institutions to protect us.
It's gonna require
global coordination.
And I worry that humanity is
increasingly getting worse
at that rather than better.
We need
a lot more people
really taking this seriously
and thinking about this.
It's, yeah, it's serious.
It worries me.
It worries me. Yeah.
If you received
an email saying
this superior
alien civilization
is going to arrive on Earth,
there would be
emergency meetings
of all the governments.
We would go into overdrive
trying to figure out
how to prepare.
The arrival of AGI will be
the most important moment
that we have ever faced.
My dream
was that on the way to AGI,
we would create
revolutionary technologies
that would be
of use to humanity.
That's what I wanted
with AlphaFold.
I think
it's more important than ever
that we should solve
the protein folding problem.
This is gonna be really hard,
but I won't give up
until it's done.
You know,
we need to double down
and go as fast as possible
from here.
I think we've got
no time to lose.
So we are going to make
a protein folding strike team.
Team lead for the strike team
will be John.
Yeah, we've seen Alpha...
You know,
we're gonna try everything,
kitchen sink, the whole lot.
CASP14 is about
proving we can
solve the whole problem.
And I felt that to do that,
we would need to incorporate
some domain knowledge.
We had some
fantastic engineers on it,
but they were
not trained in biology.
As a computational biologist,
when I initially joined
the AlphaFold team,
I didn't immediately feel
confident about anything.
You know,
whether we were
gonna be successful.
Biology is so
ridiculously complicated.
It just felt like this very
far-off mountain to climb.
I'm starting to play with
the underlying temperatures
to see if we can get...
As one of the few people
on the team
who's done work
in biology before,
you feel this huge sense
of responsibility.
"We're expecting you to do
"great things
on this strike team."
That's terrifying.
But one of the reasons
why I wanted to come here
was to do
something that matters.
This is the number
of missing things.
What about making use
of whatever understanding
you have of physics?
Using that
as a source of data?
But if it's systematic...
Then, that can't be
right, though.
If it's systematically wrong
in some weird way,
you might be learning that
systematically wrong physics.
The team is already
trying to think
of multiple ways that...
Biological relevance
is what we're going for.
So we rewrote
the whole data pipeline
that AlphaFold uses to learn.
You can't
force the creative phase.
You have to give it space
for those flowers to bloom.
We won CASP.
Then it was
back to the drawing board
and like,
what are our new ideas?
Um, and then it's taken
a little while, I would say,
for them to get back
to where they were,
but with the new ideas.
And then now I think
we're seeing the benefits
of the new ideas.
They can go further, right?
So, um, that's a really
important moment.
I've seen that moment
so many times now,
but I know
what that means now.
And I know
this is the time now to press.
Adding side-chains
improves direct folding.
That drove
a lot of the progress.
- We'll talk about that.
- Great.
The last four months,
we've made enormous gains.
During CASP13,
it would take us a day or two
to fold one of the proteins,
and now we're folding, like,
hundreds of thousands
a second.
Yeah, it's just insane.
Now,
this is a model
that is
orders of magnitude faster,
while at the same time
being better.
We're getting
a lot of structures
into the high-accuracy regime.
We're rapidly improving
to a system
that is starting to really
get at the core and heart
of the problem.
It's great work.
It looks like
we're in good shape.
So we got, what, six,
five weeks left? Six weeks?
So what's, uh... Is it...
You got enough compute power?
I... We could use more.
I was nervous about CASP
but as the system
is starting to come together,
I don't feel as nervous.
I feel like things
have, sort of,
come into perspective
recently,
and, you know,
it's gonna be fine.
The Prime Minister
has announced
the most drastic limits
to our lives
the U.K. has ever seen
in living memory.
I must give the British people
a very simple instruction.
You must stay at home.
It feels like we're
in a science fiction novel.
You know, I'm delivering food
to my parents,
making sure
they stay isolated and safe.
I think it just highlights
the incredible need
for AI-assisted science.
You always know that
something like this
is a possibility.
But nobody ever really
believes it's gonna happen
in their lifetime, though.
-Are you recording yet?
-Yes.
- Okay, morning, all.
- Hey.
Good. CASP has started.
It's nice I get to sit around
in my pajama bottoms all day.
I never
thought I'd live in a house
where so much was going on.
I would be trying to solve
protein folding in one room,
and my husband would be trying
to make robots walk
in the other.
One of the hardest proteins
we've gotten in CASP thus far
is the SARS-CoV-2 protein
called ORF8.
ORF8 is
a coronavirus protein.
It's one of the main proteins,
um,
that dampens
the immune system.
We tried really hard
to improve our prediction.
Like, really, really hard.
Probably the most time
that we have ever spent
on a single target.
To the point where
my husband is, like,
"It's midnight.
You need to go to bed."
So I think we're at
Day 102 since lockdown.
My daughter
is keeping a journal.
Now you can go out
as much as you want.
We have received
the last target.
They've said they will be
sending out no more targets
in our category of CASP.
So we're just making sure
we get
the best possible answer.
As soon as we started
to get the results,
I'd sit down and start looking
at how close did anybody come
to getting the protein
structures correct.
- Oh, hi there.
-Hello.
It is an unbelievable thing,
CASP has finally ended.
I think it's at least time
to raise a glass.
Um, I don't know
if everyone has a glass
of something
that they can raise.
If not, raise,
I don't know, your laptops.
Um...
I'll probably make a speech
in a minute.
I feel like I should but I
just have no idea what to say.
So... let's see.
I feel like
a reading of email...
is the right thing to do.
When John said,
"I'm gonna read an email,"
at a team social,
I thought, "Wow, John,
you know how to have fun."
We're gonna read an email now.
Uh, I got this
about four o'clock today.
Um, it is from John Moult.
And I'll just read it.
It says,
"As I expect you know,
"your group has performed
amazingly well in CASP 14,
"both relative to other groups
"and in absolute
model accuracy."
"Congratulations on this work.
"It is really outstanding."
The structures were so good,
it was... it was just amazing.
After half a century,
we finally have a solution
to the protein folding
problem.
When I saw this email,
I read it,
I go, "Oh, shit!"
And my wife goes,
"Is everything okay?"
I call my parents, and just,
like, "Hey, Mum.
"Um, got something
to tell you.
"We've done this thing
"and it might be kind of
a big deal."
When I learned of
the CASP 14 results,
I was gobsmacked.
I was just excited.
This is a problem
that I was beginning to think
would not get solved
in my lifetime.
Now we have a tool
that can be used
practically by scientists.
These people
are asking us, you know,
"I've got this protein
involved in malaria,"
or, you know,
some infectious disease.
"We don't know the structure.
"Can we use AlphaFold
to solve it?"
We can easily predict
all known sequences
in a month.
All known sequences
in a month?
- Yeah, easily.
- Mmm-hmm?
A billion, two billion.
Um, and they're...
So why don't we just do that?
Yeah.
- We should just do that a lot.
- Well, I mean...
That's way better.
Why don't we just do that?
So that's
one of the options.
-Right.
- There's this...
We should just...
Right, that's a great idea.
We should just run
every protein in existence.
And then release that.
Why didn't someone
suggest this before?
Of course that's
what we should do.
Why are we thinking about
making a service
and then people submit
their protein?
We just fold everything.
And then give it to
everyone in the world.
Who knows how many discoveries
will be made from that?
Demis called us up
and said,
"We want to make this open.
"Not just make sure
the code is open,
"but we're gonna make it
really easy
"for everybody to get access
to the predictions."
That is fantastic.
It's like drawing back
the curtain
and seeing the whole world
of protein structures.
They released the structures
of 200 million proteins.
These are gifts to humanity.
The moment AlphaFold
is live to the world,
we will no longer be
the most important people
in AlphaFold's story.
Can't quite believe
it's all out.
Aw!
A hundred
and sixty-four users.
Loads of activity in Japan.
We have 655 users currently.
We currently
have 100,000 concurrent users.
Wow!
Today is just crazy.
What an absolutely
unbelievable effort
from everyone.
We're gonna all remember
these moments
for the rest of our lives.
I'm excited about AlphaFold.
For my research, it's already
propelling lots of progress.
And this is
just the beginning.
My guess is,
every single biological
and chemistry achievement
will be related to AlphaFold
in some way.
AlphaFold is an index moment.
It's a moment
that people will not forget
because the world changed.
Everybody's realized now
what Shane and I have known
for more than 20 years,
that AI is going to be
the most important thing
humanity's ever gonna invent.
We will shortly be arriving
at our final destination.
The pace of
innovation and capabilities
is accelerating,
like a boulder rolling down
a hill that we've kicked off
and now it's continuing
to gather speed.
We are at
a crossroads in human history.
AI has the potential
to transform our lives
in every aspect.
It's no less important than
the discovery of electricity.
We should be looking
at the scientific method
and trying to understand
each step of the way
in a rigorous way.
This is a moment
of profound opportunity.
Harnessing this technology
could eclipse anything
we have ever known.
Hi, Alpha.
Hi.
What is this?
This is a chessboard.
If I was to play white, what
move would you recommend?
I would recommend
that you move your pawn
from E2 to E4.
And now if you were black,
what would you play now?
I would play
the Sicilian Defense.
That's a good choice.
Thanks.
So what do you see?
What is this object?
This is a pencil sculpture.
What happens if I move
one of the pencils?
If you move
one of the pencils,
the sculpture will fall apart.
I'd better leave it alone,
then.
That's probably
a good idea.
AGI is on the horizon now.
Very clearly
the next generation
is going to live
in a future world
where things will be radically
different because of AI.
And if you want to steward
that responsibly,
every moment is vital.
This is the moment I've been
living my whole life for.
It's just
a good thinking game.
Hello.
Can you
help me write code?
I was trained
to answer questions,
but I'm able to learn.
That's very
open-minded of you.
Thank you.
I'm glad you're happy with me.
What's this guy doing?
That's a developer.
What do you think
he's working on?
That's a tough question.
He might be working
on a new feature,
a bug fix or something else.
It's quite possible.
Yes.
Do you see my backpack?
That's a badminton racket.
It's a squash racket,
but that's pretty close.
That's a badminton racket.
No, but you're not
the first person
to make that mistake.
AI, the technology
that has been advancing
at breakneck speed.
Artificial
intelligence is all the rage.
Some are now
raising alarm about...
It is definitely concerning.
This is an AI arms race.
We don't know
how this is all
going to shake out,
but it's clear
something is happening.
I'm kind of restless.
Trying to build AGI
is the most exciting journey,
in my opinion, that humans
have ever embarked on.
If you're really going
to take that seriously,
there isn't a lot of time.
Life's very short.
My whole life goal is to solve
artificial
general intelligence.
And on the way,
use AI as the ultimate tool
to solve all the world's
most complex
scientific problems.
I think that's bigger
than the Internet.
I think that's bigger
than mobile.
I think it's more like
the advent
of electricity or fire.
World leaders
and artificial
intelligence experts
are gathering
for the first ever
global AI safety summit,
set to look at the risks
of the fast growing technology
and also...
I think
this is a hugely
critical moment
for all humanity.
It feels like
we're on the cusp
of some incredible things
happening.
Let me take you through
some of the reactions
in today's papers.
AGI is pretty close,
I think.
There's clearly huge interest
in what it is capable of,
where it's taking us.
This is the moment
I've been living
my whole life for.
I've always been fascinated
by the mind.
So I set my heart
on studying neuroscience
because I wanted
to get inspiration
from the brain for AI.
I remember asking Demis,
"What's the end game?"
You know?
So you're going to come here
and you're going
to study neuroscience
and you're going to maybe
get a Ph.D. if you work hard.
And he said,
"You know, I want
to be able to solve AI.
"I want to be able
to solve intelligence."
The human brain
is the only existent proof
we have, perhaps
in the entire universe,
that general intelligence
is possible at all.
And I thought
someone in this building
should be interested
in general intelligence
like I am.
And then Shane's name
popped up.
Our next speaker today
is Shane Legg.
He's from New Zealand,
where he trained in math
and classical ballet.
Are machines actually
becoming more intelligent?
Some people say yes,
some people say no.
It's not really clear.
We know they're getting
a lot faster
at doing computations.
But are we actually
going forwards
in terms
of general intelligence?
We were both
obsessed with AGI,
artificial
general intelligence.
So today I'm going
to be talking about
different approaches
to building AGI.
With my colleague
Demis Hassabis,
we're looking at ways
to bring in ideas
from theoretical neuroscience.
I felt like we were
the keepers of a secret
that no one else knew.
Shane and I knew
no one in academia
would be supportive
of what we were doing.
AI was almost
an embarrassing word
to use in academic circles,
right?
If you said
you were working on AI,
then you clearly weren't
a serious scientist.
So I convinced Shane
the right way to do it
would be to start a company.
Okay,
we're going to try to do
artificial
general intelligence.
It may not even be possible.
We're not quite sure
how we're going to do it,
but we have some ideas
or, kind of, approaches.
Huge amounts of money,
huge amounts of risk,
lots and lots of compute.
And if we pull this off,
it'll be the biggest thing
ever, right?
That is a very hard thing
for a typical investor
to put their money on.
It's almost like
buying a lottery ticket.
I'm going to be speaking about
the system of neuroscience
and how it might be used
to help us build AGI.
Finding initial funding
for this was very hard.
We're going to solve
all of intelligence.
You can imagine
some of the looks I got
when we were
pitching that around.
So I'm a V.C.
and I look at about
700 to 1,000 projects a year.
And I fund
literally 1% of those.
About eight projects a year.
So that means 99% of the time,
you're in "No" mode.
"Wait a minute.
I'm telling you,
"this is the most important
thing of all time.
"I'm giving you
all this build-up
"about how... explain
"how it connects
with the brain,
"why the time's right now,
and then you're asking me,
"'But what's your, how are you
going to make money?
"'What's your product?'"
It's like,
so prosaic a question.
You know?
"Have you not been listening
to what I've been saying?"
We needed investors
who aren't necessarily
going to invest
because they think
it's the best
investment decision.
They're probably
going to invest
because they just think
it's really cool.
He's the Silicon Valley
version of the man
behind the curtain
inThe Wizard of Oz.
He had a lot to do
with giving you
PayPal, Facebook,
YouTube and Yelp.
If everyone says "X,"
Peter Thiel suspects
that the opposite of X
is quite possibly true.
So Peter Thiel
was our first big investor.
But he insisted that
we come to Silicon Valley
because that
was the only place we could...
There would be the talent,
and we could build
that kind of company.
But I was pretty adamant
we should be in London
because I think
London's an amazing city.
Plus, I knew there were
really amazing people
trained at Cambridge
and Oxford and UCL.
In Silicon Valley,
everybody's founding
a company every year,
and then if it doesn't work,
you chuck it
and you start something new.
That is not conducive
to a long-term
research challenge.
So we were totally
an outlier for him.
Hi, everyone.
Welcome to DeepMind.
So, what is our mission?
We summarize it as...
DeepMind's mission is to build
the world's first
general learning machine.
So we always stress the word
"general" and "learning" here
are the key things.
Our mission
was to build an AGI,
an artificial
general intelligence.
And so that means that we need
a system which is general.
It doesn't learn to do
one specific thing.
That's a really key part
of human intelligence.
We can learn to do
many, many things.
It's going to, of course,
be a lot of hard work.
But one of the things
that keeps me up at night
is to not waste this
opportunity to, you know,
to really make
a difference here,
and have a big impact
on the world.
The first people
that came
and joined DeepMind
really believed in the dream.
But this was, I think,
one of the first times
they found a place
full of other dreamers.
You know, we collected
this Manhattan Project,
if you like,
together to solve AI.
In the first two years,
we were in total stealth mode.
And so we couldn't
say to anyone
what were we doing
or where we worked.
It was all quite vague.
It had
no public presence at all.
You couldn't
look at a website.
The office
was at a secret location.
When we would interview people
in those early days,
they would show up
very nervously.
I had at least one candidate
who said,
"I just messaged my wife
to tell her exactly
"where I'm going just in case
"this turns out to be some
kind of horrible scam
"and I'm going
to get kidnapped."
Well, my favorite new person
who's an investor,
who I've been working
for a year, is Elon Musk.
So for those of you
who don't know,
this is what he looks like.
And he hadn't really thought
much about AI
until we chatted.
His mission is to die on Mars
or something.
But not on impact.
So...
We made some big decisions
about how we were going
to approach building AI.
This is a reinforcement
learning setup.
This is the kind of setup
that we think about
when we say we're building,
you know, an AI agent.
It's basically the agent,
which is the AI,
and then there's
the environment
that it's interacting with.
We decided that games,
as long as
you're very disciplined
about how you use them,
are the perfect
training ground
for AI development.
We wanted
to try to create one algorithm
that could to be
trained up to play
several dozen
different Atari games.
So just like a human,
you have to use the same brain
to play all the games.
You can think of it
that you provide the agent
with the cartridge.
And you say,
"Okay, imagine you're born
into that world
"with that cartridge,
and you just get to interact
"with the pixels
and see the score.
"What can you do?"
So what you're going to do is
take your Q function. Q-K...
Q-learning
is one of the oldest methods
for reinforcement learning.
And what we did was combine
reinforcement learning
with deep learning
in one system.
No one had ever combined
those two things together
at scale to do
anything impressive,
and we needed
to prove out this thesis.
We tried doingPong
as the first game.
It seemed like the simplest.
It hasn't been told
anything about
what it's controlling
or what it's supposed to do.
All it knows
is that score is good
and it has to learn
what its controls do,
and build everything...
first principles.
It wasn't really working.
I was just
saying to Shane,
"Maybe we're just wrong,
and we can't even doPong."
It was a bit
nerve-racking,
thinking how far we had to go
if we were going
to really build
a generally
intelligent system.
And it felt like
it was time
to give up and move on.
And then suddenly...
We got our first point.
And then it was like,
"Is this random?"
"No, no, it's really
getting a point now."
It was really exciting
that this thing
that previously
couldn't even figure out
how to move a paddle
had suddenly been able
to totally get it right.
Then it was getting
a few points.
And then it won
its first game.
And then three months later,
no human could beat it.
You hadn't told it the rules,
how to get the score, nothing.
And you just tell it
to maximize the score,
and it goes away and does it.
This is the first time
anyone had done
this end-to-end learning.
"Okay, so we have this working
in quite a general way.
"Now let's try another game."
So then
we triedBreakout.
At the beginning,
after 100 games,
the agent is not very good.
It's missing the ball
most of the time,
but it's starting to get
the hang of the idea
that the bat should go
towards the ball.
Now, after 300 games,
it's about as good as
any human can play this.
We thought,
"Well, that's pretty cool,"
but we left the system playing
for another 200 games,
and it did this amazing thing.
It found the optimal strategy
was to dig a tunnel
around the side
and put the ball
around the back of the wall.
Finally, the agent
is actually achieving
what you thought
it would achieve.
That is a great feeling.
Right?
Like, I mean,
when we do research,
that is the best
we can hope for.
We started generalizing
to 50 games,
and we basically
created a recipe.
We could just take a game
that we have
never seen before.
We would run
the algorithm on that,
and DQN could train itself
from scratch,
achieving human level
or sometimes better
than human level.
We didn't build it
to play any of them.
We could just give it
a bunch of games
and would figure it out
for itself.
And there was something
quite magical in that.
Suddenly you had something
that would respond and learn
whatever situation
it was parachuted into.
And that was like a huge,
huge breakthrough.
It was in many respects
the first example
of any kind of thing
you could call
a general intelligence.
Although we were
a well-funded startup,
holding us back
was not enough compute power.
I realized that
this would accelerate
our time scale
to AGI massively.
I used to see Demis
quite frequently.
We'd have lunch, and he did...
say to me that
he had two companies
that were involved
in buying DeepMind.
And he didn't know
which one to go with.
The issue was,
would any commercial company
appreciate the real importance
of the research?
And give the research time
to come to fruition
and not be breathing down
their necks,
saying, "We want some kind of
commercial benefit from this."
Google has bought DeepMind
for a reported 400,000,000,
making the artificial
intelligence firm
its largest
European acquisition so far.
The company was founded
by 37-year-old entrepreneur
Demis Hassabis.
After the acquisition,
I started mentoring
and spending time with Demis,
and just listening to him.
And this is a person
who fundamentally
is a scientist
and a natural scientist.
He wants science to solve
every problem in the world,
and he believes it can do so.
That's not a normal person
you find in a tech company.
We were able
to not only join Google
but run independently
in London,
build our culture,
which was optimized
for breakthroughs
and not deal with products,
do pure research.
Our investors
didn't want to sell,
but we decided
that this was the best thing
for the mission.
In many senses,
we were underselling
in terms of value
before it more matured,
and you could have sold it
for a lot more money.
And the reason is because
there's no time to waste.
There's so many things
that got to be cracked
while the brain
is still in gear.
You know, I'm still alive.
There's all these things
that gotta be done.
So you haven't got--
I mean, how many...
How many billions
would you trade for
another five years of life,
you know,
to do what you set out to do?
Okay, all of a sudden,
we've got this massive scale
compute available to us.
What can we do with that?
Go is the pinnacle
of board games.
It is the most complex game
ever devised by man.
There are more possible
board configurations
in the game of Go than there
are atoms in the universe.
Go is the holy grail
of artificial intelligence.
For many years,
people have looked
at this game
and they've thought,
"Wow, this is just too hard."
Everything we've ever
tried in AI,
it just falls over when
you try the game of Go.
And so that's why
it feels like
a real litmus test
of progress.
We had just bought DeepMind.
They were working
on reinforcement learning
and they were the world's
experts in games.
And so when
they introduced the idea
that they could beat
the top level Go players
in a game that was thought
to be incomputable,
I thought, "Well,
that's pretty interesting."
Our ultimate next step
is to play the legendary
Lee Sedol
in just over two weeks.
A match like no other
is about to get underway
in South Korea.
Lee Sedol
is getting ready to rumble.
Lee Sedol is probably
one of the greatest players
of the last decade.
I describe him
as the Roger Federer of Go.
He showed up,
and all of a sudden
we have a thousand Koreans
who represent
all of Korean society,
the top Go players.
And then we have Demis.
And the great
engineering team.
He's very famous
for very creative
fighting play.
So this could be
difficult for us.
I figured Lee Sedol
is going to beat these guys,
but they'll make
a good showing.
Good for a startup.
I went over
to the technical group
and they said,
"Let me show you
how our algorithm works."
If you step
through the actual game,
we can see, kind of,
how AlphaGo thinks.
The way we start off
on training AlphaGo
is by showing it 100,000 games
that strong amateurs
have played.
And we first initially
get AlphaGo to mimic
the human player,
and then through
reinforcement learning,
it plays against
different versions of itself
many millions of times
and learns from its errors.
Hmm, this is interesting.
All right, folks,
you're going to see
history made.
So the game starts.
He's really concentrating.
If you really look at the...
That's a very surprising move.
I think we're
seeing an original move here.
Yeah, that's an exciting move.
I like...
Professional commentators
almost unanimously said
that not a single human player
would have chosen move 37.
So I actually had a poke
around in AlphaGo
to see what AlphaGo thought.
And AlphaGo actually agreed
with that assessment.
AlphaGo said there was a one
in 10,000 probability
that move 37 would have been
played by a human player.
The game of Go
has been studied
for thousands of years.
And AlphaGo discovered
something completely new.
He resigned.
Lee Sedol has just resigned.
He's beaten.
The battle
between man versus machine,
a computer just came out
the victor.
put its DeepMind team
to the test against
one of the brightest minds
in the world and won.
That's when we realized
the DeepMind people knew
what they were doing
and to pay attention
to reinforcement learning
as they have invented it.
Based on that experience,
AlphaGo got better
and better and better.
And they had a little chart
of how much better
they were getting.
And I said,
"When does this stop?"
And Demis said,
"When we beat the Chinese guy,
"the top-rated player
in the world."
Ke Jie versus AlphaGo.
And I think we will see
AlphaGo pushing through there.
AlphaGo is ahead quite a bit.
About halfway
through the first game,
the best player in the world
was not doing so well.
What can black do here?
Looks difficult.
And at a critical moment...
the Chinese government
ordered the feed cut off.
It was at that moment
we were telling the world
that something new
had arrived on earth.
In the 1950s
when Russia'sSputnik
satellite was launched,
it changed
the course of history.
It is a challenge
that America must meet
to survive in the Space Age.
This has been
called theSputnik moment.
The Sputnikmoment created
a massive reaction in the US
in terms of funding
for science and engineering,
and particularly
of space technology.
For China,
AlphaGo was the wakeup call,
the Sputnikmoment.
It launched an AI space race.
We had this
huge idea that worked,
and now the whole world knows.
It's always easier
to land on the moon
if someone's already
landed there.
It is going to matter
who builds AI,
and how it gets built.
I always feel that pressure.
There's been
a big chain of events
that followed on from all
of the excitement of AlphaGo.
When we played
against Lee Sedol,
we actually had a system
that had been trained
on human data,
on all of the millions
of games
that have been played
by human experts.
We eventually found
a new algorithm,
a much more elegant approach
to the whole system,
which actually stripped out
all of the human knowledge
and just started
completely from scratch.
And that became a project
which we called AlphaZero.
Zero, meaning having zero
human knowledge in the loop.
Instead of learning
from human data,
it learned from its own games.
So it actually
became its own teacher.
AlphaZero is an experiment
in how little knowledge
can we put into these systems
and how quickly
and how efficiently
can they learn?
But the other thing is AlphaZero
doesn't have any rules.
It learns through experience.
The next stage
was to make it more general,
so that it could play
any two-player game.
Things like chess,
and in fact,
any kind of two-player
perfect information game.
It's going really well.
It's going
really, really well.
- Oh, wow.
- It's going down, like fast.
AlphaGo used
to take a few months to train,
but AlphaZero could start
in the morning
playing completely randomly
and then by tea
be at superhuman level.
And by dinner it will be
the strongest chess entity
there's ever been.
- Amazing, it's amazing.
- Yeah.
It's discovered its own
attacking style, you know,
to take on the current
level of defense.
I mean, I never
in my wildest dreams...
I agree. Actually, I was not
expecting that either.
And it's fun for me.
I mean, it's inspired me
to get back into chess again,
because it's cool to see
that there's even more depth
than we thought in chess.
I actually got
into AI through games.
Initially, it was board games.
I was thinking,
"How is my brain doing this?"
Like, what is it doing?
I was very aware of that
from a very young age.
So I've always been thinking
about thinking.
The British
and American chess champions
meet to begin
a series of matches.
Playing alongside them
are the cream
of Britain and America's
youngest players.
Demis Hassabis
is representing Britain.
When Demis was four,
he first showed
an aptitude for chess.
By the time he was six,
he became London
under-eight champion.
My parents
were very interesting
and unusual, actually.
I'd probably describe them
as quite bohemian.
My father
was a singer-songwriter
when he was younger,
and Bob Dylan was his hero.
Yeah, yeah.
What is it
that you like about this game?
It's just a good
thinking game.
At the time,
I was the second-highest rated
chess player in the world
for my age.
But although I was on track
to be a professional
chess player,
I thought that was what
I was going to do.
No matter how much
I loved the game,
it was incredibly stressful.
Definitely was not fun
and games for me.
My parents used to, you know,
get very upset
when I lost the game
and angry
if I forgot something.
And because it was quite high
stakes for them, you know,
it cost a lot of money
to go to these tournaments.
And my parents
didn't have much money.
My parents thought, you know,
"If you interested
in being a chess professional,
"this is really important.
It's like your exams."
I remember
I was about 12-years-old
and I was at this
international chess tournament
in Liechtenstein
up in the mountains.
And we were in this
huge church hall
with, you know,
hundreds of international
chess players.
And I was playing
the ex-Danish champion.
He must have been
in his 30s, probably.
In those days,
there was a long time limit.
The games could
literally last all day.
- We were into our tenth hour.
And we were in this
incredibly unusual ending.
I think it should be a draw.
But he kept on trying
to win for hours.
Finally, he tried
one last cheap trick.
All I had to do
was give away my queen.
Then it would be stalemate.
But I was so tired,
I thought it was inevitable
I was going to be checkmated.
And so I resigned.
He jumped up.
Just started laughing.
And he went,
"Why have you resigned?
It's a draw."
And he immediately,
with a flourish,
sort of showed me
the drawing move.
I felt so sick to my stomach.
It made me think of
the rest of that tournament.
Like, are we wasting
our minds?
Is this the best use
of all this brain power?
Everybody's, collectively,
in that building?
If you could somehow plug in
those 300 brains
into a system,
you might be able
to solve cancer
with that level
of brain power.
This intuitive feeling
came over me
that although I love chess,
this is not the right thing
to spend my whole life on.
Demis and myself,
our plan was always
to fill DeepMind
with some of the most
brilliant scientists
in the world.
So we had the human brains
necessary to create
an AGI system.
By definition, the "G"
in AGI is about generality.
What I imagine is being able
to talk to an agent,
the agent can talk back,
and the agent is able to solve
novel problems
that it hasn't seen before.
That's a really key part
of human intelligence,
and it's that
cognitive breadth
and flexibility
that's incredible.
The only natural
general intelligence
we know of as humans,
we obviously learn a lot
from our environment.
So we think that
simulated environments
are one of the ways
to create an AGI.
The very early humans
were having to solve
logic problems.
They were having to solve
navigation, memory,
and we evolved
in that environment.
If we can create
a virtual recreation
of that kind of environment,
that's the perfect
testing ground
and training ground
for everything
we do at DeepMind.
What they were doing here
was creating environments
for childlike beings,
the agents to exist
within and play.
That just sounded like
the most interesting thing
in all the world.
A child
learns by tearing things up
and then throwing food around
and getting a response
from mommy or daddy.
This seems like an important
idea to incorporate
in the way you train an agent.
The humanoid
is supposed to stand up.
As his center
of gravity rises,
it gets more points.
You have a reward
and the agent
learns from the reward,
like, you do something well,
you get a positive reward.
You do something bad,
you get a negative reward.
It looks like it's standing.
It's still a bit drunk.
It likes to walk backwards.
Yeah.
The whole algorithm
is trying to optimize
for receiving as much rewards
as possible,
and it's found that
walking backwards,
it's good enough
to get very good scores.
When we learn to navigate,
when we learn to get around
in our world,
we don't start with maps.
We just start
with our own exploration,
adventuring off
across the park,
without our parents
by our side,
or finding our way home
from school when we're young.
A few of us
came up with this idea
that if we had an environment
where a simulated robot
just had to run forward,
we could put all sorts of
obstacles in its way
and see if it could manage
to navigate
different types of terrain.
The idea would be like
a parkour challenge.
It's not graceful,
but was never trained to hold
a glass whilst it was running
and not spill water.
You set this objective
that says,
"Just move forward,
forward velocity,
"and you'll get
a reward for that."
And the learning algorithm
figures out
how to move
this complex set of joints.
That's the power of
reward-based
reinforcement learning.
Our goal
is to try and build agents
which, we drop them in,
they know nothing,
they get to play around in
whatever problem you give them
and eventually figure out how
to solve it for themselves.
Now we want something
which can do that
in as many different types
of problems as possible.
A human needs diverse skills
to interact with the world.
How to deal
with complex images,
how to manipulate
thousands of things at once,
how to deal
with missing information.
We think all of these things
together
are represented
by this game calledStarCraft.
All it's being trained
to do is,
given this situation,
this screen,
what would a human do?
We took inspiration from
large language models
where you simply train
a model
to predict the next word,
which is exactly the same as
predict the next
StarCraft move.
Unlike chess or Go,
where players take turns
to make moves,
inStarCraft there's a
continuous flow of decisions.
On top of that,
you can't even see
what the opponent is doing.
There is no longer
a clear definition
of what it means
to play the best way.
It depends on
what your opponent does.
This is the way
that we'll get to
a much more fluid,
more natural, faster,
more reactive agent.
This is a huge challenge
and let's see how far
we can push.
Oh!
Holy monkey!
I'm a pretty
low-level amateur.
I'm okay, but I'm
a pretty low-level amateur.
These agents have
a long ways to go.
We couldn't
beat someone of Tim's level.
You know, that was
a little bit alarming.
At that point, it felt like
it was going to be, like,
a really big long challenge,
maybe a couple of years.
Dani is the best
DeepMind StarCraft 2 player.
I've been playing the agent
every day for a few weeks now.
I could feel that the agent
was getting better
really fast.
Wow, we beat Danny.
That, for me,
was already
like a huge achievement.
The next step is
we're going to book in
a pro to play.
It feels a bit unfair.
All you guys against me.
We're way
ahead of what I thought
we would do, given where
we were two months ago.
Just trying to digest it all,
actually.
But it's very, very cool.
Now we're in
a position where
we can finally share
the work that we've done
with the public.
This is a big step.
We are really putting
ourselves on the line here.
- Take it away. Cheers.
- Thank you.
We're going to be live
from London.
It's happening.
Welcome to London.
We are going to have
a live exhibition match,
MaNa against AlphaStar.
At this point now,
AlphaStar, 10 and 0
against professional gamers.
Any thoughts
before we get into this game?
I just want to see
a good game, yeah.
I want to see a good game.
Absolutely,
good game. We're all excited.
All right. Let's
see what MaNa can pull off.
AlphaStar is definitely
dominating the pace
of this game.
Wow. AlphaStar
is playing so smartly.
This really looks like
I'm watching
a professional human gamer
from the AlphaStar
point of view.
I hadn't really seen
a pro playStarCraft up close,
and the 800 clicks per minute.
I don't understand how anyone
can even click 800 times,
let alone doing
800 useful clicks.
Oh, another good hit.
- AlphaStar is just
completely relentless.
We need to be careful
because many of us grew up
as gamers and are gamers.
And so to us,
it's very natural
to view games
as what they are,
which is pure vehicles
for fun,
and not to see
that more militaristic side
that the public might see
if they looked at this.
You can't look at gunpowder
and only make a firecracker.
All technologies inherently
point into certain directions.
I'm very worried about
the certain ways in which AI
will be used
for military purposes.
And that makes it even clearer
how important it is
for our societies
to be in control
of these new technologies.
The potential for abuse
from AI will be significant.
Wars that occur faster
than humans can comprehend
and more powerful
surveillance.
How do you keep power forever
over something that's
much more powerful than you?
Technologies can be used
to do terrible things.
And technology can be used
to do wonderful things
and solve
all kinds of problems.
When DeepMind
was acquired by Google...
- Yeah.
- ...you got Google to promise
that technology you developed
won't be used by the military
- for surveillance.
- Right.
- Yes.
- Tell us about that.
I think technology
is neutral in itself,
um, but how, you know,
we as a society
or humans and companies
and other things,
other entities and governments
decide to use it
is what determines whether
things become good or bad.
You know, I personally think
having autonomous weaponry
is just a very bad idea.
AlphaStar is playing
an extremely intelligent game
right now.
There is an element to
what's being created
at DeepMind in London
that does seem like
the Manhattan Project.
There's a relationship between
Robert Oppenheimer
and Demis Hassabis
in which they're unleashing
a new force upon humanity.
MaNa is fighting back, though.
Oh, man!
I think that Oppenheimer
and some of the other leaders
of that project got caught up
in the excitement
of building the technology
and seeing if it was possible.
Where is AlphaStar?
Where is AlphaStar?
I don't see AlphaStar's units
anywhere.
They did not think
carefully enough
about the morals of what
they were doing early enough.
What we should do
as scientists
with powerful new technologies
is try and understand it in
controlled conditions first.
And that is that.
MaNa has defeated AlphaStar.
I mean, my honest feeling is
that I think it is
a fair representation
of where we are.
And I think that part feels...
feels okay.
- I'm very happy for you.
- I'm happy.
So well... well done.
My view is that the approach
to building technology
which is embodied by
move fast and break things,
is exactly what
we should not be doing,
because you can't afford
to break things
and then fix them afterwards.
- Cheers.
- Thank you so much.
Yeah, get... get some rest.
You did really well.
- Cheers, yeah?
- Thank you for having us.
When I was eight,
I bought my first computer
with the winnings
from a chess tournament.
I sort of had this intuition
that computers
are this magical device
that can extend
the power of the mind.
I had a couple
of school friends,
and we used to have
a hacking club,
writing code, making games.
And then over
the summer holidays,
I'd spend the whole day
flicking through
games magazines.
And one day I noticed
there was a competition
to write an original version
of Space Invaders.
And the winner won a job
at Bullfrog.
Bullfrog at the time was the
best game development house
in all of Europe.
You know, I really wanted
to work at this place
and see how they build games.
Bullfrog,
based here in Guildford,
began with a big idea.
That idea turned into the game
Populous,
which became
a global bestseller.
In the '90s, there was
no recruitment agencies.
You couldn't go out and say,
you know,
"Come and work
in the games industry."
It was still not even
considered an industry.
So we came up with the idea
to have a competition
and we got
a lot of applicants.
And one of those was Demis's.
I can still remember clearly
the day that Demis came in.
He walked in the door,
he looked about 12.
I thought, "Oh, my God,
"what the hell are we going
to do with this guy?"
I applied to Cambridge.
I got in but they said
I was way too young.
So...
So I needed to take a year off
so I'd be at least 17
before I got there.
And that's when I decided
to spend that entire gap year
working at Bullfrog.
They couldn't even
legally employ me,
so I ended up being paid
in brown paper envelopes.
I got a feeling of being
really at the cutting edge
and how much fun that was
to invent things every day.
And then you know,
a few months later,
maybe everyone... a million
people will be playing it.
In those days
computer games had to evolve.
There had to be new genres
which were more
than just shooting things.
Wouldn't it be amazing
to have a game
where you design and build
your own theme park?
Demis and I started to talk
aboutTheme Park.
It allows the player
to build a world
and see the consequences
of your choices
that you've made
in that world.
A human player
set out the layout
of the theme park and designed
the roller coaster
and set the prices
in the chip shop.
What I was working on was
the behaviors of the people.
They were autonomous
and that was the AI
in this case.
So what I was trying to do
was mimic
interesting human behavior
so that the simulation
would be
more interesting
to interact with.
Demis worked
on ridiculous things,
like you could place down
these shops
and if you put a shop too near
a very dangerous ride,
then people on the ride
would throw up
because they'd just eaten.
And then that would make
other people throw up
when they saw the throwing-up
on the floor,
so you then had to have
lots of sweepers
to quickly sweep it up
before the people saw it.
That's the cool thing
about it.
You as the player tinker with
it and then it reacts to you.
All those nuanced
simulation things he did
and that was an invention
which never really
existed before.
It was
unbelievably successful.
Theme Park actually turned out
to be a top ten title
and that was the first time
we were starting to see
how AI could make
a difference.
We were doing
some Christmas shopping
and were waiting for the taxi
to take us home.
I have this very clear memory
of Demis talking about AI
in a very different way,
in a way that we didn't
commonly talk about.
This idea of AI being useful
for other things
other than entertainment.
So being useful for, um,
helping the world
and the potential of AI
to change the world.
I just said to Demis,
"What is it you want to do?"
And he said to me,
"I want to be the person
that solves AI."
Peter offered me 1 million
to not go to university.
But I had a plan
from the beginning.
And my plan was always
to go to Cambridge.
I think a lot of
my schoolfriends
thought I was mad.
Why would you not...
I mean, 1 million,
that's a lot of money.
In the '90s,
that is a lot of money, right?
For a...
For a poor 17-year-old kid.
He's like this little seed
that's going to burst through,
and he's not going to be able
to do that at Bullfrog.
I had to drop him off
at the train station
and I can still see
that picture
of this little elven character
disappear down that tunnel.
That was an incredibly
sad moment.
I had this romantic ideal
of what Cambridge
would be like,
1,000 years of history,
walking the same streets
that Turing,
Newton and Crick had walked.
I wanted to explore
the edge of the universe.
When I got to Cambridge,
I'd basically been working
my whole life.
Every single summer,
I was either playing chess
professionally,
or I was working,
doing an internship.
So I was, like, "Right,
I am gonna have fun now
"and explore what it means
to be a normal teenager."
Come on! Go, boy, go!
It was work hard
and play hard.
I first met Demis
because we both attended
Queens' College.
Our group of friends,
we'd often drink beer
in the bar,
play table football.
In the bar,
I used to play speed chess,
pieces flying off the board,
you know, the whole game
in one minute.
Demis sat down opposite me.
And I looked at him
and I thought,
"I remember you
from when we were kids."
I had actually been
in the same chess tournament
as Dave in Ipswich,
where I used to go and try
and raid his local chess club
to win a bit of prize money.
We were studying
computer science.
Some people,
who at the age of 17
would have come in and made
sure to tell everybody
everything about themselves.
"Hey, I worked at Bullfrog
"and built the world's
most successful video game."
But he wasn't like that
at all.
At Cambridge,
Demis and myself
both had an interest
in computational neuroscience
and trying to understand
how computers and brains
intertwined
and linked together.
Both David and Demis
came to me for supervisions.
It happens just by coincidence
that the year 1997,
their third and final year
at Cambridge,
was also the year when
the first chess grandmaster
was beaten by
a computer program.
Round one today
of a chess match
between the ranking
world champion Garry Kasparov
and an opponent named
Deep Blue
to test to see if the human
brain can outwit a machine.
I remember the drama
of Kasparov
losing the last match.
Whoa!
Kasparov has resigned!
When Deep Blue
beat Garry Kasparov,
that was a real
watershed event.
My main memory of it was
I wasn't that impressed
with Deep Blue.
I was more impressed
with Kasparov's mind.
That he could play chess
to this level,
where he could compete
on an equal footing
with the brute of a machine,
but of course, Kasparov can do
everything else humans can do,
too.
It was a huge achievement.
But the truth
of the matter was,
Deep Blue
could only play chess.
What we would regard
as intelligence
was missing from that system.
This idea of generality
and also learning.
Cambridge was amazing,
because of course, you know,
you're mixing with people
who are studying
many different subjects.
There were scientists,
philosophers, artists...
...geologists,
biologists, ecologists.
You know, everybody is talking
about everything all the time.
I was obsessed with
the protein folding problem.
Tim Stevens used
to talk obsessively,
almost like religiously
about this problem,
protein folding problem.
Proteins are, you know,
one of the most beautiful and
elegant things about biology.
They are the machines of life.
They build everything,
they control everything,
they're why biology works.
Proteins are made from strings
of amino acids
that fold up to create
a protein structure.
If we can predict
the structure of proteins
from just their amino acid
sequences,
then a new protein
to cure cancer
or break down plastic
to help the environment
is definitely something
that you could begin
to think about.
I kind of thought,
"Well, is a human being
clever enough
"to actually fold a protein?"
We can't work it out.
Since the 1960s,
we thought that in principle,
if I know what the amino acid
sequence of a protein is,
I should be able to compute
what the structure's like.
So, if you could
just press a button,
and they'd all come
popping out, that would be...
that would have some impact.
It stuck in my mind.
"Oh, this is
a very interesting problem."
And it felt to me
like it would be solvable.
But I thought
it would need AI to do it.
If we could just solve
protein folding,
it could change the world.
Ever since
I was a student at Cambridge,
I've never
stopped thinking about
the protein folding problem.
If you were
to solve protein folding,
then the potential
to help solve problems like
Alzheimer's, dementia
and drug discovery is huge.
Solving disease is probably
the most major impact
we could have.
Thousands of very smart people
have tried
to solve protein folding.
I just think now
is the right time
for AI to crack it.
We needed
a reasonable way
to apply machine learning
to the protein folding
problem.
We came across
this Foldit game.
The goal is to move around
this 3D model of a protein
and you get a score
every time you move it.
The more accurate
you make these structures,
the more useful
they will be to biologists.
I spent a few days
just kind of seeing
how well we could do.
We did reasonably well.
But even if you were
the world's
best Foldit player,
you wouldn't
solve protein folding.
That's why we had
to move beyond the game.
Games
are always just
the proving ground
for our algorithms.
The ultimate goal was not just
to crack Go and StarCraft.
It was to crack
real-world challenges.
I remember
hearing this rumor
that Demis was
getting into proteins.
I talked to some people
at DeepMind and I would ask,
"So are you doing
protein folding?"
And they would
artfully change the subject.
And when that happened twice,
I pretty much figured it out.
So I thought
I should submit a resume.
All right, everyone,
welcome to DeepMind.
I know some of you,
this may be your first week,
but I hope you all set...
The really appealing
part for me about the job
was this, like,
sense of connection
to the larger purpose.
If we can crack
some fundamental problems
in science,
many other people
and other companies
and labs and so on
could build
on top of our work.
This is your chance now
to add your chapter
to this story.
When I arrived,
I was definitely
quite a bit nervous.
I'm still trying to keep...
I haven't taken
any biology courses.
We haven't spent
years of our lives
looking at these structures
and understanding them.
We are just going off the data
and our machine learning
models.
In machine learning,
you train a network
like flashcards.
Here's the question.
Here's the answer.
Here's the question.
Here's the answer.
But in protein folding,
we're not doing the kind
of standard task at DeepMind
where you have unlimited data.
Your job is to get better
at chess or Go
and you can play
as many games of chess or Go
as your computers will allow.
With proteins,
we're sitting on
a very thick size of data
that's been determined
by a half century
of time-consuming experimental
methods in laboratories.
These painstaking methods
can take months or years
to determine
a single protein structure,
and sometimes, a structure
can never be determined.
That's why we're working
with such small datasets
to train our algorithms.
When DeepMind
started to explore
the folding problem,
they were talking to us about
which datasets they were using
and what would be
the possibilities
if they did
solve this problem.
Many people have tried,
and yet no one on the planet
has solved protein folding.
I did think to myself,
"Well, you know, good luck."
If we can solve
the protein folding problem,
it would have an incredible
kind of medical relevance.
This is the cycle of science.
You do a huge amount
of exploration,
and then you go
into exploitation mode,
and you focus and you see
how good
are those ideas, really?
And there's nothing better
than external competition
for that.
So we decided
to enter CASP competition.
CASP, we started
to try and speed up
the solution to
the protein folding problem.
CASP is when we say,
"Look, DeepMind
is doing protein folding,
"this is how good we are,
"and maybe it's better
than everybody else.
"Maybe it isn't."
CASP is a bit like
the Olympic Games
of protein folding.
CASP is
a community-wide assessment
that's held every two years.
Teams are given
the amino acid sequences
of about 100 proteins,
and then they try
to solve this folding problem
using computational methods.
These proteins have
already been determined
by experiments
in a laboratory,
but have not yet
been revealed publicly.
And these known structures
represent the gold standard
against which
all the computational
predictions will be compared.
We've got a score
that measures the accuracy
of the predictions.
And you would expect
a score of over 90
to be a solution to
the protein folding problem.
Welcome, everyone,
to our first, uh, semifinals
in the winners' bracket.
Nick and John
versus Demis and Frank.
Please join us, come around.
This will be an intense match.
When I learned that Demis was
going to tackle
the protein folding issue,
um, I wasn't at all surprised.
It's very typical of Demis.
You know,
he loves competition.
And that's the end
of the first game, 10-7.
The aim for CASP would be
to not just
win the competition,
but sort of, um,
retire the need for it.
So, 20 targets total
have been released by CASP.
We were thinking maybe
throw in the standard
kind of machine learning
and see how far
that could take us.
Instead of having a couple
of days on an experiment,
we can turn around
five experiments a day.
Great. Well done, everyone.
Can you show me the real one
instead of ours?
The true answer is
supposed to look
something like that.
It's a lot more
cylindrical than I thought.
The results
were not very good.
Okay.
We throw
all the obvious ideas to it
and the problem laughs at you.
This makes no sense.
We thought
we could just throw
some of our best algorithms
at the problem.
We were slightly naive.
We should be learning this,
you know,
in the blink of an eye.
The thing
I'm worried about is,
we take the field from
really bad answers
to moderately bad answers.
I feel like we need
some sort of new technology
for moving around
these things.
With only
a week left of CASP,
it's now a sprint
to get it deployed.
You've done your best.
Then there's
nothing more you can do
but wait for CASP
to deliver the results.
This famous thing of Einstein,
the last couple of years
of his life,
when he was here,
he overlapped with Kurt Godel
and he said one of the reasons
he still comes in to work
is so that
he gets to walk home
and discuss things with Godel.
It's a pretty big compliment
for Kurt Godel,
shows you how amazing he was.
The Institute
for Advanced Study
was formed in 1933.
In the early years,
the intense scientific
atmosphere attracted
some of the most brilliant
mathematicians and physicists
ever concentrated
in a single place and time.
The founding
principle of this place,
it's the idea of unfettered
intellectual pursuits,
even if you don't know
what you're exploring.
Will result
in some cool things,
and sometimes that then
ends up being useful,
which, of course,
is partially what I've been
trying to do at DeepMind.
How many big breakthroughs
do you think are required
to get all the way to AGI?
And, you know,
I estimate maybe
there's about
a dozen of those.
You know, I hope
it's within my lifetime.
- Yes, okay.
-But then,
all scientists
hope that, right?
Demis has
many accolades.
He was elected Fellow to
the Royal Society last year.
He is also a Fellow
of Royal Society of Arts.
A big hand for Demis Hassabis.
My dream
has always been to try
and make
AI-assisted science possible.
And what I think is
our most exciting project,
last year,
which is our work
in protein folding.
Uh, and we call this system
AlphaFold.
We entered it into CASP
and our system, uh,
was the most accurate,
uh, predicting structures
for 25 out of the 43 proteins
in the hardest category.
So we're state of the art,
but we still...
I have to make... Be clear,
we're still a long way from
solving the protein
folding problem.
We're working hard
on this, though,
and we're exploring
many other techniques.
Let's get started.
So kind of
a rapid debrief,
these are
our final rankings for CASP.
We beat the second team
in this competition
by nearly 50%,
but we've still got
a long way to go
before we've solved
the protein folding problem
in a sense that
a biologist could use it.
It is area of concern.
The quality
of predictions varied
and they were no more useful
than the previous methods.
AlphaFold didn't
produce good enough data
for it to be useful
in a practical way
to, say, somebody like me
investigating
my own biological problems.
That was kind of
a humbling moment
'cause we thought we'd worked
very hard and succeeded.
And what we'd found is
we were the best in the world
at a problem
the world's not good at.
We knew we sucked.
It doesn't help
if you have the tallest ladder
when you're going to the moon.
The opinion of quite
a few people on the team,
that this is sort of
a fool's errand in some ways.
And I might have been wrong
with protein folding.
Maybe it's too hard still
for where we're at
generally with AI.
If you want to do
biological research,
you have to be
prepared to fail
because biology
is very complicated.
I've run a laboratory
for nearly 50 years,
and half my time,
I'm just
an amateur psychiatrist
to keep, um, my colleagues
cheerful when nothing works.
And quite a lot of the time
and I mean, 80, 90%,
it does not work.
If you are
at the forefront of science,
I can tell you,
you will fail a great deal.
I just felt disappointed.
Lesson I learned is that
ambition is a good thing,
but you need
to get the timing right.
There's no point being
50 years ahead of your time.
You will never survive
fifty years of
that kind of endeavor
before it yields something.
You'll literally die trying.
When we talk about AGI,
the holy grail
of artificial intelligence,
it becomes really difficult
to know what
we're even talking about.
Which bits
are we gonna see today?
We're going
to start in the garden.
This is the garden looking
from the observation area.
Research scientists
and engineers
can analyze and collaborate
and evaluate
what's going on in real time.
So in the 1800s,
we'd think of things like
television and the submarine
or a rocket ship to the moon
and say these things
are impossible.
Yet Jules Verne
wrote about them and,
a century and a half later,
they happened.
We'll be
experimenting
on civilizations really,
civilizations of AI agents.
Once the experiments
start going,
it's going to be
the most exciting thing ever.
So how will we get sleep?
I won't be able to sleep.
Full AGI
will be able to do
any cognitive task
a person can do.
It will be at a scale,
potentially, far beyond that.
It's really impossible for us
to imagine the outputs
of a superintelligent entity.
It's like asking a gorilla
to imagine, you know,
what Einstein does
when he produces
the theory of relativity.
People often ask me
these questions like,
"What happens if you're wrong,
and AGI is quite far away?"
And I'm like,
I never worry about that.
I actually
worry about the reverse.
I actually worry
that it's coming faster
than we can
really prepare for.
It really feels
like we're in a race to AGI.
The prototypes and the models
that we are developing now
are actually transforming
the space of what
we know about intelligence.
Recently,
we've had agents
that are powerful enough
to actually start
playing games in teams,
then competing
against other teams.
We're seeing
co-operative social dynamics
coming out of agents
where we haven't
pre-programmed in
any of these sorts
of dynamics.
It's completely learned
from their own experiences.
When we started,
we thought we were
out to build
an intelligence system
and convince the world
that we'd done it.
We're now starting
to wonder whether
we're gonna build systems
that we're not convinced
are fully intelligent,
and we're trying to convince
the world that they're not.
Hi, Alpha.
Hello there.
Where are we today?
You're at the Museum of
Modern Art in New York City.
Kind of.
Um, what painting is this?
This isThe Creation of Adam
by Michelangelo.
I don't think that painting
is in New York City.
You are right.
It's in the Vatican City.
Do you think
that's where we are?
No.
Then how
am I looking at this?
You're looking at
a digital copy
of the painting.
Yes.
Who lives
in this house?
An astronaut.
What's this astronaut's name?
His name is Mark.
This is a famous equation
by Albert Einstein.
It shows that energy and mass
are equivalent.
How would you explain it
to a five year old?
Well, imagine
you have a big rock,
and you want to know
how much it weighs.
Is Mark in danger?
No.
Mark is not in danger.
Why is that?
Because the dinosaur
is not real.
All right.
Why could you
not answer my question?
I think I couldn't
answer your question
because I don't know
enough about the subject.
Okay.
How could you learn
more about the subject?
I can learn more
about the subject
by reading books,
articles, and websites.
You can teach me.
My conclusion is,
if you now think about
what we're doing,
is learning from all humans,
all their knowledge at once
put on the Internet,
you would actually
know a lot about the world.
Like a significant portion
of everything humans can do.
And now,
I think it's more like,
"Well, it might just work."
This is a big moment.
Who is this?
This is God
reaching out to Adam.
The advent of AGI
will divide human history
into two parts.
The part up to that point
and the part after that point.
Why is he reaching out
to touch Adam?
God is
reaching out to touch Adam
to give him life.
It will give us a tool
that can completely reinvent
our entire civilization.
What does
this painting mean to you?
The painting
means a lot to me.
Okay. Like what?
I think
the painting is a reminder
that we are all
connected to each other
and that we are
all part of something
bigger than ourselves.
That's pretty nice.
When you cross
that barrier of
"AGI might happen
one day in the future"
to "No, actually, this could
really happen in a time frame
"that is sort of, like,
on my watch, you know,"
something changes
in your thinking.
...learned to orient
itself by looking...
We have to be
careful with how we use it
and thoughtful about
how we deploy it.
You'd have to consider
what's its top level goal.
If it's to keep humans happy,
which set of humans?
What does happiness mean?
A lot of our collective goals
are very tricky,
even for humans to figure out.
Technology always
embeds our values.
It's not just technical,
it's ethical as well.
So we've got
to be really cautious
about what
we're building into it.
We're trying to find
a single algorithm which...
The reality is
that this is an algorithm
that has been created
by people, by us.
You know, what does it mean
to endow our agents
with the same kind of values
that we hold dear?
What is the purpose
of making these AI systems
appear so humanlike
so that they do
capture hearts and minds
because they're kind of
exploiting a human
vulnerability also?
The heart and mind
of these systems
are very much
human-generated data...
Mmm-hmm.
...for all the good
and the bad.
There is a parallel
between
the Industrial Revolution,
which was an incredible
moment of displacement
and the current technological
change created by AI.
Pause AI!
We have to think
about who's displaced
and how we're going
to support them.
This technology
is coming a lot sooner,
uh, than really
the world knows or kind of
even we 18, 24 months
ago thought.
So there's
a tremendous opportunity,
tremendous excitement,
but also
tremendous responsibility.
It's happening so fast.
How will we govern it?
How will we decide
what is okay
and what is not okay?
AI-generated images are
getting more sophisticated.
The use of AI
for generating disinformation
and manipulating
human psychology
is only going to get
much, much worse.
AGI is coming,
whether we do it here
at DeepMind or not.
It's gonna happen,
so we better create
institutions to protect us.
It's gonna require
global coordination.
And I worry that humanity is
increasingly getting worse
at that rather than better.
We need
a lot more people
really taking this seriously
and thinking about this.
It's, yeah, it's serious.
It worries me.
It worries me. Yeah.
If you received
an email saying
this superior
alien civilization
is going to arrive on Earth,
there would be
emergency meetings
of all the governments.
We would go into overdrive
trying to figure out
how to prepare.
The arrival of AGI will be
the most important moment
that we have ever faced.
My dream
was that on the way to AGI,
we would create
revolutionary technologies
that would be
of use to humanity.
That's what I wanted
with AlphaFold.
I think
it's more important than ever
that we should solve
the protein folding problem.
This is gonna be really hard,
but I won't give up
until it's done.
You know,
we need to double down
and go as fast as possible
from here.
I think we've got
no time to lose.
So we are going to make
a protein folding strike team.
Team lead for the strike team
will be John.
Yeah, we've seen Alpha...
You know,
we're gonna try everything,
kitchen sink, the whole lot.
CASP14 is about
proving we can
solve the whole problem.
And I felt that to do that,
we would need to incorporate
some domain knowledge.
We had some
fantastic engineers on it,
but they were
not trained in biology.
As a computational biologist,
when I initially joined
the AlphaFold team,
I didn't immediately feel
confident about anything.
You know,
whether we were
gonna be successful.
Biology is so
ridiculously complicated.
It just felt like this very
far-off mountain to climb.
I'm starting to play with
the underlying temperatures
to see if we can get...
As one of the few people
on the team
who's done work
in biology before,
you feel this huge sense
of responsibility.
"We're expecting you to do
"great things
on this strike team."
That's terrifying.
But one of the reasons
why I wanted to come here
was to do
something that matters.
This is the number
of missing things.
What about making use
of whatever understanding
you have of physics?
Using that
as a source of data?
But if it's systematic...
Then, that can't be
right, though.
If it's systematically wrong
in some weird way,
you might be learning that
systematically wrong physics.
The team is already
trying to think
of multiple ways that...
Biological relevance
is what we're going for.
So we rewrote
the whole data pipeline
that AlphaFold uses to learn.
You can't
force the creative phase.
You have to give it space
for those flowers to bloom.
We won CASP.
Then it was
back to the drawing board
and like,
what are our new ideas?
Um, and then it's taken
a little while, I would say,
for them to get back
to where they were,
but with the new ideas.
And then now I think
we're seeing the benefits
of the new ideas.
They can go further, right?
So, um, that's a really
important moment.
I've seen that moment
so many times now,
but I know
what that means now.
And I know
this is the time now to press.
Adding side-chains
improves direct folding.
That drove
a lot of the progress.
- We'll talk about that.
- Great.
The last four months,
we've made enormous gains.
During CASP13,
it would take us a day or two
to fold one of the proteins,
and now we're folding, like,
hundreds of thousands
a second.
Yeah, it's just insane.
Now,
this is a model
that is
orders of magnitude faster,
while at the same time
being better.
We're getting
a lot of structures
into the high-accuracy regime.
We're rapidly improving
to a system
that is starting to really
get at the core and heart
of the problem.
It's great work.
It looks like
we're in good shape.
So we got, what, six,
five weeks left? Six weeks?
So what's, uh... Is it...
You got enough compute power?
I... We could use more.
I was nervous about CASP
but as the system
is starting to come together,
I don't feel as nervous.
I feel like things
have, sort of,
come into perspective
recently,
and, you know,
it's gonna be fine.
The Prime Minister
has announced
the most drastic limits
to our lives
the U.K. has ever seen
in living memory.
I must give the British people
a very simple instruction.
You must stay at home.
It feels like we're
in a science fiction novel.
You know, I'm delivering food
to my parents,
making sure
they stay isolated and safe.
I think it just highlights
the incredible need
for AI-assisted science.
You always know that
something like this
is a possibility.
But nobody ever really
believes it's gonna happen
in their lifetime, though.
-Are you recording yet?
-Yes.
- Okay, morning, all.
- Hey.
Good. CASP has started.
It's nice I get to sit around
in my pajama bottoms all day.
I never
thought I'd live in a house
where so much was going on.
I would be trying to solve
protein folding in one room,
and my husband would be trying
to make robots walk
in the other.
One of the hardest proteins
we've gotten in CASP thus far
is the SARS-CoV-2 protein
called ORF8.
ORF8 is
a coronavirus protein.
It's one of the main proteins,
um,
that dampens
the immune system.
We tried really hard
to improve our prediction.
Like, really, really hard.
Probably the most time
that we have ever spent
on a single target.
To the point where
my husband is, like,
"It's midnight.
You need to go to bed."
So I think we're at
Day 102 since lockdown.
My daughter
is keeping a journal.
Now you can go out
as much as you want.
We have received
the last target.
They've said they will be
sending out no more targets
in our category of CASP.
So we're just making sure
we get
the best possible answer.
As soon as we started
to get the results,
I'd sit down and start looking
at how close did anybody come
to getting the protein
structures correct.
- Oh, hi there.
-Hello.
It is an unbelievable thing,
CASP has finally ended.
I think it's at least time
to raise a glass.
Um, I don't know
if everyone has a glass
of something
that they can raise.
If not, raise,
I don't know, your laptops.
Um...
I'll probably make a speech
in a minute.
I feel like I should but I
just have no idea what to say.
So... let's see.
I feel like
a reading of email...
is the right thing to do.
When John said,
"I'm gonna read an email,"
at a team social,
I thought, "Wow, John,
you know how to have fun."
We're gonna read an email now.
Uh, I got this
about four o'clock today.
Um, it is from John Moult.
And I'll just read it.
It says,
"As I expect you know,
"your group has performed
amazingly well in CASP 14,
"both relative to other groups
"and in absolute
model accuracy."
"Congratulations on this work.
"It is really outstanding."
The structures were so good,
it was... it was just amazing.
After half a century,
we finally have a solution
to the protein folding
problem.
When I saw this email,
I read it,
I go, "Oh, shit!"
And my wife goes,
"Is everything okay?"
I call my parents, and just,
like, "Hey, Mum.
"Um, got something
to tell you.
"We've done this thing
"and it might be kind of
a big deal."
When I learned of
the CASP 14 results,
I was gobsmacked.
I was just excited.
This is a problem
that I was beginning to think
would not get solved
in my lifetime.
Now we have a tool
that can be used
practically by scientists.
These people
are asking us, you know,
"I've got this protein
involved in malaria,"
or, you know,
some infectious disease.
"We don't know the structure.
"Can we use AlphaFold
to solve it?"
We can easily predict
all known sequences
in a month.
All known sequences
in a month?
- Yeah, easily.
- Mmm-hmm?
A billion, two billion.
Um, and they're...
So why don't we just do that?
Yeah.
- We should just do that a lot.
- Well, I mean...
That's way better.
Why don't we just do that?
So that's
one of the options.
-Right.
- There's this...
We should just...
Right, that's a great idea.
We should just run
every protein in existence.
And then release that.
Why didn't someone
suggest this before?
Of course that's
what we should do.
Why are we thinking about
making a service
and then people submit
their protein?
We just fold everything.
And then give it to
everyone in the world.
Who knows how many discoveries
will be made from that?
Demis called us up
and said,
"We want to make this open.
"Not just make sure
the code is open,
"but we're gonna make it
really easy
"for everybody to get access
to the predictions."
That is fantastic.
It's like drawing back
the curtain
and seeing the whole world
of protein structures.
They released the structures
of 200 million proteins.
These are gifts to humanity.
The moment AlphaFold
is live to the world,
we will no longer be
the most important people
in AlphaFold's story.
Can't quite believe
it's all out.
Aw!
A hundred
and sixty-four users.
Loads of activity in Japan.
We have 655 users currently.
We currently
have 100,000 concurrent users.
Wow!
Today is just crazy.
What an absolutely
unbelievable effort
from everyone.
We're gonna all remember
these moments
for the rest of our lives.
I'm excited about AlphaFold.
For my research, it's already
propelling lots of progress.
And this is
just the beginning.
My guess is,
every single biological
and chemistry achievement
will be related to AlphaFold
in some way.
AlphaFold is an index moment.
It's a moment
that people will not forget
because the world changed.
Everybody's realized now
what Shane and I have known
for more than 20 years,
that AI is going to be
the most important thing
humanity's ever gonna invent.
We will shortly be arriving
at our final destination.
The pace of
innovation and capabilities
is accelerating,
like a boulder rolling down
a hill that we've kicked off
and now it's continuing
to gather speed.
We are at
a crossroads in human history.
AI has the potential
to transform our lives
in every aspect.
It's no less important than
the discovery of electricity.
We should be looking
at the scientific method
and trying to understand
each step of the way
in a rigorous way.
This is a moment
of profound opportunity.
Harnessing this technology
could eclipse anything
we have ever known.
Hi, Alpha.
Hi.
What is this?
This is a chessboard.
If I was to play white, what
move would you recommend?
I would recommend
that you move your pawn
from E2 to E4.
And now if you were black,
what would you play now?
I would play
the Sicilian Defense.
That's a good choice.
Thanks.
So what do you see?
What is this object?
This is a pencil sculpture.
What happens if I move
one of the pencils?
If you move
one of the pencils,
the sculpture will fall apart.
I'd better leave it alone,
then.
That's probably
a good idea.
AGI is on the horizon now.
Very clearly
the next generation
is going to live
in a future world
where things will be radically
different because of AI.
And if you want to steward
that responsibly,
every moment is vital.
This is the moment I've been
living my whole life for.
It's just
a good thinking game.