Video summary
Yann LeCun addresses the monumental challenge of building a system with human-level intelligence, using the metaphor of climbing mountains to illustrate that while we can see the first obstacle clearly, there may be many more hidden ahead. He references historical examples like Newell and Simon's General Problem Solver from 1956 as early attempts that failed because researchers only focused on immediate peaks without understanding the broader landscape required for true generalization. LeCun argues that current AI systems are still far out of reach compared to human capabilities, emphasizing that achieving this goal requires overcoming fundamental hurdles in how machines perceive and interact with reality rather than just scaling up existing data-driven models. The first critical peak involves developing self-supervised learning where machines learn high-fidelity models of the world through observation alone, mimicking the developmental process of babies and young animals. LeCun cites research by Amanda Demis from Fair and a French university detailing how infants rapidly acquire complex concepts within their first few months; for instance, distinguishing animate objects becomes possible around two to three months, while understanding gravity—realizing that unsupported objects fall rather than float—is mastered by eight or nine months through active experimentation. This biological insight suggests that intelligent autonomous systems must similarly construct predictive models of the world where they can anticipate states at time T plus one based on actions taken at time T, a capability currently lacking in standard AI architectures due to difficulties representing high-dimensional continuous distributions with certainty. Beyond modeling reality, an intelligent system requires two additional components: a hard-wired objective function rooted in basal ganglia-like mechanisms that compute levels of contentment or unhappiness, and the ability to optimize actions toward specific goals such as minimizing energy consumption while maximizing satisfaction. In humans, this internal drive prevents dangerous behaviors like touching fire because the brain's predictive model anticipates pain before action occurs; similarly, AI systems need an objective predictor that estimates future reward signals alongside a policy network capable of determining the best course of action to optimize given constraints and models. These three modules—the world model, the contentment calculator, and the optimization engine—form the essential architecture for autonomous intelligence without which agents remain limited in their adaptability and decision-making capabilities. LeCun concludes by outlining how failure can manifest in three distinct ways that correspond directly to flaws in these core components: an incorrect model of the world leads to poor predictions regardless of intent, a misaligned objective function results in behavior that contradicts human values or safety requirements akin to psychopathy, and an inefficient policy network prevents the system from finding optimal solutions even when models and goals are correct. This framework provides a structured approach for researchers to identify specific bottlenecks in current AI development rather than treating intelligence as a monolithic problem solvable by sheer computational power alone. By focusing on these foundational elements inspired by developmental psychology and neuroscience, LeCun suggests that the path forward requires rethinking how machines learn from observation and interact with their environment to achieve genuine autonomy comparable to human cognition.
Read the full video transcript
what do you think it takes to build a
system with human level intelligence you
talked about the AI system in the movie
her being way out of reach our current
reach this might be outdated as well but
this is still way out of reach what
would it take to build her do you think
so I can tell you the first two
obstacles that we have to clear but I
don't know how many obstacles they are
after this so the image I usually use is
that there is a bunch of mountains that
we have to climb and we can see the
first one but we don't know if there are
50 mountains behind it or not and this
might be a good sort of metaphor for why
AI research was in the past I've been
overly optimistic about the result of
way I you know for example a New Orleans
Simon Wright wrote the general problem
solver and they call it the general
problems you have problems okay and of
course the 15 you realize is that all
the problems you want to solve is
financial and so you can actually use it
for anything useful but you know yes oh
yeah all you see is the first peak so in
general what are the first couple of
peaks for her so the first peak which is
precisely what I'm working on is self
supervisor running high how do we get
machines to run models of the world by
observation kind of like babies and like
young animals
so I we've been working with you know
coming to scientists so this Amanda
depuis who is a at fair and in Paris is
half-time is also a researcher and
French University and he he has his
chart that shows that which how many
months of life baby humans kind of
learned different concepts and you can
met you can measure this various ways so
things like distinguishing animate
objects from animate inanimate object
you can you can tell the difference at
age two three months whether an object
is going to stay stable is gonna fall
you know about four months you can tell
you know things like this and then
things like gravity the fact that
objects are not supposed to float in the
air but as opposed to fall you run this
around the age of eight or nine months
if you look at a lot of you know eight
month old babies you give them a bunch
of toys on the highchair first thing
they do is it's why I'm on the ground
let you look at them it's because you
know they're learning about actively
learning about gravity gravity yeah okay
so they're not trying to know you but
they you know they need to do the
experiment right yeah so you know how do
we get machines to learn like babies
mostly by observation with a little bit
of interaction and learning those those
those models of the world because I
think that's really a crucial piece of
an intelligent autonomous system so if
you think about the architecture of an
intelligent autonomous system it needs
to have a predictive model of the world
so something that says here is a wall
that time T here is a stable world at
time T plus one if I take this action
and it's not a single answer it can be
education yeah yeah well but we don't
know how to represent distributions in
high dimension continuous basis so it's
got to be something we care that data
hey yeah but with some summer
presentation with certainty if you have
that then you can do what optimal
control theory is called model
predictive control which means that you
can run your model with the hypothesis
for a sequence of action and then see
the result now what you need the other
thing you need is some sort of objective
that you want to optimize am i reaching
the goal of grabbing the subject about
minimizing energy am I
whatever right so there is some sort of
objectives that you have to minimize and
so in your head if you had this model
you can figure out the sequence of
action that will optimize your objective
that objective is something that
ultimately is rooted in your basal
ganglia at least in the human brain
that's that's what is available Gambia
computes your level of contentment or
miss contentment oh no noise that's a
word unhappiness okay yeah this
contentment this contentment and so your
entire behavior is driven towards kind
of minimizing that objective which is
maximizing your contentment computed by
your your basal ganglia and what you
have is an objective function which is
basically a predictor of what your basal
ganglia is going to tell you so you're
not going to put your hand on fire
because you know it's gonna you know
it's gonna burn and you're gonna get
hurt and you're predicting this because
of your model of the world and your your
predictor of this objective right so you
if you have those you have those three
components you have four components you
have the the hard-wired contentment
objective computer if you want
calculator and then you have the three
components one is the objective
predictor which basically predicts your
level of contact and one is the model of
the world and there's a third module I
didn't mention which is a module that
will figure out the best course of
action to optimize an objective given
your model okay yeah cool it's a policy
policy network or something like that
right now you need those three
components to act autonomously
intelligently and you can be stupid in
three different ways you can be stupid
because your model of the world is wrong
you can be stupid because your objective
is not aligned with what you actually
want to achieve okay and in humans that
would be a psychopath right and then the
the third thing you the third way you
can be stupid is that you have the right
model you have the right objective but
you're unable to figure out a course of
action to optimize your objective given
your model
you