Scientist Exposes Why Your Reality is All a Lie | Donald Hoffman on Conversations with Tom
Watch on YouTubeVideo summary
In this second round of his interview on *Conversations with Tom*, cognitive scientist Donald Hoffman argues that our perception of reality is a deceptive interface, similar to playing a video game like *Grand Theft Auto* where steering wheels and cars are merely visual representations rather than fundamental causes. He posits that space-time, physical objects, and even the laws of physics we observe—such as those in Einstein's relativity or quantum field theory—are not primary reality but emergent projections from a deeper layer. Hoffman asserts that our best scientific theories actually tell us where they stop: at the Planck scale (10 to the minus 33 cm), space-time ceases to make sense, and reductionism fails because it cannot probe beyond this limit without creating black holes. Consequently, he claims that consciousness is fundamental, not an emergent property of brain activity or physical matter, and that what we call "reality" is actually a visualization tool evolved by natural selection solely for survival, not truth. To explain how this deeper reality functions, Hoffman describes it as a vast social network of interacting conscious agents rather than particles in space-time. He uses the analogy of Twitter to illustrate his point: just as one cannot understand billions of tweets and users by looking at simple graphics like colored dots on a screen, we cannot grasp fundamental reality through physical objects; instead, those objects are merely simplified icons allowing us to navigate our survival interface. This framework challenges standard reductionist theories in neuroscience that attempt to explain consciousness via integrated information theory or quantum states in microtubules, arguing that these approaches remain trapped within the flawed space-time paradigm. He notes that even advanced physicists like Nima Arkani-Hamed are finding structures beyond space-time where concepts like Hilbert spaces and unitarity do not apply, suggesting we must look for a new mathematical language to describe consciousness outside of our current headset. Hoffman addresses common objections regarding AI and the nature of reality by distinguishing between building machines within the interface versus creating true conscious agents in the deeper realm. He clarifies that while an AI could theoretically become conscious if it accesses this fundamental layer, standard approaches assuming silicon or carbon-based complexity will never achieve consciousness because they operate entirely within space-time constraints. Furthermore, he discusses how deep learning research at DeepMind has independently stumbled upon similar conclusions: neural networks do not discover truth but construct virtual realities optimized for rewards, mirroring evolution's strategy of creating a user interface that satisfies survival needs rather than revealing the underlying code. He emphasizes that Gödel’s incompleteness theorem suggests there will never be a single "Theory of Everything," as any theory is limited by its assumptions and finite implications; instead, science should focus on developing metatheories about how these conscious agents project into space-time to make testable predictions for phenomena like particle scattering amplitudes. To bridge the gap between his radical theories and empirical testing, Hoffman outlines a rigorous scientific loop that involves creating precise mathematical models of consciousness outside space-time and projecting them back into our interface to generate falsifiable predictions. He admits this is an immense challenge requiring him to let go of dogmatic thinking about physicalism, which he describes as clinging to the "security blankets" of known concepts. His methodology combines intense meditation—spending three hours a day in absolute silence to dismantle his ego and existing mental models—with deep study of advanced physics mathematics, including transcribing lectures by Nima Arkani-Hamed on scattering amplitudes. He likens this process to a caterpillar's metamorphosis inside a chrysalis: it is an internal war where the old self must be completely overwhelmed before new forms can emerge, requiring both absolute precision in mathematical modeling and total surrender of conceptual control during meditation. Ultimately, Hoffman concludes that humanity has become wizards of its own virtual reality headset but remains ignorant of the fundamental dynamics driving existence outside of space-time. He encourages scientists to stop trying to reduce consciousness to matter and instead explore how networks of conscious agents interact to create new forms of experience, a process he views as endless exploration rather than arriving at a final destination. By embracing this perspective, we can better understand why our brains perceive the world in terms of cause-and-effect physical objects when those are merely useful fictions for survival. He invites listeners to explore his book *The Case Against Reality* and engage with his work on Twitter or via email, urging them not to dismiss these ideas as mere speculation but to consider how they might revolutionize our understanding of the universe by stepping outside the limitations of space-time itself.
Read the full video transcript
Everybody, welcome to another episode of
Conversations with Tom. I am here for a
second round with Donald Hoffman.
Welcome back.
Thank you very much, Tom. It's great to
be here. Dude, I am so excited to spend
more time with you. I was listening to
the first interview that we did, which
by the way, everybody, you're going to
want to watch that one
to really understand everything that
Donald's about. We'll give you a quick
primer here, but we're going to cover
new ground in this. But the reason that
I'm so excited was, honestly, man,
trying to wrap my head around your take
on consciousness and the way that
basically we're living in a constructed
reality that we're essentially in the
Matrix whether we want to be or not. Um
and the I get that and I was into it and
I love it. But some of the implications
of that have only hit me now that I've
had time to like, you know, take a step
back, really think about it, interact
with other people dealing with what they
call the hard problem of consciousness.
Mhm.
Um so, for us to be able to dive into
that though, give people the like
3-minute primer on
why your take is so different than
everybody else who takes a really sort
of physicality-based approach to
consciousness.
Right. So, most people who are looking
at how consciousness is related to the
physical world, like our brain,
are assuming that somehow the physical
world is primary. It's the source of all
cause and effect in reality.
And therefore, consciousness is an
effect of physical causes, presumably
neuroactivity in the brain, for example.
But maybe also computer activity in a
artificial intelligence that's
sufficiently complicated.
And my my take is that our best science
today,
quantum field theory,
Einstein's theory of gravity, and
evolution by natural selection, all
three of our best
scientific theories today are telling us
that space-time is not fundamental.
And that physical objects in space-time
are not fundamental reality. And science
is good enough our best scientific
theories are good enough to tell us
where they stop.
But they're not good enough, of course,
to tell us what's beyond. That's up to
us as creative scientists to try to
guess
what is a deeper theory of reality that
goes beyond space and time. But
when we project it back into space and
time, that deeper reality needs to look
like gravity and quantum field theory
and evolution by natural selection. And
so
basically what I'm saying is that my my
brilliant colleagues
and these are my friends, they're
they're brilliant, I'm not not putting
them down anyway, but when they assume
that physical objects like neurons or
computing systems cause consciousness, I
think that they're running against what
our best scientific theories are telling
us. They're telling us space-time is
doomed. We need a deeper
notion of reality and and
for most science it's no problem to work
in space-time, but when we're dealing
with consciousness
the fiction that physical objects have
genuine causal powers
which is a useful fiction most of the
time. For everyday neuroscience it's a
very useful fiction. I use it myself.
But for consciousness, that's when the
fiction comes back to bite you. And just
just a quick idea. If you're playing a
virtual reality game
like Grand Theft Auto, but in a VR
souped-up multiplayer version, it's a
perfectly useful fiction to think that
the steering wheel causes the car to
move around to the left or to the right
and so forth. It's perfectly harmless
fiction. But if you're a software
engineer looking to upgrade the actual
software that runs the the program that
fiction, if you were stuck in that
fiction, you would not be equipped to do
the upgrade that you needed. In other
words, if you're trying to look at the
reality outside the headset,
you can't just live with the notion of
cause and effect inside the headset. You
actually have to expand your horizons to
understand a deeper notion of cause and
effect. And that's what I claim we have
to do with consciousness. It's useful
most of the time to talk about physical
objects as though they have causal
powers. Perfectly harmless. But when it
comes to consciousness, it's the single
big obstacle that's stopping progress in
its tracks. Okay. Woo, you did it
perfectly. Now, I want to like really
drill into that quickly so that people
understand where we're going to be going
from here. So, uh we spent almost 2 and
1/2 hours together last time with me
doing with with my pea brain doing my
best to grapple with these topics.
And finally, I was able to understand a
couple things that I'm going to lay out
now that open up what this interview is
going to be about and it's going to be
very interesting. We're going to cover
things like AI and whether that becomes
conscious, faster than light travel,
which I think your theory predicts. All
kinds of very interesting things. So, to
say that analogy in my own words, maybe
from a lay perspective, so people get
what you're saying about Grand Theft
Auto, cuz this is the key to
understanding the consequences of your
theory. So,
when you think about what's really going
on as a computer programmer is trying to
make this game called Grand Theft Auto,
you're dealing with algorithms and
mathematics and uh moving electrical
currents around a Xbox or whatever. And
so, ultimately, your goal is to move
electrons and things like that around
this machine that then creates this
supposed experience, right? On a TV that
I can interact with. Okay, when you
understand that the re the difference
between the reality that that programmer
has to deal with, which looks nothing
like it. It's literally numbers. It's
all code, all math. Math designed to
move electrons around, okay? That's not
exactly right, but that's close enough.
And that reality versus what you see,
which is that oh look, I'm driving with
the steering wheel.
What you're saying is what you see when
you walk around the room and interact
with stuff and you think about
space-time and Einstein relativity is as
divorced from reality as the computer
programmer is from the gamer who plays
this game.
Now, it took me a very long time to
understand that's what you're trying to
get people to to understand.
And then it was one thing that was like
a real key in the lock for me was
somebody asked you a question. It was so
great. And they said
Donald, this is wonderful. I love it.
But now predict we have the same
conversation in 10,000 years. What are
we going to know then? And you said, oh
that space-time isn't real and so we can
create space-time ourselves because
space-time is space-time is the Grand
Theft Auto game. It's not the code
underneath. So once you understand
Einstein just figured out a way to
describe Grand Theft Auto. He did not
figure out a way to describe the actual
underlying code.
And so if if the space-time is just
Grand Theft Auto and we know we can
manipulate Grand Theft Auto, we can now
manipulate space-time and you said we'll
have this conversation from Alpha
Centauri. And I was like, oh my god,
even if you just get excited about the
chills. Even if you just get excited
about our ability to manipulate what's
in the headset.
Right? Manipulating space-time,
traveling faster than light, um
changing fundamental physics, things
like that. Then even that would be
interesting. Let alone the other part
that you're saying which is oh you might
actually be able to figure out what the
underlying code is.
That's that's exactly right. And and so
one way to think about it is
science
for all of its incredible breakthroughs
and wonderful theories
has only been studying our headset.
Science has not yet been studying
objective reality outside of our
space-time
virtual reality
that from an evolutionary point of view
was just evolved as a way for us to play
the game of life and stay alive long
enough to reproduce, not to show us the
truth. So, we have really in the in the
last four or five centuries really
gotten to be wizards
of our headset, wizards of the Grand
Theft Auto game. But, just because
you're a wizard of Grand Theft Auto does
not mean that you know anything about
the circuits and software that are
running the game.
And for someone who thinks that they
know everything when all they know is
Grand Theft Auto means they they're
still stuck in the headset. Science, I
want to claim, has the tools. We have
learned the right tools as we've studied
our headset. We are ready to use those
same tools to venture outside the
headset, outside of space and time. So,
science has the right tools. We just
have to open up, you know, open our
minds
to the fact that we're just playing a
game inside space-time. It's just a
virtual reality. There's an entire world
out Now, the best physicists are already
there.
Like Nima Arkani-Hamed and many of his
collaborators who are saying space-time
is doomed. We're looking for the reality
that's beyond space-time in which, in
fact, the very language of quantum
theory and and relativity theory don't
hold. There's There are no what they
call Hilbert spaces. So, there's
no Hilbert space there in what they're
finding. There's no quantum theory. You
need Hilbert space
What is Hilbert space? I've never Never
of that. Oh, it's it's a mathematical
structure that is used to describe
quantum states and their evolution. It's
called Hilbert space. And so So, what
they're looking for
don't exist?
That's right. So, these physicists are
saying, "Look, we're finding structures
beyond space-time, and these structures
don't care about Hilbert space. And they
don't care about locality in space and
time. They don't care about so-called
unitarity, which is important for
quantum theory." These are deeper
structures. They project into space-time
and give us
unitary and locality unitarity and
locality in space-time. In other words,
they project to the right things in our
headset, but they're deeper, and they
have symmetries
that you cannot see in space-time. And
when physicists find symmetries that are
in the data, but can't be captured in
space-time, they're very, very
interested. So, so
the best and brightest physicists are
boldly stepping outside of the headset,
but the question is
where do you look?
What kinds of ideas I mean, if it's not
space and time, how do you come up with
an idea about what reality is? So, we
just have to try ideas,
make them rigorous, make them precise,
and then project them back into our
headset.
That's the key. We know how to test
things within the headset. So, we're
going to make theories of reality
outside of space and time with
mathematically precise models of how
they map into space and time.
And then we can test. So, so this is not
just waving your hands and blowing
steam, you know, it this is not that.
This is we want rigorous theories out
outside of space-time that have
mathematical projections into space-time
that lead to testable predictions.
I right now am studying
the physics of scattering amplitudes
for the like colliders.
Look, you know, they smash protons
together, and they have gluons smashing
into each other and and gluons go flying
out and you can predict the the
probability of these these particle
events.
So, my goal is to start with a theory of
consciousness outside of space-time,
mathematically precise, show exactly how
it maps into space-time, and then
hopefully predict those scattering
amplitudes to 10 decimal predictions to
you know, 10 decimal places of of of
accuracy. Then, that doesn't mean I'm
right, but at least now I'm doing the
right thing to be testable.
Okay. I want to ground everybody in why
I've gotten so um hyped on this. So, do
you read science fiction much?
A little bit. I'm mostly just
reading that right now.
Very saddened to hear that, but um so,
one of the things that I find so
enjoyable about science fiction is they
really play with big ideas and I'm
reading a book. Uh it's the second book
in the Three-Body Problem series. And in
that, they're basically alien invasion
that's happening and they're trying to
figure out like what they do.
And the way that the um aliens stopped
them from making progress, spoiler alert
for anybody who plans to read the
series, is that they um
they send these photons that can
basically interrupt the large colliders
to give them impossible to interpret
data. And so, they shoot these things um
to the colliders and they they just give
them completely nonsensical data. And
the reason they said that is they're
like, "If you can't make
the the breakthroughs at the fundamental
layers of science, you can't progress."
So, for anybody who is feeling like,
"Okay, these guys are drifting off into
the ether. Why is this interesting? How
does it relate to my life?" First of
all, I'll say that you're a cognitive
scientist. That, you know, is your
background. So, this starts with, "Hey,
I'm trying to understand consciousness
and the hard problem of consciousness
and it's leading me to this place that
challenges the very substance of
reality." And that matters because, by
the way, we might be able to manipulate
more of this stuff than we think,
but we're still in this um presentation
layer, the the headset.
Right.
So, now, as I begin to
unwind some of this stuff, it's
when we
think about the fact that, okay,
I'm guessing the scientists, the quantum
scientists, the reason that they're now
looking elsewhere is they cannot make
what they see mathematically make sense
with the models that they have
with of space-time.
And
for them to make that leap outside is
going to be brutally difficult in terms
of science doesn't progress as the truth
is revealed, science progress, I think
it was Niels Bohr, we talked about this
last time, or Planck, that said,
basically, the old people have to die
cuz they just they can't update their
model of the world, and then the next
generation grows up just believing it to
be true. So, how
are we holding out hope for people to
step outside of that, and what methods
are they using to discover this stuff?
Is it going to be in the collider cuz
that's all headset?
Right, so I can tell you what the
physicists are up to a little bit um on
this and and why I'm interested. As you
said,
I'm not interested in particle physics
for its own sake, I'm a cognitive
scientist.
I'm looking for the simplest thing
that I could possibly do to test a
theory of consciousness in which
consciousness is fundamental and
space-time is just a headset. And
I think you have to you you have to
explain that. We talked about it in the
last one, but it's it's worth it. When
you say that um consciousness is
fundamental, what do you mean?
All right, so
so by consciousness, I just mean simple
things like having a headache or
smelling garlic or uh hearing the sound
of a trumpet or having an itch,
um or or feeling a mood like uh you
know, love or hate or something like
that. So, simple um
feelings or sensory experiences that I
could imagine even a mouse might have.
Like, a mouse might smell cheese, and it
might enjoy the taste of cheese. I think
everybody can get behind that though,
but aren't you taking it way farther
down to like there is an entity, I don't
know what word to put around it. Its
entire experience is either green or
nothing.
Right. So, so
I actually then
when I try to get a model of
consciousness on its own terms as a
scientist, I have to write down a
mathematical description of what I mean
by having conscious experiences and
acting on them and and and entertain the
possibility of very simple
consciousnesses that might have, as you
say, just one or two conscious
experiences like green or nothing or
something like that. And look at at how
these kinds of consciousnesses might
interact and so forth. And and so, I've
been with my colleagues Chetan Prakash
and and Chris Fields and Manish Singh
and others working on mathematical
models um of a dynamics of
consciousness. It's much like
a vast social network like the
Twitterverse, where you have lots of
social entities that are interacting,
tweeting, and following, and so forth.
It'll it would be like that. There's not
just one consciousness, there are many
what I call conscious agents that are
interacting. Um and there's so many of
them that it's overwhelming.
It's too much for anyone conscious agent
to talk to all or interact with all the
other conscious agents. And and just
like with social data,
if you're you know, like with the
Twitterverse, if you're trying to
understand what's happening there, well,
there's tens of millions of users,
literally billions of tweets. You can't
read the tweet all the tweets or
interact with all users. If you want to
understand what's going on, you need a
visualization tool, maybe a VR headset
where you can sort of see what's
trending in the United States, and then
zoom in to what's happening in Moscow,
and then zoom out to what's happening in
over in China and then zoom down to a
particular street. And so what you want
is simple graphics, simple eye candy,
little objects that are colored that are
doing different things that somehow lets
you grasp
what's what the billions of tweets and
tens of millions of Twitter users are
doing but in a way that you can So it's
got to dumb things down, put it in a
colorful simple eye candy format that
you can understand.
That and that's the big idea. I'm
claiming that that's what space time is.
Space time,
the sun and the moon, physical objects,
everything that we see inside of space
and time is just our visualization tool.
The reality we're interacting with is
nothing like the visualization tool.
It's nothing like space and time. It's a
whole network of interacting conscious
agents outside of space time, a vast
social network. And we've made the
rookie mistake
of assuming that our headset, VR,
our visualization tool, is the final
reality. It's just a rookie mistake.
It's It's like someone who's played
Grand Theft Auto so long, they have no
idea there's a reality besides Grand
Theft Auto. We're We're like that right
now. All right. So, let's go back to
this idea of conscious entities, which I
find interesting. It took me a while to
grasp this one. So, the easiest one is
inside the human brain right now, there
are two hemispheres. If you split the
corpus callosum, we discussed this last
time, you get two different
personalities. You've also got the
microbiome, which conceivably all the
microbes are conscious. And so, when you
uh inside of all of our cells, there's
hundreds or even thousands of
mitochondria, which are living organisms
inside of our cells. So, it is very
um objectively true to look at a human
and say, "You're not a single entity.
You are a collection of
trillions of entities that we just
sum up as like that's Donald. Right? But
in reality, it's not. And if I go in and
mess with the consciousness, like if I
go in and mess with your microbiome,
it'll change your personality, which is
crazy and I can't believe it's true.
Uh but nonetheless is true. I can affect
your energy output by going and messing
with your mitochondria, which again have
their own DNA. It's not like it's just a
cell in your body. This this is a uh its
own entity that happens to be inside of
your cells. Um and
as we begin to recognize that humans
already are just a collection of these
much smaller consciousness, but they
come together. Um
I get where you're going. Now, I don't
yet know the implications of that or
what we're going to take away from it,
but my relationship with you has been uh
like
hey, this crazy statement that I can't
fathom is true. I really want to write
you off as a nut job, but I can't
because like all of these things like do
make sense. It's just I so can't imagine
what life outside the headset is. Um but
the more time I have spent with the
ideas, the more it's like, "Okay, these
are starting to coalesce for me."
Um
so cool. I just wanted people to
understand that consciousness thing. I I
don't I certainly don't understand it
yet how it exists outside of the
headset, but I can't deny that already
even in the headset, we're a collection
of smaller consciousnesses.
Right. Maybe one help for thinking about
your consciousness outside
I
I might have mentioned this last time.
Um if you just look at your face in the
mirror.
If you look
what you see directly is just skin,
hair, and eyes.
That's all That's all you see.
And if you looked inside, if someone
opened your skull up and looked at you,
you'd just see neurons and and so forth.
But what you know firsthand that you
cannot see
is your hopes, your your
your aspirations, your love of music,
your your mood,
all the rich world of your conscious
experiences,
compared to that rich world, this face
is
unbelievably simple and nothing like
the world of your experiences. If I
smile or you smile, I can guess that
you're feeling joy. But a smile in no
way resembles joy. A smile is a twitch
of a face. A joy
is that that's where it's like the
things we see happening in the quantum
realm that make no sense. That to you is
the thing that tells you
your brain, the physical tissues, all of
that, they they are entirely in the VR
experience. It's all in the VR
experience. That's right. It's And so
strictly speaking,
no physical object, including my body,
is conscious.
Strictly speaking, my brain isn't
conscious because my brain
in fact doesn't even exist unless I
render it.
Right? So if you're playing Grand Theft
Auto, I'm playing a VR version of I've
got the steering wheel in front of me.
I'm holding the steering wheel. If I
look to the side, I no longer render the
steering wheel and there is no steering
wheel.
When I look here, I render it and now
there is a steering wheel. The same
thing is true strictly speaking of
neurons and brains.
They're there when you render them.
They're not there when you don't. It's a
VR
system that you render objects in space
and time as you need them
because they're part of your
visualization tool. And then you garbage
collect them. You delete them when you
don't need them. So strictly speaking,
no physical object is conscious. So So
not human bodies aren't conscious, rocks
aren't conscious. So I'm not a
panpsychist. A panpsychist is someone
who, you know, at least one version of
panpsychism is that, you know, there are
physical objects that obey the laws of
physics and the laws of physics are are
in some sense fundamental, but
consciousness is the reality that's
inside the laws.
And I'm saying something entirely
different. I'm saying that the very laws
of physics themselves are really no
restraint to consciousness whatsoever.
They're just a visualization tool that
certain consciousnesses happen to use,
but they're no restriction on the nature
of consciousness itself at all. And so
Okay, so before we move off that Yeah.
Um I know you don't know, but I want you
you must
have flashes of images or favorite
metaphors or whatever. So if I buy that
this really is a simulation true true
true, like it is as simulated as it's
going to get down to the fact that space
time is just a part of that simulation.
And it is consciousness that is
fundamental meaning that the complexity
of my brain will never give birth to
consciousness.
My consciousness, which is outside of
the the headset, it's outside the VR
world, it's outside the Grand Theft Auto
game.
Right. That thing has a need to
from a evolutionary standpoint based on
the gains it gets from certain
behaviors, it needed to create a virtual
reality so that it wasn't overwhelmed
with data.
So what is that conscious being that was
evolving?
As it sits outside of this, where where
can I scrape through and find the
conscious thing?
Right. So so well, the consciousness
won't be inside space and time.
Understood. Instead, space and time is
inside consciousness. Yep. I get that,
but I'm still imagining a little person
outside of the VR. Is that just
fundamentally broken?
Uh no, I would say that that probably
given the current state of human
imagination, including mine, that's
probably the best thing that we can do
of is to think about these entities. And
of course, as soon as we think about
entities, we we place them in space and
time. We we That's how we think. And so
So, it's harmless to do that as long as
you realize that the space that you're
thinking about isn't They're not
embedded in space. They're the creators
of space. That's That's the interesting
thing. So, it's hard for us
But outside space and time, I am eating
things, right?
Well, so so inside space and So, I don't
know what we're doing outside of space
and time. That's part of what I want to
understand is what are we actually
doing?
We don't See, I don't know what I'm
actually doing. I know what I'm doing
under a description like like I'm moving
my hand right now. And if I grab a
steering wheel in my car, I know what
I'm doing under a space-time
description, but I don't know in
ultimate reality what I'm really doing.
It's just like the VR player when they
turn the steering wheel in Grand Theft
Auto, they know
what they're doing in the language of
the game. I'm turning a steering wheel.
But what they're really doing in terms
of the supercomputer, right, which in
that metaphor would be the deeper
reality, they're toggling voltages and
magnetic fields and circuits that they
have no idea. There's There's probably
trillions of voltage togglings going on
for one turn of the wheel. All they see
is a turn of the wheel. That's their
notion of cause and effect. It's
trivial. The real cause and effect is
trillions of voltages getting toggled in
some in you know, in fractions of a
second. It's much much more complicated.
So, from an evolutionary So, when I When
we talk about evolution as as you did,
we have to be From this point of view,
it's very very important to be careful
because
um Now, we have to talk about in what
part of the framework we're talking
about. So, when I talk evolution,
I'm only going to be talking about
assuming the headset. I'm within the
framework of the headset because
evolutionary theory is only a headset
theory.
It's not a theory of consciousness
beyond space and time. Okay, this is
where things start to break a little for
me. So, I'm going to articulate what I
think you have said
about cuz all of this was born for you
you basically said you have two choices.
You can either keep space-time and get
rid of evolution or you can keep
evolution and get rid of space-time. And
your argument goes like this and
obviously stop me where I go wrong.
That all evolution cares about is
fitness payoffs. There are certain
behaviors that must be taken in order
for you to have children that have
children. And there's so much data
coming in that like looking at a desk or
a table or something would simply be a
string of numbers that dictate the
number of photons reflecting off that
coming back and you could interpret that
as different colors and brightness and
all that. But in reality it is just the
math of that situation.
And what you see around you is something
to simplify that. So that you only have
to render what you're looking at when
you look away it ceases to exist.
There's just the overwhelming
complexity. It would paralyze any
animal. So the evolutionary strategy
that was chosen is this crazy
simplification that we exist in which is
very convincing but it's ultimately a
convincing lie and isn't real. So I'm
like, "Okay, cool. I can actually get
behind that." Where it breaks down for
me is
what's actually evolving? Like something
needed this simplification. What is that
something? Right. So there's So there's
got to be a deeper dynamics, right?
There's some deeper dynamics that in
space-time looks like evolution by
natural selection. That's what it looks
like inside of our headset. But but
there has to be some deeper dynamics and
I I I've only had one idea
that I've run across that seems deep
enough. I'm not saying it's right.
But it's there's at least But But this
idea will tell you how deep we have to
go to at least get a contender. So if
consciousness is doing something if it's
quote-unquote evolving but not from
natural selection point of view. Just
So, by evolving I just mean it has some
kind of dynamics. And the question is
why? What what what is it up to? What is
consciousness up to?
Right? Cuz now that the typical stuff of
trying to get food and and procreation,
that that doesn't apply outside of space
and time presumably, right? It need not
might not apply. So, what's the deeper
thing?
The only idea that I've seen that's deep
enough, um,
comes from something called Gödel's
incompleteness theorem.
Yeah, I struggled with this in the last
interview. Now I think I have it
mastered.
Oh, okay. Well, well, then you're better
than me because Gödel's Gödel's theorem
was unbelievably deep. But, um, but but
basically what Gödel said without going
into the details is there is no end
in principle, no end to the exploration
of novel mathematical structure.
Even in quote unquote God could never
know it all. It's there's always going
to be an unbounded inquiry ahead. No
matter how much you know, there's
unbounded structure left to explore. And
if we make the assumption, and and now
I'm just speaking as a scientist like
saying, "Look, I don't know what the
truth is.
We put some ideas on the table and see
where they go, right? That's that's
that's how you do science. So, maybe
everything I'm saying is wrong, but I'm
trying to be precise so we can figure
out where it's wrong. So, if we assume
that consciousness is all is really the
fundamental reality, a bunch of these
conscious agents, this social network,
and if that's all that there really is,
then the only thing that mathematical
structure can be about
is consciousness.
That's all it's about because that's all
there is. So, Gödel's theorem then would
say,
"Because there's an unbounded and
never-ending possibility for exploration
of mathematical structure,
that means there's a never-ending and
unbounded possibility
for the exploration of varieties of
conscious experience."
In other words, consciousness
is like a kid in a candy store.
It but it's an infinite candy store. I
call it Gödel's candy store. It's a
never-ending exploration that is in
principle
never-ending.
It's not like you can ever come to the
end of it. And so, that is deep enough.
I'm not saying it's right, but it's deep
enough to be a real contender. Why
should consciousness be doing anything
at all? Well, here's one reason. Because
no matter how much consciousness
explores its possibilities, it can never
come to the end of its own
possibilities. And so, it's in a
never-ending
self-exploration.
And what you we call Tom and Don are
just parts of this overall exploration
of of consciousness and all of its
possibilities. And you know,
our little bit that we're exploring
right now is rich as it seems to us is
trivial.
Literally trivial compared to all the
possibilities that Gödel says are out
there. And we get some feeling of the
triviality, but I can imagine a square.
I can imagine a cube.
Now, go up one more dimension. Imagine a
cube in four dimensions.
My brain halts and my mind catches on
fire. Nothing happens. That's only four
dimensions. I can't even go to four
dimensions. I mean, how that that that's
terrible. It's it's just an incredible
limitation. I can only see three
dimensions of color, red, you know, you
sort of a
red-green dimension, blue-yellow, and
and and and and so forth. Like light and
dark. We have three cone systems and and
so forth. There are some pigeons who
that have four color receptors.
Presumably, they're in an extra
dimension of color that I can't even
imagine what it's like. Can you imagine
a specific color you've never seen
before? Right? Try to imagine one
specific color you've never seen.
So,
as rich as our world seem, we know that
there's a rich possibility of conscious
experiences that we can't even
concretely imagine. But, consciousness
itself,
on this theory, is exploring all these
possibilities. And right now we're sort
of stuck on this little headset.
Three dimensions, small amount of color
that we can see, and so forth. Just
We thought it was the whole world. No,
it's just it's a little headset. It's a
It's a prison. Right? That's it's it's
For me, I realized I'm sort of stuck. I
mean, it's just like my imagination is
stuck in only three dimensions. My
colors are stuck in a certain range.
Consciousness itself is exploring the
vast possibilities of of that's going
on. So, that Now Now, here's the
challenge. Suppose we chase that down.
As we say, "Okay, there's going to be
this
ongoing dynamics of consciousness
constantly
going beyond what it knows."
Exploring the candy store further and
further.
Well, there's several things to say
about that. One is
That's not The candy store makes it
sound like all fun and games, right? Oh,
but there's going to be a
a dark side to it because going into the
unknown means letting go of what you
know.
And that can be terrifying. So, this
suggests that consciousness is going to
have this thing going on all the time of
the exhilaration
and the terror
of going literally into the unknown,
where literally you don't have concepts.
All of your current concepts are
inadequate. And this is what what Gödel
is is saying. What These are going to be
new structures that that transcend. So,
for those who meditate, I mean, when you
go into silence,
it's both healing and terrifying.
Right? If you really let go of all
thoughts,
you and go into the void, it's it's sort
of it can be scary. Like you want to go
back into you grab back on your It's a
life jacket, right? You you grab on to
your teddy bear your thoughts. So,
there's going to be this
to really go into new conceptual
frontiers, you have to let go of old
concepts. So, there's going to be that
aspect to it. Which is sort of a
spiritual side. But, there's
also
to making progress?
I think so. I I think that
What's the central question for you? So,
and I'll prime you by telling you my
central question. Sure. The central
question in all of this that I find
interesting is what is the correlate?
So,
um Mhm. I I'm in this VR experience
to the advantage of something. And I
want to know what that something is. It
isn't me as I perceive me, um but it's
something.
Right. So, what's your central question?
Right. Right. The Well, the answer is I
I don't know. But,
and so I
There's no specific thing that you're
chasing?
Well, what I'm chasing is the idea that
that we're chasing that the
consciousness itself
is only about
exploring new possibilities of
experience.
New
Okay, so I'm going to push on that. You
Okay. Let's go into the way that AI
researchers think and work. And I know
that was your degree, so this ought to
be I'm taking you right home. Um
you have to imbue the robot with
directives, desires, right? So, to put
it in human terms, it's like there are
certain things that humans want to do.
We um we're an active species, so we
tend to go and explore. Uh we try to um
take control of our environment. We
certainly eat, procreate, like all
those. We have the drive to quench
thirst, hunger, sex, so on and so forth.
So, like those things are pushing us to
go do things, even if we don't want to.
We find ourselves compelled to seek
pleasure, to move away from pain. All
right. By default, AI wouldn't have
those. So, now you've got to give those
those things. And I love that concept of
minus a desire, any entity just sits or
is blown around by
um
physics, right? So,
uh obviously we're in the headset now,
but like you've got wind. And so, okay,
something lighter than the wind is is
going to move. But otherwise, everything
just sits.
So, what is it? Like
what how has this conscious entity in
that question that you just posed
been given some sort of impetus to
explore the infinite candies in the
infinite candy shop?
Well,
by the way, I'm on board with what
you're saying. I think that that's
really a a good way of thinking about
this. And that you could think about our
your life and my life right now is we're
in a simulator, a space-time simulator.
And we've been given, like an AI system,
we've been given certain
intrinsic
desires that we then find. And so so So,
my my wife is an artist.
That's how she's exploring. I I am still
stuck at third grade stick figures. So,
that's not how I'm exploring.
I'm exploring in a different way. So so
So, there's billions of humans
and there are billions of different ways
that we explore in music, in art, in
literature, in science, various kinds of
science, meditation. So, we're in
sports. There There are all sorts of
ways that consciousness is exploring um
through through us. And there is not
like one is the best
or that you're What makes consciousness
want to go go all the asset to create
this VR experience to run each of us is
sort of an individual experience
in consciousness.
The idea would be that that is what
consciousness is about is the
exploration of all of its possibilities.
So is that just the miracle like I've
now hit the part where you're like I
don't [ __ ] know. This is the miracle.
Well, well, yeah and and when we when we
say that um
that's something that we have to say is
true of any explanation, right? Any
explanation at some point
we say if you grant me these assumptions
then with those assumptions I can
explain everything else.
Well, so and I totally buy into that.
Here here is the base assumption I've
always made about the miracle that the
whole point is to say hey everybody,
I've got this theory. Here's my miracle.
Check it out theory works, right? Yeah,
yeah, yeah, wow, this is better than
everything. Okay, the only reason I've
told you about this thing is so you can
tell me how to move the miracle back
even farther.
Or are you just like cool, I'm good with
that miracle and now I just want to
explore
within that where that miracle is or
Well, so I want to do both. So so
this this miracle is so new that I you
know, I need to explore it a little bit,
right?
So so I want to push on this one but the
but the the miracles I'm proposing are
consciousness is fundamental. So
experiences themselves don't come from
physics.
They are fundamental. So that's a
miracle and second um
this other miracle that that girdle
proved
where he proved it but it's still a
miracle, right?
The incompleteness of mathematics that
you can that there's endless explore
that's just a fact which is remarkable
fact we proved it but it's nevertheless
this why should the universe be that
way? Why should logic demand that?
That's
So that's the but it's a satisfying kind
of endpoint where we say that's the way
the world is. Here's the theorem
that says that's the way the universe is
And that that one theorem tells us why
if you're up to exploration,
then have fun because you will always
There's no getting there. That's the
key. There's no arriving.
Consciousness will never arrive.
Gödel's incompleteness theorem in a
real-world example? Cuz this one,
anybody that watches the first episode,
I must ask you 75 questions about this
theorem, and I just could not get my
head around it. And now, uh the
punchline is as far as I can tell, it's
turtles all the way down. So, um
Gödel's incompleteness theorem, as I
understand it, says no matter how much
you use math to try to find base
reality, you will never find it. There
is no end. There will always be another
layer to discover on and on and on and
on and on literally for infinity.
Right. So, so I can say a little bit
more about what what Gödel was up to on
that and how it relates. So, so Gödel
was The question they were asking It was
a mathematical question. That is, if you
write down a bunch of axioms, right?
Some These things are true. These things
are Give me
two points define a line. Two lines
intersect Give me a few things like
that. And then you ask, "What are all
the theorems that you could prove
from those assumptions?"
And And so, you know, so we did all this
in high school algebra and so forth. We
would you know, prove different things.
What Gödel's The big question that
mathematicians had David Hilbert really
put put this out there was, "Can we with
just grinding through these theorems and
proofs
get all mathematical truth?"
Is that
There's some finite number. There's
maybe it's 6.7 million, but we can do
it. Even if it's infinite. In principle,
if we could just grind forever, would we
get all the truths? And that was So,
Hilbert asked that question, and Gödel
showed that the answer is no, that no
matter how big your axiom system is, how
many axioms you've got, he found a way
to show here is something that's true,
but you can't prove it within your
axioms. So now what So you can take that
new truth, stick it as one of your
axioms, and then he showed, well,
there'll be another truth
that now pops up. And so this never
never ends. And so So no matter how So
you can't just mechanically grind
through and get all the truths.
And the key thing about this, which is
really interesting for consciousness
now,
is
Gödel used
self-reference.
It It's when you get a a mathematical
system to talk about itself
that the problems start to arise. And
that's really interesting it because
what I'm suggesting here is that
consciousness
is trying to understand itself in all of
its possibilities.
And
because of that self-reference,
it's a never-ending enterprise. And you
can never
sort of quietly draw a parallel between
math and consciousness.
Are they separable or inseparable
entities?
That's a really deep and important
question.
I don't know. Here's Here's just my
thoughts.
My
I study psychophysics, which is a branch
of science which we experimentally and
mathematically study
conscious experiences. Your perceptions
of shape and color and so forth. We
write down math models and we test
people in in the lab.
Every conscious experience
has structure.
And we can write down mathematical
structure. I've never seen a conscious
experience that doesn't have
mathematical structure. And the
structure's derived from what what
neurons are firing and things like that?
Um well, it's sometimes has nothing to
do with neurons at all. Um for example,
in color space, you can talk about it it
seems like red and orange are closer to
each other than red and green.
That's an a structural notion, and we
can write we can write down what we call
color spaces, and they turn out to be in
these non-Euclidean color spaces. Taro
Imai and others um who did the
mathematics on on this
come up with these really interesting
complicated mathematical spaces which
model um all the relationships of colors
to each other. So, we have color
experience and their structure. Um, when
you see a shape like a ball
we can write down equations that model
the 3D shape that you're experiencing.
So, there's an intimate connection
that's been studied scientifically
between conscious experience and
mathematics. The way I think of it is
that
consciousness
is to mathematics like the living
organism is to its bones.
For, if you're a vertebrate you need the
bones
but you're more than the bones.
And and so, that's the way I think about
con- consciousness can't be reduced to
mathematics, I don't think. There are
others like Tegmark who would say that
everything can be reduced to to
mathematics. Max Tegmark says that kind
of thing. I you know, he may be right,
but that's not what I'm saying. I I'm
saying that mathematics is the
structural aspect of conscious
experience, but there's more to the
conscious experience than just the
structure. In part because um so far as
we know, different kinds of conscious
experiences can be structurally
identical.
So, if and if that's the case, then
uh uh
something with the same structure could
have different qualia? Feel different?
Exactly right. That's right. So, is that
context dependent?
How
See, well, that's now where I'm getting
to the edge of my understanding here.
It's It's I I did actually prove a
theorem. It's called the scrambling
theorem, and I published it in 2006,
where I proved that that your colors
could be scrambled with respect to mine.
But, we would be functionally identical
in every single experiment we could do.
So, there was no structural thing that I
could do to
show that your color experiences were
different from my color experiences. So,
so your experiences aren't devoid of
mathematical structure, but
the mathematical structure isn't the
whole story about your conscious
experiences. That That's the best I can
say right now. And I agree with you. If
If If that feels like we need to press
further on that, I couldn't agree more.
We do need to press further on that, and
and I look forward to cuz I think there
some profound insights are yet to be
revealed.
So, where this all to me, I'm so
curious. Like, I'm always trying to find
how is something usable, right? How does
this come back? So,
um
if it reveals something about myself and
how I can move through the world in a
way that's more interesting, more
fulfilling, more whatever.
Um
if it actually the the big thing between
last one and this one was the idea that
space time is as malleable as video game
code. And that we really could, even
though it would only be an experience in
the headset, that suddenly things within
the headset, like faster-than-light
travel, suddenly become very real. We
just have to figure out what the real
substance of the
headset code is, so that we can get in
there and begin to um make changes.
But, that to me forces the question of
the me that I perceive as me is
inherently an object of the
uh the headset. So, there is There is no
me outside of the headset, but there is
something outside of the headset. And I
don't know if if our minds maybe just
work so fundamentally differently, but
as we talk about this is what I started
imagining. Okay, hey Tom, this is a
collection of different um
conscious beings and consciousnesses the
the you know, the driving force and it's
running through all these
experimentations. And so I'm like, oh
okay, cool. Uh there's this thing
underneath the 3D and it's you know,
essentially popping up all these
different Well, let me see what blue
would be like for a kid that grew up in
Tacoma, Washington and went to Harvard
Elementary. You know what I mean? And
like, oh, that's interesting. And then
but like needed my entire sort of life
and universe to go for it to truly be an
infinite exploration of what these
different things. So there's a me that
they spun up just to know the color blue
at the age of 44. You know what I mean?
Have with this exact history. And then
there's oh, over here I'm going to do
that same test, but I want to know what
salmon tastes like when you had that
early bad experience with salmon as a
kid, but later you fall in love with
this girl who's really into salmon. What
does salmon taste like then? And so
that's like where my mind goes, right?
And so now I'm imagining like this
consciousness of some kind. Maybe it too
is the Borg and you know, maybe the Borg
is what's feeding its drivers and all of
that, but I'm still trying to imagine
like my brain immediately goes to
there's a thing. And that thing in my
mind is basically the most classic
looking alien ever. But they have like
these long fingers that like each finger
is
uh an entity that becomes this
uh a conscious entity living in the the
headset just to go, oh cool, that's what
that experience is like. Do you have any
sort of
analogy metaphor that you think about
this stuff in or is this just cuz I have
a limited brain? I'm not sure. No, I I I
love your metaphor and I don't have a
better one. And
I you know there's a couple things to
say about that metaphor though, which is
um one
in some sense, you know, a lot of
spiritual teachers tell us to relax and
enjoy the ride.
Right? Don't get all anxious, don't get
all bent out of shape, and so forth.
Rich or poor, whatever you might be,
enjoy the ride. And in some sense, when
you do that
it feels right. I mean, it feels like I
mean, of course I'm I'm I'm exploring,
I'm not being lazy, I'm not but but but
there's there's something about hey, you
know, smell the roses, enjoy this thing.
You you know, you don't want to come to
the end of your life and and and not
have really enjoyed the ride. And and
so, the idea that that it's it's about
not arriving anywhere
but but the joy of exploring for its own
sake. That that's that's one thing
that's on the table here. Is it Is that
what it's about? Now, there's another
thing that I've I've put on the table
though, which is
Of course.
We should be very modest about all of
our claims here. I'm probably wrong
right about about all of this, right?
And but as a scientist, what I want to
do then is to say, well, how can we go
about trying to
figure out where we're wrong as fast as
possible. And for me, what I'm doing I
mean, while I'm exploring these ideas
that that we're talking about
I'm also trying to say, how would
consciousness
precisely, this this vast social network
project mathematically into space-time?
Clearly, there's a projection. I'm
interacting with
Tom's consciousness. I'm not seeing that
consciousness, I'm seeing skin, hair,
and eyes. I'm seeing a space-time
projection. I'm not actually seeing your
emotions, I'm not seeing your mood.
But I am genuinely interacting with your
experiences. It's a genuine interaction.
And so, there is a projection from this
conscious realm into space-time.
I want to get a mathematically precise
model of that projection. The thing
about gluons in the
Large Hadron Collider predicting that is
just not because I'm so interested in
gluons, it's just to make sure that I'm
not BS-ing myself. Did I get the mapping
right? If I can't predict gluon
interactions, then I still have my
homework to do. But now, once I get
that,
here's the kicker.
We can take what we understand in the
headset and pull it backwards.
If we can project from consciousness to
the headset, then we can try at least to
go from the headset and pull backwards.
It's it's it's a fallible enterprise,
but it may help us
to open our minds to the possibilities
for deeper theories of what's going on
outside the headset. So So, the reason
I'm doing this is because I
I can't even imagine a specific color
that I've never seen before. I can't
imagine in four dimensions. In other
words, I take it as a given
that I'm
deeply deeply limited in my imagination.
And I need all the tools I can get to
help me step outside of my headset and
try to guess
the unfathomable outside of there. So,
that's why we want to get this
mathematically precise mapping into
space-time and then pull it back to to
give us a guide that can help us to not
just be wildly speculating about what's
going on in the realm of consciousness,
but to have more tailored ideas that we
can test in a loop. I get ideas in my
headset, I pull them back to what they
might mean outside the headset, take
those ideas, play with them, project
them back into the headset to get new
predictions. So, in other words, we
if we don't want to BS ourselves, we
have to figure out a way to make this an
experimental
scientific enterprise. And that's the
loop. But this is a bigger scientific
loop. It goes outside the space-time
headset to a theory of what's going on
in consciousness
projecting back into space-time, which
is the only place where we know that how
to do experiments, and going through
that loop. So, science is up to the
task.
But,
here's the kicker for me as a scientist.
This approach says there will be no
theory of everything.
Why not?
Because Gödel's theorem says You just
there's too much. Can't bring it all
together. Any theory is going to have a
finite set of assumptions.
And the implications of that will be
finite. Yeah, well, well, well, well,
could have such a a deep theory of so
many things that
I mean, it's there's always a new sort
of theorem to discover, but does that in
any way, shape, or form break? Cuz
here's here's my understanding of why
people are searching for a theory of
everything. You've got Einstein, um,
Newton dealing with the um, macro world,
and then you've got the quantum dealing
with the microscopic world. And for
whatever reason, all of your predictive
models when things are big, they work
just fine. All of your, um, modeling
when it's small works just fine. But,
when you try to make either one of them
work together, then it falls apart. But,
we are I could see sort of closing the
loop on that. That becomes an
everything, right? Even though it's
actually just a very small subset.
Right. It's the headset, and so it's not
the, you know, the true theory of
everything. Right. But, if it allows you
to unify sort of the known universe,
that seems like it would be incredibly
useful. And I'm assuming there's some
there is something for us to understand,
like that loop you were talking about,
that goes and takes in consciousness,
comes back into the headset, that we
could create a loop. So, I'll I'll make
this more concrete again, thinking maybe
more as a writer than as um a physicist,
for sure. But, so when I was thinking
about, okay, the Big Bang and things
expand, what are they expanding into?
Um and
the idea that a universe could sort of
pop in and out of exist, like how's all
this possible?
And one idea that's put forth is that
basically the the everything, so I'll
I'll hesitate to call it the universe,
but the thing, whatever that is, is like
a foam. And every bubble is a universe.
And the bubbles sort of come and go, and
you're in the bubble, all you see is the
bubble, the bubble to you seems like
everything, but if you were to actually
puncture through that bubble out, now
I'm in the, you know, the bigger matrix
of stuff. And so you you begin to
understand how you get a temporary
limitation, but actually then once you
see what's beyond you, like, oh, I get
it. And then Gödel's incompleteness
theorem answers the question of, okay,
but what's that goop sitting in? Oh,
it's sitting in this space. What's that
space sitting? Oh, it's sitting in this.
Oh, [ __ ] Gödel, right? And you're
just like, it just
It goes on and on forever. But, you
would like at some point, being able to
predict seven, you know, bubbles on,
it's like,
do I really need to go to the infinite?
There's just As long as if the What? you
poke through one bubble and all of a
sudden all physics are backwards and it
doesn't make sense, okay, that would be
problematic. But, assuming you're just
puncturing through to the next thing
that's exactly like where you currently
are, seems like you could come up with
something unifying-ish.
Right. So, instead of turtles all the
way down, it's Gödel's all the way down,
right? It's just It It's just
endless exploration. And Gödel's theorem
could be like the deep meta theory.
It's not the theory of everything, it's
sort of a meta theory that tells us why
we will constantly be exploring for new
theories. So, if if you were looking for
the deepest theory, from this point of
view, maybe I'd I'd think about it, but
maybe Gödel's theorem would be this
metatheory that explains why all the
concrete theories will never be the
final theory of everything.
And so, in that sense, maybe we with
with Gödel we have I mean, a candidate
for this metatheory of everything. Um
and and which which explains why
um the joy of exploration will never
cease.
Um
which is an interesting
But I I agree, this is a a really
interesting thing to to to try to
understand as a scientist and and
we can use some of the tools that we've
been learning from um deep learning. So,
deep neural networks and so forth, where
you we get the agent-based models of
interaction for exploration and
learning.
So, those those tools that they're like
DeepMind um at Google
um has some papers recently where they
they've come to the same conclusion that
that my team has come from evolution.
They found that instead of giving deep
neural networks a strict model of the
world that they want them to make
reasons in or to make guesses in or to
to live in,
um they just give them, as you were
saying, some
some payoffs, some, you know,
positive and negative rewards for their
behaviors, and they don't tell them
about the world. They just let the
the deep neural network explore explore,
and they build their own
um worlds, and it turns out they don't
build worlds which mimic the truth.
They build virtual realities, which are
a dumbed-down user interface that let
them get the most rewards, um and they
don't see the truth. So, we actually So,
there's some papers I can give you a
link to some papers some from DeepMind
in the last couple years, where they've
stumbled onto the same thing that
evolution has stumbled onto that that um
you know,
the The
never leads to the truth that leads to
this the uneasy interface which sort of
doesn't maximize but which satisfies. It
It gives you what you need to uh in
terms of the rewards.
And I would like to say one thing that
an objection that people will have at
this point. Some people will go, "Yeah,
this is crazy.
Um of course we see the truth. I I know
enough truth not to get hit by that car.
And we know enough truth to build
computers and to to send rockets to the
moon. So, this is completely nuts to say
that we we we don't know the truth." And
and
uh from what we've said now people might
be able to understand what I'm about to
say or or guess what I'm about to say.
It's sort of like if you're um in one of
the really neat little programs right
now that um
where you can build stuff. So, there
there there building games like you know
Roblox or Trove or or Fortnite or
Minecraft. And and you know, you can
you can become a master
in one of those worlds, right? And and
so you might say you can imagine a
person saying, "Well, what do you mean
I'm not in reality? I can build these
wonderful worlds. I can build all these
tools. I can do all this great stuff in
Minecraft or you know, in these various
worlds." Of co- but and yeah, within
that {quote} {unquote} reality of
Minecraft, yes. You're seeing that
reality and you are building things in
that reality and it requires
intelligence and so forth.
But you're not seeing again the circuits
and the software and the voltages that's
the real reality outside your Minecraft
world. And so that's that's
that's the answer to someone who says,
"Well, I know enough about reality not
to get hit by a car and to build a
computer and to send you know, rockets
to the moon." Yes, well you're in your
Minecraft world and we've become very
very good at that Minecraft world.
But it's still a rookie mistake not to
realize that Minecraft is just
Minecraft, it's not the final reality.
And so So, the kinds of arguments that
that really hold a lot of psychological
weight. And then the reason I mean, I'm
talking about this is these ideas really
grip our imagination and and it's hard
for us to let go of them. So, that's
that's why I wanted to bring that that
up.
So, talk to me. So, you've got so many
people trying to get to general
artificial intelligence. You have Elon
Musk going around warning people, "Hey,
you're going to make something that is
going to be so much smarter than you.
It's just absolutely going to rip
uh the planet apart." Um
you've got people talking about AI
becoming conscious.
In your understanding of what
consciousness really is as a fundamental
element, could a
robot or an AI ever become conscious?
Well,
the answer is not in the way that it's
typically thought, but in a in a
completely different way, yes. But in
the way that it's typically thought,
absolutely not. And so
How do people typically think of it?
Right. So, so it's
The way it's typically thought of is
again within a physicalist framework.
So, space-time and particles and energy
are fundamental. Everything is made of
quarks and gluons and protons and
neutrons and so forth and and, you know,
it's the Big Bang story. Big Bang was
13.8 billion years ago. Space-time
emerged, particles and energy. And there
was no life
for hundreds of millions of billions of
years.
No consciousness for maybe hundreds of
millions of billions of years after
that. So, consciousness and life are
late comers. They're not fundamental.
From that point of view,
the right way to think about things is
how does matter and particles get into
complicated enough patterns of
interaction such that life and then
consciousness emerge. From that
framework, that's the right way to think
about it.
I'm rejecting the entire framework.
Space-time is doomed. That whole
framework is the wrong framework.
But
and and and it's not me as a cognitive
scientist saying, I'm saying it's
physics, it's physicists are saying
space-time is doomed. Like Nima
Arkani-Hamed and and and others are
saying that because of gravity and
quantum field theory and the way they
interact,
there are no local observables in
space-time. None. In our space-time,
there is nothing that can be precisely
measured anywhere in our space-time.
In other words, space-time
is an inadequate framework
for what we need to do if we're as
scientists. It's just the wrong
framework. There's got to be a deeper
framework and space-time has to be
emergent.
So, the whole reductionist paradigm
is wrong.
The reason So, reductionism is the idea
that
to understand complicated things like
you and me,
we need to understand simpler things
like chem- chemicals. And to understand
them, we need to understand even simpler
things like just particles. As we go
down to smaller and smaller regions of
space and time, we get to the better
better understanding of the more
fundamental principles. That's sort of
the reductionist
And by the way, that's been
spectacularly successful
for centuries.
Um and we owe our current science to the
success of reductionism. So, I'm not
against reductionism. It's been
successful. It's worked
so far because we've been studying our
headset. And it's true that as you go
closer and closer into {quote} the
pixels of your headset, you're
understanding more and more
fundamentally how the headset works. I'm
not saying that space-time has pixels,
by the way. It mean physicists would say
um that would violate Lorentz
invariance. There are no pixels of
space-time. It
space-time just ceases to make any sense
at 10 to the minus 33 cm, 10 to the
minus 43 seconds. It it just falls
apart. It's not that there are pixels,
it just makes no sense.
So, reductionism worked,
but it stops because space-time isn't
fundamental.
And so, the very notion of smaller
ceases to be operational. There is no no
smaller. In fact, as you try to probe
smaller and smaller past 10 to the minus
33, you you create black holes that just
get bigger and bigger and bigger. So,
you you literally reductionism literally
blows up in your face in physics. It
blows up in the form of a black hole.
So, reductionism has worked, but
reducing consciousness, so we're try So,
like my brilliant colleagues and and
these are my good friends who are
working on this, right? In in cognitive
neuroscience. They're trying to reduce
consciousness to
patterns of matter. So, there's
integrated information theory,
causal computational architectures that
have certain kind of integrated
information. The claim is they're
identical or give rise to consciousness.
Or Penrose and Hameroff, um
there are certain quantum states in
microtubules that if you have a coherent
gravitational collapse of these
orchestrated collapse of these,
somehow consciousness arises. Or there's
global neuronal workspace. If you have
the right broadcasting architecture for
certain kinds of information, then that
becomes conscious. So, these are all
reductionist
theories of consciousness. You start
with space-time and physical stuff, and
somehow consciousness emerges. I'm
saying
as those those guys are incredibly
brilliant,
but
because space-time is doomed,
all approaches to consciousness which
assume that space-time isn't doomed,
which assumes that space-time and matter
are fundamental, are themselves doomed.
Those So, those approaches to
consciousness just haven't really
understood what the physicists are
telling us and what I'm claiming
evolution by natural selection is
telling us.
Space-time is the wrong language.
Particles are the wrong language. The
only reason reductionism has worked is
because we were studying our headset.
And in the headset, yes, going smaller
and smaller in the headset worked up to
a point until the very notion of small
ceased to make any sense. And that's
where it stopped.
So,
where do we So, with AI now, this is a
long way to your question, but but but I
can't answer your question simply
because the the issues are so deep here.
Sure. So, with with
the standard view of AI and
consciousness is, of course,
we can build machines that will be
conscious.
The brain is a machine, and it's
conscious.
So, we we have a an a real example.
Here's a carbon-based machine inside
your own head that's creating
consciousness. So, who cares if it's
carbon or silicon? We can build a
machine with the right So, we're just
trying to reverse engineer the dynamical
patterns of neural networks in the brain
or microtubule quantum collapses,
whatever they might be.
Whatever the physical magic is that
somehow gives rise to consciousness,
we'll we'll do that. I'm saying that all
of those approaches can't work because
space-time is doomed.
Okay, so before we move on from that, so
but we can create new consciousness,
right? If my wife and I get together,
it's a loving night, warm,
Right.
9 months later, we've got a new
consciousness. So, how is that not Are
you saying that all the elements from
the egg and the sperm, all of it, there
was consciousness there the whole time?
And so, there is no point where it just
gets The cells divide sufficiently such
that consciousness arises? It's been
conscious the whole time?
Well, so remember that
cells and eggs and sperms and so forth
are just icons in our interface. Yes.
They themselves have no consciousness
themselves.
They're They're little symbols
that we use as pointers to a realm of
consciousness that we have to reverse
engineer to figure out what's going on.
What actually
Is there a moment though where the realm
of consciousness goes, "I am now
inserting the consciousness element into
this child?" Well,
I think so in in the in the
Well, into the our interface.
Inserting the consciousness into our
interface. Yes, but they're inserting
the consciousness into that specific
part of our interface which at this
moment is an infant or a zygote or a
wherever whatever point that
consciousness is imbued. Right. Yeah, I
would say that yeah, I would agree. I
would say that there's a point in which
a new portal
in our interfaces is opened up into
consciousness. So So, for example, I
have a portal into Tom's consciousness.
It's It's It's not
perfect. It's fallible. But, it's real.
I can guess if you're interested, I can
guess if you're you know, if you're
hurting or or I can guess. Yeah.
It's a But, it's a genuine portal into
your consciousness. And but but of
course,
my experience is not your consciousness.
Your consciousness is is is separate.
And so, our interface does give us
genuine portals into the consciousness
of others. My cat, I have less access.
My a mouse, even less. And you know, a
microbe,
my interface has given up. My portal has
become really dumb. It's not because
there's no consciousness out there. It's
that my portal is is got too much noise
or or it's just not opened up to it.
So So, yes, when we have babies,
we are, in a way that we don't
understand,
opening new portals
into the realm of consciousness.
I So, I want to understand that. It's
It's very much like if someone is
building something in Minecraft and you
know, they put things together.
But, if if you're really inquisitive,
you'd like to know, "Well, what was
really going on inside the computer
that looks like me building this thing
that I see in my Minecraft world. And
that's that's what I want want to do.
So, in Minecraft there are different
things that are in some sense portals to
a whole bunch of code that's going on in
the computer that's allowing me to build
this stuff.
Okay, let me start making some guesses
here on where you're going. So, I'm
assuming that you're chasing this
problem because ultimately you want to
be able to figure out, "Hey guys, guess
what? Spacetime is fundamentally the
wrong way to look at it. And if we get
the right way to look at it, we will
have all just an avalanche of insights
maybe usable in the way that quantum
discoveries have given birth to modern
life." Most people don't put two and two
together. They just think uh the you
know, maybe the atomic bomb or something
like that. But that there's real your
cell phones, GPS, like all of it has to
do with um physics. So, if we can get to
the the underlying physics of whatever
gives birth to the um the simulation,
now we could have a whole new avalanche
of insights that allow us greater
manipulation of the world or whatever it
is precisely that's driving you. Which
brings me back to the collider. You're
paying attention to that because you if
I understand how these things explode,
then I can backtrack it and understand
how they came together in the first
place, which in your prediction is going
to take us outside of the simulation
into the world of consciousness, which
do you imagine that world has physics
and desires? Like does the the
consciousness must have something
propelling it to do things?
Right. The The only idea I've got there
is this idea from Gödel of just infinite
exploration. Unbounded
that is the Okay, so this is going to
bring us to God here cuz I feel like
you've already said this is a magic
moment or a miracle moment. So,
something has
given the spark of desire to
consciousness to explore girdles
infinite like look at all the different
manifestations that consciousness can
take. And so we are all but one sort of
pop up of a very specific kind of
consciousness and who knows there could
be a Brazilian of these things all over
the known and unknown universe.
Um
Right. So
as we're doing that it begs the question
of in your mind is there such a thing as
God?
Well, this gives us possibly
the
a chance to have a language
which for the first time ever we might
be able to formulate a precise
hypothesis about what we mean by the
word God
and start to do science. So for example
have a hypothesis around that?
I Well, yes. So I have a precise
definition of a conscious agent.
And what one definition I could give for
God would be um the agent which is the
combination of all
the conscious agents. The single So So
suppose it turns out that mathematically
when I look at the mathematics of
conscious agents and how they combine to
formulate agents
suppose that the mathematics tells me
there is in some sense always one
largest agent that's being formed. I
don't know if that's will be the case. I
don't know. But but suppose then I could
say that that's God.
Suppose it turns out that no
what's going on is that there are many
many quote unquote maximal agents but
there's no single maximal agent. And
they're not identical. Then that would
then there it might be a polytheism.
But the nice thing about this is
we could See the word God has been used
in contradictory ways for thousands of
years by various traditions and and we
fight to the death
over a term literally that's not well
defined because your God is not the same
as my God. And And it's a tragedy
um
of human
history that that hundreds of millions
of people have been have died
in because of
differences over what we mean by the
word God. And And what I would like to
see is sort of
a humble approach to that that term
saying, "Look, no, we My tradition has
its ideas, your tradition has its ideas.
Clearly, since we all disagree, at most
one of us is right. And and possibly all
of us are wrong. So, why don't we
come together, take all of our best
ideas,
and then try to sift through And here's
where science can help, where we take
the ideas and try to make them precise,
mathematically precise, cuz that's when
you find out if things gel, if they're
consistent, or if they actually we
you're you're talking nonsense, right?
You You know, if you say
A is true and not A is true, well,
you're talking nonsense, right? So,
so, can we do something like that?
And
evolve
ideas about the notion of God, and and
have a scientific spirituality where
where God becomes something that we're
we don't assume that we know, we're not
dogmatic, I know what God is. We're
humble. We say, "These are the best
ideas we've got so far. Let's try to
make them precise so we can figure out
precisely where we're wrong, and then
evolve it." So, so I I see
this direction going forward, the
possibility of a scientific spirituality
where um
we
take a lot of the spiritual insights
that the spiritual traditions, the
mystical traditions have had for
thousands of years,
and we take the tools that science has
learned by studying our headset.
And we use those tools to take the first
step outside the headset that the
spiritual traditions have been telling
us, "Look, you guys are stuck in the
headset. You're stuck in the headset."
Well, they're right.
But, by studying the headset, we got the
tools we needed to actually step outside
the headset
in a way that can be precise, and we can
figure out
what we're doing and make precise
theories. And so, I see science and
spirit We're We're at this really
interesting convergence point in human
history.
Where there's been a war between science
and spirituality in effect. They've been
at at odds. These are non-physicalists
over here, the spiritual side. These are
physicalists over here, the scientists.
Scientists have all the hard-nosed
tools. It's all woolly and and imprecise
over here on the spiritual side. And so,
they've been been at odds at each other,
right? But now, let's take the best
insights. And I'm I'm not saying that
anybody's right or wrong. I'm just
saying, let's take the best insights
from the spiritual traditions
and be willing to call nonsense
nonsense, and take the best tools from
science, and take and also call theories
nonsense that are nonsense,
and try together to make precise
theories about the spiritual realm and
our position, you know, what are we here
for?
Um what is life about? I mean,
these deep deep questions that are all
important to us. Um and see see where it
goes. And and you're right. I think that
as we do this,
we're going to understand if if this
idea that there's a network of conscious
agents outside space-time. And we begin
to really understand how
in part it works and how it relates to
space-time.
The technologies
that we're going to get
are stunning. The The The analogy I
would think of is is like this.
Again, going back to Grand Theft Auto.
You can imagine being someone who's a
wizard at Grand Theft Auto. We all just
look in awe at what this wizard can do.
And that's truly impressive. But now,
the software engineer comes along who
actually knows the software of the game.
And he can take the gasoline out of the
tank or let the tire out of the airs of
the wizard's car. So, now the wizard is
nothing
compared to someone who knows how the
software works outside of Grand Theft
Auto. Once we get outside of space-time,
and we understand how this network of
conscious agent works, and how
space-time is just a visualization tool.
We will be in the position of that
software engineer that can actually just
give the Grand Theft Auto wizard a flat
tire. We'll be able to walk walk
We he could change the road. We he could
change the dimensions of the road. He
could make buildings disappear. He could
make space and time shift in any way he
wants.
That's the kind of
Pandora's Box, potentially,
that we're going to open up here. I I I
It's both, as a scientist and a human
being, it's exhilarating and scary as
all get out.
Um
That in the wrong hands is incredible
power.
Yes, there's so many sort of layers of
guesses between us and there, but if um
yeah, if people have the ability to
essentially edit the matrix, and anybody
can do it, then that's going to
certainly go into some pretty
interesting places.
Um before we ponder that, though, I want
to ask you,
what do you think of Einstein's
statement that I want to know God's
thoughts, everything else is just
details?
Well, there there's a a sense in which
um
I
I'm very much on on board with with
Einstein. In in in some sense,
the attitude is, I mean,
who cares that there are so many kinds
of quarks, and who cares that there are
so many kinds of gluons, and that the
mass of the electron is such and such,
and that you mean
That's not what it's really about. I
mean, we we need to understand those
things, but not for their own sake. What
we're what what Einstein and the and
theoretical physicists are really after
is they're trying as as Einstein said,
"I want to understand the mind of God,
right? As as I want to understand
what are the big deep principles that
would lead to the laws that have as
their consequences there are these kinds
of quarks and these kinds of gluons and
so forth. So it's the deep deep
insights. It's the same kind of thing
that you and I are chasing here when we
are talking about ideas like Gödel's
incompleteness theorem and Gödel's candy
store. Like these you know, even if
that's not the right idea, it gives you
a flavor for the deep kind of idea that
we're after that that we think of this
could be a deep enough idea that it
could be a a guiding principle for a lot
of the details that we see.
So it's in that sense that I would would
agree completely with with Einstein on
that. Now, I think Einstein
um
was very much attached to space and
time.
Um
he Seems fair.
Yeah, he he he he was the
perhaps the person with the most
profound original insights ever about
space and time.
Um I don't know if he ever let go of
space time. Maybe in his later years
maybe he did. I don't I don't know, but
but but most of us it's really hard.
The avant-garde of physics right now are
letting go of space time. When you if
you just Google space time is doomed.
Google that phrase, you can find videos
by Nima Arkani-Hamed for example, and he
can tell you exactly why
state-of-the-art physicists today are
saying space time is doomed. So the mind
of God, whatever it is,
is not space time itself.
It's something deeper.
And but they don't know what that
something deeper is. What the physicists
are doing,
um
because they don't have any
they don't have any idea what you know
what's beyond space and time. What
they're doing, which is really
brilliant, they're saying let's take the
mathematics
of the models that we do have in space
time. Quantum field theory,
gravity.
Let's look at that mathematics and see
that mathematics is like a light into
the dark beyond space time.
Can we and and they're flashing that
light into the dark as far as they can
let that light go.
So they're they're just trying to see
what the structure of our current
theories might tell us to guide us in
our ideas beyond space time. But
ultimately,
we're going to need to make a creative
leap. We're going to have to just
and this is the fun of science. You make
a creative guess.
You make it mathematically precise and
then go back and say, "Okay, here's my
guess about what's behind space time."
Then you have to project it back into
space time where you can test it. And so
so so the physicists are doing great
when I'm reading their work very very
carefully because I need to build on
their work. I'm trying to plug my theory
of conscious agents and I want to show
that the
the long-term behavior of conscious
agents, so-called asymptotic behavior.
So this this is a dynamics on graphs, so
Markovian dynamics and it has an
asymptotic behavior. It turns out I
believe I can show that that asymptotic
behavior plugs into structures that the
physicists are finding called
cosmological polytopes, amplitude hedra,
associahedron and so forth that have the
same kind of permutation properties that
the asymptotic behavior of consciousness
does. So the asymptotic behavior of
consciousness leads to certain
permutations to classify it.
Permutations turn out to be the
fundamental thing that that the
physicists have found beyond space time.
That's as deep as they've gotten. There
are these things called permutations
beyond space time that lead to what they
call on-shell processes which they can
then lead to predicting the scattering
amplitudes. So that's the thread I want
to
to pull. Start with a theory of
consciousness where it's
a vast social network of
consciousnesses. Its asymptotic behavior
is what the flashlight of physics has
seen, the permutations. That's as far as
they can go.
What's asymptotic mean?
Long-term behavior. So, so I'll give you
very, very concrete with an example.
Suppose that you're in your car on the
freeway
and you're driving and there's hundreds
of people on the road with you.
Everybody it's a conscious person
turning the steering wheel, pushing on
the gas, hitting the brake and so forth.
Now imagine you're up in a helicopter,
you know, half a mile up and you're
looking down. You're the Channel 7 News
and you're
And and what you see is a bunch of
little specks, little dots moving on the
freeway. Mhm. You don't see any
consciousness. You could think of it as
particle flow, a bunch of particles
flowing. Well, there's a little The
particles are all stopped here, there's
a traffic jam and and now they're fluid
is flowing. You could use like fluid
dynamics, kind of math that physicists
use to describe that because that's the
long-term behavior. You're looking at it
from far, far away. You don't see the
consciousness.
So, so you're looking at long-term
behavior, not the little turn of the
wheel, the stepping on the brake of each
person. You're looking from very far
away. That's asymptotics, looking at the
long-term
from a far away distance. So, that's why
physics has never seen consciousness.
First, they're studying our headset,
not consciousness.
Um and and second, the headset itself
has only been
designed to show us the asymptotic
behavior of consciousness because that's
how we data compress. Right? That's This
is data compression. I can't see all the
Twitter users and what they're tweeting.
I see trends. Mhm.
Trends are the asymptotics and and so it
turns out when you look at the trend
behavior of consciousness, you get these
things
that we mathema- mathematicians call
permutations and that's as far as the
So, that's what I'm coming from my side.
Consciousness leads to permutations. The
physicist
pointing from the headset of space-time
into the dark,
their flashlight gets to permutations.
So, we're meeting in the middle. So,
that's what I'm trying to do is to
bridge that gap. It'll take a couple
years.
I'm not a physicist, so I'm just
learning as much as I can. And I'm
working with physicists, but you know,
there's a lot of conceptual work to do
there. But then this will get back to
the question you raised earlier about
artificial intelligence.
Because
once we understand how this whole that
thread gets pulled that I just described
from consciousness through asymptotics
into space-time.
We can reverse engineer
space-time.
And we can open
new portals
in the interface into conscious agents.
The conscious agents are there.
We'll be able to re- rejig our interface
to open new portals
and see new aspects of this social
network of conscious agents that we've
never seen before.
And maybe some of the technology that we
use to do that will look like circuits
and software. I don't know. We'll
You know, we'll see.
And if it does, you
it would be then in some sense we might
say Sure. Sure.
AI with circuits and software
has opened We now have consciousness in
that AI. But it will be different. It
will be not that the circuits and
software and silicon
was the founding thing and it created
the consciousness as an emergent
property.
Instead, we just circuits and software
are the language of the interface that
we use to describe this much deeper
thing we did that opened up a hole
opened up a portal in the interface that
looks like circuits and software in our
interface, but that's not the truth.
That's just what it looks like in our
interface. The deeper thing is well,
something with conscious agents and how
they operate that we'll we'll learn.
So, wait. Let me make sure I understand
that. So, are you saying that there is
we can create entities that meet some
sort of requirement as to open a portal
to conscious beings.
Now, the
the one that we know how to do now is um
sexual reproduction and I guess asexual
reproduction depending on where you draw
the line of consciousness, but we can
make puppies, we can make humans,
um
and those the act of that somehow, some
way meet some criteria that then
Exactly. Okay, and that there is some
configuration that we could do with
robotics or AI or a combination thereof
that would open a similar portal.
You've got it exactly right, Tom. We We
have as as you just pointed out, we have
proof
that our interface does have the
technology to open new portals. It's
pretty low-tech
where do we have that proof?
When you have a kid.
Okay. Okay.
a low-tech, right? Right, it's low-tech.
But we know that
know what happens. We enjoy the process,
but but we have technology. In other
words, our our interface has proven that
it's got the technology to open new
portals.
Well said.
Now the question is if we can understand
what's really going on there, we should
be able to do it and it may look like
AI.
Um and this may also be an answer to a
very, very deep question about um
alien intelligences. What Where are
they?
Well,
we're looking in our headset.
Of course we can't see them.
That's interesting.
They're out there.
That's really interesting.
We may We may I'm not saying we won't
find some of them out there. Our headset
may give us access to certain alien
intelligences on planets around Alpha
Centauri and so forth, but
it's going to be trivial compared to all
the consciousnesses that are out there.
That's what a headset is for. It's there
to hide
all of the consciousnesses because it
would be overwhelming to interact with
them. So, that's where they are. They're
all around us. We're
We're like ants that don't see the guy
with the Raid can coming at them. They
can't They They just can't see it,
right? Um so they're all around us, but
we're we are stuck in our headset and we
think that we're the the epitome of of
advancement and knowledge
and and so forth. My
It It would be funny and it maybe the
case that every that that's
a rookie mistake that every
consciousness goes through in its
simulator.
That it thinks it because its headset is
only going to give it
the best access to itself and others
like it and less access to others. And
so in its own eyes it will always be the
wisest
in its in its environment. And so it may
be a rookie mistake
that every
simulator that consciousness creates
has. That we all have to go through this
phase of going, "Oh, we're the best.
We're the greatest. We're the epitome of
evolution." And then we slowly realize,
"Oh, no, no, no, no. I'm in a simulator
and there's you know there's this
infinite range of other possibilities
for consciousness.
Some so profound that I that I if I
could see them I wouldn't be you know
inclined to fall down and worship them.
Who knows, you know? It's just So but
but it's a it's a really humbling
position. So we go from being the top of
creation that that that the smartest you
know
the brain is the most
incredibly complicated thing we've ever
found in the entire universe that point
of view to oh, wow. Um
We made a rookie mistake here. Um there
are consciousnesses out there that are
far more you know
mind-blowing than anything I could even
concretely imagine. So it's it's a very
very different kind of thing. And this
also by the way puts a different spin on
the the question of
life living versus non-living.
How so? I struggled with this the first
time I heard you bring it up. Dead still
feels dead to me.
How does it uh
Right. Cuz you're saying the very thing
that I perceive is them is
uh the consciousness coming through the
portal and if I could re-track down that
bit of consciousness, it would be just
like
dealing with
Timmy.
Uh, well, in that direction. That that
that So, that's the right direction. And
And by the way, you know,
I don't know the answer. So, you might
be closer than me. So, I'm So, if when I
say the right direction, uh, close to
what I'm thinking, and maybe you're
right and and and better better than
mine. An analogy I think that's that's
useful here is again a virtual reality.
And I like, you know, say you you go
with a bunch of buddies to, um, a
virtual reality arcade and put on a
headset and body suit and to play
virtual volleyball.
And so, you find yourself immersed in a
beach scene with the beach volleyball
court and so forth, and you start
playing beach volleyball for a little
while, then your friend Joe says,
"Excuse me for a minute, I'm thirsty.
I'll get a drink." So, he takes off his
headset and body suit to get a drink,
and his avatar
collapses motionless on the sand.
From the point of view of the VR game,
he's effectively dead. He's He's
unplugged.
But,
he's just unplugged from the headset.
He's not dead. And so, if space-time
isn't fundamental,
death may be nothing more What we call
death is just unplugging from the
headset. Now, what the consequences of
that are for consciousness,
for example,
maybe consciousness survives what we
call death,
but maybe the notion of a self, of me,
maybe that doesn't survive. I don't
know. This is going to be
I don't want to be doctrinaire about
this. want to be open to, you know,
first having bold ideas.
You You have to be crazy, have drink
beer, have some ideas, and then then
when you're sober, you go back and you
start, you know, okay, let's That That
looked really great when I was, you
know, with a gin and tonic, but now it
doesn't look so great when I'm sober.
Right? So, so you have to do, you know,
explore, but then go back. So, we want
our mathematical model of consciousness
to give us insights.
What is a self?
What is this thing that I call the self?
Will that survive detachment from an
interface? Or is that itself somehow
wedded to the interface? What is the
relationship between my interface, my
space-time interface, and my notion of
self? I'm really attached to this body.
But this body
is just a symbol.
You know,
I
I am not this
I want to get into something really
fast. So, one thing that I find very
confusing, not confusing, I
um I understand it and there's some part
of my brain is rejecting it. So, what I
what I like about the reductionist model
of quantum mechanics and all of that is
that um
there is something beyond what I'll
shorthand to personality.
So, a gluon is a gluon is a gluon,
right? It's just a particle and it acts
in a certain way according to certain
laws and I can get that things acting in
a certain way according to certain laws
as they group up into more and more
complex things, those more and more
complex things are now the amalgamation
of all these different laws and they
look like humans. Oh my gosh, look at
that. Right, but But as I break them
down, they die, the immune system stops
fighting off bugs, they return to a
different anatomical state, let's call
it dirt, and now they're reacting in a
different way. But then those could be
consumed by something that ends up
becoming a piece of, you know, the egg
and then the egg is refertilized and now
you actually become something again. And
so we're just we're these set number of
particles that sort of take different
forms, break apart, take a different
form again, and and it makes sense to me
largely because there are things beyond
personality, personality is only
associated with things that take a very
particular form, the sort of living
biological things as we would call it,
and there the individual pieces exist
outside of that and that's reflected
back to me because if I go and give
somebody brain damage, they will act
fundamentally different, right? Right.
Um deny somebody oxygen for a certain
period of time, but then don't let them
die and they they will be fundamentally
different. And so it's like everything
in the simulation, I fully understand
that.
But
having lived in the simulation, all of
that makes a lot of sense.
Now, when I try to
imagine, come up with a metaphor,
whatever, where consciousness is primary
and this may just be a failing of my
brain is so primed
to think of consciousness as being an
element of personality
that it just falls apart as I try to
imagine, okay, wait, while this
consciousness is in this body, it has
personality and I can [ __ ] up its
personality and make it act
fundamentally different. But hey, when
you come back out one of two things has
to be true. Either it's fundamental
nature was different than its
manifestation as Timmy
and so it was like, hey, you were Timmy
for a while. Oh, you got damaged, but
you're still you and Timmy's messed up
now, but I can pull you out and you'd be
just like you were before. But if I, as
little Tommy, come and re-engage with
the consciousness that was part of
Timmy, I wouldn't recognize this person
at all. So even if they're in Timmy
normal, they come out of Timmy, Timmy's
still normal, I still wouldn't get this
person or the consciousness because and
this is where again, my brain just
immediately starts grabbing a hold of
metaphor. So my brain goes, oh, okay,
cool, I get this. The consciousness is
like a puppet master and the very act of
taking on the body, right? So pregnancy,
cool, you got a baby, at some point the
puppet master brings consciousness to
that
puppet and now that that consciousness
gets to experience the girdle's infinite
candy store range of um states of
consciousness, of qualia, and goes, "Oh,
wow, cool. What a neat ride as I
experience this. Oh, this gets damaged.
It just changes my experience of what
this looks This is what Sally was like
before the brain damage. This is what
grapes taste like to her now that she's
had catastrophic brain injury. How
interesting." And like that's where I'm
like
one of those two interpretations is
way off.
Because I can't reconcile them both.
Now, because I've lived my entire life
in the headset, it just makes so much
more sense to me that
individual parts act one way,
when they come together, they act
another way. I mean, it's just That's
the human body, right? If you're just
looking at bacteria, it feels very
different. If you're just looking at
mitochondria, it's very different. If
you're looking at me without bacteria,
different. Me without mitochondria, I'm
dead, first of all. And it's only as you
bring all these together that I actually
act the way that I act. So, I understand
how I am this I am, you know, a
totality. Uh uh
I don't want to put words in your mouth,
but it's very poetic and super
interesting. A small g god, right? Uh
something that is like the accumulation
of trillions of things that have come
together in this pretty amazing form,
right? That is delicate and precious and
would never want anything to happen to
it, but obviously does not rule the
universe and just trying to get through
the day.
Uh but, you know, very interesting as
you If you define God as a collection,
little g god, as a collection of these
individual consciousnesses that have
come together to create this sort of
symphony that we recognize as a cheetah
or a person or a gorilla or whatever. Um
that
I
get. That to me is very interesting.
When I start thinking as consciousness
as fundamental, I start I make the
mistake that I read that as personality
as fundamental.
Right. The first interpretation is the
one that I I agree with you about. That
the consciousnesses come together to
create new varieties of consciousnesses
and it's um a very novel and creative
process. And all I mean when I say
consciousness is fundamental is that
it's not space and time and physical
stuff that's the fundamental thing. It's
that
these kinds of consciousnesses that can
combine to create new forms of
consciousness. It's that's the direction
that science needs to go to try to
understand what's really the fundamental
dynamics of what's going on. How is it
that two consciousnesses when they
interact create a new consciousness? And
there by the way we can get some
information like from the split brain
patients that we talked about last time,
right? There are people that have the
the commissure the commissure yeah, the
corpus callosum is cut. And the in one
case the left hemisphere believed in God
and the right hemisphere was an atheist.
Left hemisphere wanted to be a
draftsman. Right hemisphere wanted to be
a race car driver. Completely different
personality. So, what consciousness is
doing in that case is what happens when
I put an atheist together with a
believer in God and make the the the
believer in God also want to be a
draftsman and the atheist also want to
be a race car driver. What kind of new
consciousness what do I get when I put
those two together and put a corpus
callosum between them and force them to
live together in a lifetime. What new
How do they So, the adjudication of that
and then we all sort of sometimes will
feel like, you know, it's Friday night.
Part of me wants to do this. I'd like
to, you know, kick up my heels and have
some fun. Part of me wants to be a geek
and study some more physics, whatever it
might be.
Maybe those are really two separate
consciousnesses, two separate conscious
agents that are negotiating and in the
process a new consciousness it exists.
This is where I come back to I'm so into
that idea from Einstein and this may not
be what he meant and maybe I'm just
doing a poetic interpretation, but I
want to know God's thoughts or the mind
of God everything else is just details.
It's like I want to know what what
imbued these conscious entities with any
propellant like what makes them step
through the portal are there times where
they're like [ __ ] it now I don't want to
step through the portal I just want to
do my version of a Friday night chilling
over here you know cuz when you think
about two conscious entities coming
together one it is they are you get very
distinct and predictable types of
consciousness depending on whether it's
right hemisphere or left hemisphere so
it is obviously not
you can very quickly over simplify but
it they're different right one side is
going to be prone to religiosity and the
other side would be prone to not like
that's predictable you wouldn't get I
forget which is right or left but like
whichever has the propensity for
religiosity you're never going to get it
that the other side has a propensity
like if I told you hey V.S. Ramachandran
who studied the hell out of this like
hey one of the sides is religious he's
not going to be like oh my god I have no
idea it's 50/50 he's going to be like oh
that's the left or the right whichever
it is so now it's like this [ __ ] is so
tied to the physicality that exists in
my headset
that it's like teasing out what is
the the what is the thought of God what
is the thing like what's the game being
played here like why why is there a
puppet master you know what I mean like
it's Exactly.
so interesting No absolutely Tom and
that's the spirit in which scientists
are are and I'm approaching this right
we're we're saying let's we we try to
reverse engineer exactly these kinds of
things what do we find from the
neurosciences split brain patients what
clues can we get to what's really going
on outside the headset so but the the
first thing you have to do is realize I
have to think outside the headset. So, I
have to let go of the reductionist view
and say, "How are neurons doing this?"
And saying this instead, "Let's talk
about consciousness on its own terms.
What's consciousness doing?" And and
then the the neural structures that I'm
seeing, I have to think about them,
"Okay, this is just my virtual reality
interface. How can I reinterpret all
these neural networks and what they're
doing in terms of what networks of
conscious agents are really doing?" In
other words, that this much harder work
to you
conceptually
spend a lot of time thinking about this.
Do you have a method for getting
breakthroughs? Is it really a gin and
tonic and then go organize your ideas?
Is it go jogging? Like, how do you do
this? Well, um it's
I have several things I do on a daily
basis. And I'm I'm
grateful to my wife for giving me some
space to do it.
I meditate for several hours.
Okay.
3 hours a day. Wow.
And you are pursuing the lack of thought
or you're pursuing to let your mind
chase a thought?
Entire silence.
Nothing but silence.
And watching what happens there. It's
very The the idea
from the my geeky point of view about it
is
if I'm going to go beyond the interface,
then I've got to let go of the interface
entirely.
Any concept, any thought that I have is
by definition still in the language in
the interface that I got. So, going into
utter
and total silence
is
not easy. And it's both exhilarating and
terrifying because there are no security
blankets
when you let go of all thoughts.
And if you So, one thing I do is I watch
myself. And I watch
the terror.
And I watch my mind jumping back and
clinging to the things that it knows.
And but then I also notice that
I I've been doing this for 18 and 1/2
years.
And
the process to me the best
metaphor I can think of for it is to
describe it as like metamorphosis.
Like so you think about you know a
caterpillar goes into a chrysalis and
then comes out a butterfly. How
beautiful it's all lovely and so forth.
But what really goes on is that inside
the chrysalis
there's a war.
The immune cells of the caterpillar
fight to the death
the cells in the in inside that are
responsible for turning it into a
butterfly. And it's only when the immune
cells of the caterpillar are completely
overwhelmed
that the transformation takes place. And
everything that the caterpillar knew
eating green leaves, crawling on a bunch
of different legs, having little
furry spikes come out of you, having a
mouth
that everything that it knows
it has to let go.
Talk about terror. It and and the the
the analogy of the terror in that seems
to be the immune system is fighting this
until the immune system is completely
overwhelmed. It's not like all peace and
love. It fights until it can't fight
anymore. And that's the way meditation
seems to me. It
It seems like the the letting go of what
I know, letting go of the caterpillar
and seeing what new forms of
consciousness might come and seeing how
I might be transformed is both
exhilarating and terrifying but is
certainly transforming. So that's one
thing that I do.
set Do you set a different intention
when you sit down to meditate? Like
today I'm going to try to um think about
like what these conscious agents look
like. No.
I I
only silence and everything else
happens.
is to let go of everything I know.
That's the one intention is
let go of this headset.
Let go of this headset completely.
do you do when your grocery shopping
needs pop into your head?
Um well, I can tell you what I do what
I've done for a lot of the time. I you
beat yourself up. You go, oh, you know,
I was stupid. Why don't you How come you
can't be into this? And then eventually
I just you over years and years and
years you learn to just go
c'est la vie
back to silence.
C'est la vie, back to silence. And just
go back there and and the weird thing
about it is
the caterpillar can't know
what it's turning into.
It has no idea what it's like to have
wings and a proboscis instead of a mouth
and to drink nectar instead of eat
leaves. It it it can't know.
It has to go completely into the
unknown. And so it's being good
with letting go of everything that's
known and letting yourself venture into
the totally unknown.
So that's one aspect of it. The other
aspect is I spend as much time as I
possibly can studying mathematics,
listening to what the physicists are I
are saying I
um Nima Arkani-Hamed gave a a course at
Harvard in fall of 2019 to the graduate
students on the state of play in
scattering amplitudes.
I've
literally transcribed by hand on my
computer 17 of his lectures. Wow.
And I'm studying them. I'm not a
physicist, but I
um and I don't have the talents that
these guys do, but I have incredible
motivation and I really want to
understand this stuff. So and I've got a
physicist friend uh Chetan Prakash who's
really good. So Chetan and I meet and
and he helps me through it. He's also
interested um and we're working on this
mathematics together. So I spend hours
every day
studying physics, studying mathematics,
of course studying cognitive
neuroscience, artificial intelligence,
the tools that are needed here. This is
This is a truly multi-disciplinary task
to go all the way from a theory of
consciousness
through its asymptotic behavior through
cosmological polytopes into these
on-shell diagrams into space-time and
quantum field theory
and then to the large hadron
and but then eventually to climb up to
life and chemistry and neuro
neuroscience and psychology
to to get the big picture. I mean I
can't get the whole thing but I'm just
trying to get the threat that goes all
the way through. That's that's my goal.
Can I pull a threat all the way through
that we can then start to build on. And
so it's truly multi-disciplinary and so
I have to think out of the box
all the time so the meditation is very
very helpful to just let go of the box
completely. But then
the weird thing about this and this may
be some clue as well to something deep
about the whole picture.
There seems to be reward
for
absolute silence
no concepts whatsoever
and
absolute precision
on the other hand.
And there's no reward for sloppy
thinking in the middle.
So but
silence
and precision
seem and we see this in quantum
computation which is really quite
interesting. In quantum computation
when you build a quantum computer
on the one hand
we use the most absolute precise theory
and mathematics we've ever had quantum
quantum theory to build use quantum
information theory. We build these So
this is just like the epitome of sharp
thinking. And everything has to be
precise.
And once you set up the quantum bits and
gates
and start the computation
now
the other side happens.
You have to let go completely.
You can't intervene. You can't touch the
thing in any way. If you interfere in
any way,
you destroy the computation.
So, you have on the one hand absolute
precision, the best that you can do in
your interface.
And then, you step away and you don't
touch it with anything in your interface
at all.
And that's when the horsepower is
unleashed. And after that and that's
where the quantum computation power
comes. And then at the end, you can look
at the quantum bits and get some data
small thimbleful of of the whole rush of
computation that went on there. So, so
there's this this very interesting thing
and I'm trying to understand it.
Precision.
Doing the best precise thinking you can
with the current cognitive tools that
you've been given.
Letting go of those cognitive tools all
together.
Going into a complete silence. Those two
seem to be really
critical and somehow they come together
in quantum computation. Precision and
then don't touch. Anybody who's a
programmer for classical computing,
right? You know that if you write a
program, you like to put a little
tracers in the program to see what it's
doing while while it's computing, you
know, to debug it, to see, you know,
what what what went wrong. You can't
trace a quantum computer that way. If
you trace it, you you break the the
power. That's so interesting.
So, so there's that kind of So, you can
see why I'm thinking out of the box. I'm
really trying to think in terms of
metaphors. How does this this weird
thing about quantum computation relate
to my own experience as a scientist
doing precise thinking or best I can
with no thinking in meditation. How does
that relate to quant This is the kind of
the out-of-box analogies that may lead
you nowhere, but it also may lead you to
to insights as long as you are don't
hold on to anything dogmatically, right?
That's that's the sort of the point.
Explore
and then be the first to kill off the
things that you know, really don't make
sense. Don't don't hold on to them. So,
it's an anti-dogmatic
point of view, but
but and yet
the balance is to be as excited and
energetic and having fun so that you
want to do it, right? You You have to
it's a balance. I mean, you have to have
the energy to go, "I really want to do
this today. I'm going to study all this
math cuz I might learn something. I
might actually break through here." And
on the other hand, to not cling to
anything you got, like, "I'm I'm
probably wrong. I'm probably wrong. I'm
probably wrong."
That's the balance to to to have in all
of this stuff and and it's possible, but
but it's really interesting to see how
the mind
goes into dogmatism.
Very It goes into safety. I think
they're maybe the same thing.
That's interesting.
And they
really could be the same thing. So, so
those are two of the things I do and
then I do a lot of exercise. Like, I I I
it's just a the case that in this
interface,
if your
body is not physically fit,
then you're not going to be at the peak
of your mental powers. So, I have a
workout regimen every day of the week. I
do either an hour of weight training
or an hour and a half of some kind of
mild aerobic stuff.
And I I alternate days. Um so, so it's
And then I spend time, you know, with my
my wife and my family and, you know, kid
and grandkids and and and so forth and
and enjoy
um this part of Girdle's Candy Store.
Right.
I love that. Donald, man, this was so
much fun. I I really really enjoy
spending time with you. Um I have no
doubt we will do a round three at some
point. Thank you so much for coming
back. Where can people get your book?
Tell Tell people about the book, where
you want them to connect with you. Oh,
yes, it's called The Case Against
Reality. Um you can get it on Amazon or
Apple and so forth. The Case Against
Reality. Um and then I've got a Twitter
feed um at Donald
D. Hoffman, I think. But if you just
Google my name on Twitter you can find
it. And I put links to most of my to to
our I'll put a link to our pod podcast
here and and so forth. But
um and
yeah, so on Twitter and you know, I have
a website at the University of
California at Irvine that lists some of
my papers and has my email um
ddhoff@uci.edu.
So people can email me. I I you know, I
get enough that I can't respond to most
of the emails, but but
you know, every once in a while I can
respond. So Nice. You know what that's
like I'm sure. I I do indeed. Right.
Cool. Well guys, check him out for sure.
Hopefully you enjoyed this and if you
loved it, be sure to subscribe. And
until next time my friends, be
legendary. Take care.