Joe Rogan podcast. Check it out.
00:01
>> The Joe Rogan Experience.
00:04
>> TRAIN BY DAY. JOE ROGAN PODCAST BY
00:06
NIGHT. All day.
00:08
>> Hello. Hey, Joe.
00:12
>> Good to see you again. We were just
00:14
talking about Was that the first time we
00:15
ever spoke or did was the first time we
00:17
spoke at at SpaceX?
00:19
>> SpaceX.
00:20
>> SpaceX. The first time when you were
00:20
giving Elon that crazy AI chip,
00:22
>> right? DJX Spark.
00:24
>> Yeah. Oo, that was a big moment. That
00:26
was a huge
00:27
>> That felt crazy to be there. I was like
00:28
watching these wizards of tech like
00:30
exchange information and and you're
00:32
giving him this crazy device, you know,
00:36
and then the other time was uh I was
00:38
shooting arrows in my backyard and uh
00:40
randomly get this call from Trump and
00:43
he's hanging out with you. President
00:45
Trump called and I called you.
00:46
>> Yeah. It's just
00:47
>> we were talking about you. [laughter]
00:48
>> It's just talking about he was talking
00:51
about the US UFC thing he was going to
00:52
do in his front yard.
00:54
>> Yeah. And he pulls out. He's JJS, look
00:55
at this design. He's so proud of it. And
00:58
I go, "You're going to have a fight in
01:01
the front lawn in the White House." He
01:04
goes, "Yeah, yeah, you're going to come.
01:05
This is going to be awesome." And he's
01:07
showing me his design and how beautiful
01:08
it is. And he goes, and somehow your
01:10
name comes up. He goes, "Do you know
01:14
Joe?" And I said, "Yeah, I'm going to be
01:16
on his podcast." He Let's call him.
01:18
[laughter]
01:21
>> He's like a kid.
01:23
>> I know. Let's call him. It's so He's
01:24
like a 79y old kid.
01:26
>> Oh, he's so incredible.
01:28
>> Yeah, he's an odd guy. Just very
01:30
different, you know, like the what you'd
01:33
expect from him. Very different than
01:35
what people think of him. And also just
01:38
very different as a president. A guy who
01:40
just calls you or texts you out of the
01:42
blue. Also, he makes when you te you.
01:43
You have an Android, so it won't go
01:45
through with you, but with my iPhone, he
01:47
makes the text go big.
01:49
>> Like, you know, USA is respected again.
01:50
like [laughter]
01:53
all caps and it makes the te the the the
01:55
text enlarge is kind of ridiculous.
01:58
>> Well, the the 101 Trump President Trump
02:00
is very different. He he surprised me f
02:04
first of all he's an incredibly good
02:07
listener. Almost everything I've ever
02:09
said to him, he's remembered.
02:11
>> Yeah. People don't they only want to
02:13
look at negative stories about him or
02:16
negative narratives about him. You know,
02:19
you can catch anybody on a bad day. Like
02:21
there's a lot of things he does where I
02:22
don't think he should do. Like I don't
02:24
think he should say to a reporter rep
02:25
reporter, "Quiet piggy." Like that's
02:26
pretty ridiculous. Also objectively
02:29
funny. I mean, it's unfortunate that it
02:32
happened to her. I wouldn't want that to
02:34
happen to her, but it was funny. Just
02:35
ridiculous that the president does that.
02:38
I wish he didn't do that. But other than
02:39
that, like he's he's an interesting guy.
02:41
Like he's a lot of different things
02:43
wrapped up into one person, you know?
02:45
You know, part of part of his charm,
02:49
well, part of his genius is Yes. He says
02:51
what's on his mind.
02:53
>> Yes.
02:54
>> And which is like an anti-olitician in a
02:55
lot of ways.
02:57
>> So, you know, what's on his mind is
02:58
really what's on his mind,
03:00
>> which
03:02
I I do some people some people would
03:04
rather be lied to.
03:06
>> Yeah. But but I I like the fact that
03:07
he's telling you what's on his mind. Um,
03:09
almost every time he explains something,
03:11
he says something,
03:13
he starts with his, you could tell, his
03:15
love for America, what he wants to do
03:18
for America. And everything that he
03:20
thinks through is very practical and
03:24
very common sense. And, you know, it's
03:26
very logical and um
03:29
I still remember the first time I I met
03:32
him and so this was I I'd never known
03:34
him, never met him before. and um uh
03:37
Secretary Lutnik called and we met right
03:39
before right at the beginning of the
03:43
administration. He said he told me what
03:45
was important to President Trump that
03:47
that um uh that United States
03:49
manufactures on shore and that was
03:53
really important to him because because
03:56
uh it's important to national security.
03:58
He wants to make sure that that the
04:00
important critical technology of our
04:02
nation is built in the United States and
04:03
that we re-industrialize
04:06
and get good at manufacturing again
04:08
because it's important for jobs.
04:10
>> It just seems like common sense, right?
04:11
>> Incredible common sense. And and that
04:13
was like literally the first
04:14
conversation I had with Secretary Letic
04:16
um and he was talking about how how um
04:19
that he started he started our
04:24
conversation with uh Jensen. This is
04:26
Secretary Lutnik and I I just want to
04:29
let you know that you're a national
04:32
treasure. Uh Nvidia is a national
04:34
treasure and whenever you need access to
04:37
the president um the administration uh
04:41
you call us. We're always going to be
04:44
available to you. Literally, that was
04:46
the first sentence.
04:49
>> That's pretty nice.
04:50
>> And it was completely true. every single
04:51
time I called, if I needed something, I
04:54
want to get something off my chest, um,
04:57
express some concern, uh, they're always
04:59
available. Incredible. It's just
05:01
unfortunate we live in such a
05:03
politically polarized society that you
05:04
can't recognize good common sense things
05:07
if they're coming from a person that you
05:09
object to. And that, I think, is what's
05:11
going on here. I think most people
05:13
generally a as a country, you know, as a
05:15
a giant community, which we are, it just
05:18
only makes sense that we have
05:20
manufacturing in America that especially
05:24
critical technology like you're talking
05:26
about. Like it's kind of insane that we
05:28
buy so much technology from other
05:30
countries.
05:32
>> If United States doesn't grow, we will
05:33
have no prosperity. We can't invest in
05:36
anything domestically or otherwise. we
05:40
can't fix any of our problems. If we
05:43
don't have energy growth, we can't have
05:45
industrial growth. If we don't have
05:48
industrial growth, we can't have job
05:50
growth. These it's as simple as that,
05:52
>> right?
05:54
>> And the fact that the fact that he came
05:55
into office and the first thing that he
05:57
said was drill baby drill. His point is
05:58
we need energy growth. Without energy
06:01
growth, we can have no industrial
06:03
growth. And that was it saved it saved
06:05
the AI industry. got I got to tell you
06:08
flat out if not for his progrowth energy
06:10
policy
06:15
we would not be able to build factories
06:16
for AI not be able to build chip
06:18
factories we won't sure surely won't be
06:20
able to build supercomputer factories
06:22
none of that stuff would be possible
06:24
without all of that
06:26
construction jobs would be challenged
06:28
right electrical you know electrician
06:30
jobs all of these jobs that are now
06:32
flourishing would be challenged and so I
06:34
think he's got it right we need energy
06:36
growth We want to re-industrialize the
06:38
United States. We need to be back in
06:40
manufacturing. Every successful person
06:42
doesn't need to have a PhD. Every
06:45
successful person doesn't have to have
06:47
gone to Stanford or MIT. And I think I
06:48
think that that that you know that
06:51
sensibility is is um spot on. Now, when
06:53
we're talking about technology growth
06:57
and energy growth, there's a lot of
06:59
people that go, "Oh, no. That's not what
07:00
we need. We need to, you know, simplify
07:02
our lives and get back." But the the
07:04
real issue is that we're in the middle
07:06
of a giant technology race. And whether
07:07
people are aware of it or not, whether
07:10
they like it or not, it's happening. And
07:11
it's a really important race because
07:13
whoever gets to
07:16
whatever the event horizon of artificial
07:18
intelligence is, whoever gets there
07:22
first has massive advantages in a huge
07:23
way.
07:26
Do you agree with that? Well, first the
07:28
part I I will say that we are in a
07:30
technology race and we are always in a
07:32
technology race. We've been in a
07:34
technology race with somebody forever.
07:36
>> Right.
07:39
>> Right. Since the industrial revolution,
07:39
we've been in a technology
07:40
>> since the Manhattan project.
07:41
>> Yeah.
07:42
>> Or or you know, even going back to the
07:43
discovery of energy, right? The United
07:45
Kingdom was where the industrial
07:48
revolution was, if you will, invented
07:51
when they realized that they can turn
07:54
steam and such into into energy into
07:55
electricity.
07:58
All of that was invented largely in
08:00
Europe and the United States capitalized
08:04
on it. We were the ones that learned
08:07
from it. We industrialized it. We
08:09
diffused it faster than anybody in
08:12
Europe. They were all stuck in
08:14
discussions about
08:17
policy and
08:20
jobs and disruptions. Meanwhile, the
08:22
United States was forming. We just took
08:25
the technology and ran with it. And so I
08:26
I think we were always in in a bit of a
08:29
technology race. World War II was a
08:31
technology race. Manhattan Project was a
08:32
technology race. We've been in the
08:35
technology race ever since during the
08:36
Cold War. I think we're still in a
08:38
technology race. It is probably the
08:40
single most important race. It is the
08:42
technology is uh it gives you
08:45
superpowers.
08:48
you know whether it's information
08:50
superpowers or energy superpowers or
08:51
military superpowers is all founded in
08:55
technology and so technology leadership
08:57
is really important
08:59
>> well the problem is if somebody else has
09:00
superior technology right that's that's
09:02
the issue it seems like with the AI race
09:04
people are very nervous about it like
09:08
you know Elon has famously said there
09:10
was like 80% chance it's awesome 20%
09:13
chance we're in trouble and people are
09:16
worried about that 20% % rightly so. I
09:18
mean that you know if you had 10 bullets
09:20
in a a a revolver and you know you you
09:23
took out eight of them and you still
09:28
have tw two in there and you spin it,
09:30
you're not going to feel real
09:32
comfortable when you pull that trigger.
09:32
It's terrifying,
09:34
>> right?
09:34
>> And when we're working towards this
09:35
ultimate goal um of AI,
09:38
it it just it's
09:42
impossible to imagine that it wouldn't
09:45
be of national security interest to get
09:46
there first.
09:48
We should The question is what's there?
09:49
That's the That was the part that
09:51
>> What is there?
09:52
>> Yeah. I'm not sure.
09:53
>> And I don't think anybody I don't think
09:54
anybody really knows.
09:56
>> That's crazy though. If I ask you,
09:57
>> you're the head of Nvidia. If you don't
10:00
know what's there, who knows?
10:02
>> Yeah. I I think it's probably going to
10:04
be much more gradual than we think. It
10:06
won't It won't be a moment. It won't be
10:09
It won't be as if um somebody arrived
10:12
and nobody else has. I don't think it's
10:15
going to be like that. I think it's
10:17
going to be things that just get better
10:18
and better and better and better just
10:20
like technology does.
10:22
>> So, you are rosy about the future.
10:23
You're you're very optimistic about
10:25
what's going to happen with AI.
10:27
>> Obviously, will you make the best AI
10:29
chips in the world?
10:31
>> You probably better be.
10:32
>> Uh h if history is a guide, um uh we
10:33
were always concerned about new
10:37
technology.
10:39
Humanity has always been concerned about
10:41
new technology. There are always
10:42
somebody who's thinking there always a
10:44
lot of people who are quite concerned.
10:46
were quite concerned and and and so if
10:47
if history is a guide, it is the case um
10:51
that all of this concern is channeled
10:56
into making the technology safer.
10:59
And so for example, in the last several
11:02
years, I would say AI technology has
11:05
increased probably in the last two years
11:08
alone, maybe a 100x. Let's just give it
11:12
a number, okay? It's like a car two
11:14
years ago was 100 times slower. So AI is
11:18
100 times more capable today. Now, how
11:22
did we channel that technology? How do
11:25
we channel all of that power? We
11:27
directed it to um causing the AI to be
11:29
able to think, meaning that it can take
11:33
a problem that we give it, break it down
11:37
step by step.
11:39
It does research before it answers. And
11:41
so it grounds it on truth.
11:44
It'll reflect on that answer. Ask
11:47
itself, is this the best, you know,
11:49
answer that I can give you. Am I certain
11:52
about this answer? If it's not certain
11:54
about the answer or highly confident
11:56
about the answer, it'll go back and do
11:58
more research. It might actually even
11:59
use a tool because that tool provides a
12:02
better solution than it could
12:04
hallucinate itself. As a result, we took
12:06
all of that computing capability and we
12:08
channeled it into having it produce a
12:11
safer result, safer answer, a more
12:14
truthful answer because as you know, one
12:16
of the greatest criticisms of AI in the
12:19
beginning was that it hallucinated,
12:20
>> right?
12:22
>> And so if you look at the reason why
12:23
people use AI so much today is because
12:25
the amount of hallucination has reduced.
12:28
You know, I use it almost I well I used
12:30
it the whole trip over here and so so I
12:32
think the
12:35
the uh the the capability most people
12:37
think about power
12:40
and they think about you know maybe as
12:42
an explosion power but the technology
12:44
power most of it is channeled to towards
12:47
safety. A car today is more powerful but
12:49
it's safer to drive. A lot of that power
12:52
goes towards better handling. You know,
12:55
I'd rather have a Well, you have a 1000
12:58
horsepower truck. I think 500 horsepower
13:01
is pretty good. No, I thousand's better.
13:04
I think a th00and is better.
13:06
>> I don't know if it's better, but it's
13:07
definitely faster.
13:09
>> Yeah. No, I think it's better. You can
13:10
get out of trouble faster. Um,
13:12
I enjoyed my 599 more than my 612. It
13:17
was I think it was a better better
13:21
horsepower is better. My 459 is better
13:23
than my 430.
13:25
more horsepower is better. I I think
13:27
more horsepower is better. I think it's
13:29
better handling. It's better control. In
13:30
the case of in the case of technology,
13:33
it's also very similar in that way, you
13:34
know. And so if you if you look at what
13:37
we're going to do with the next thousand
13:38
times of performance in AI, a lot of it
13:40
is going to be channeled towards more
13:43
reflection, more research,
13:46
thinking about the answer more deeply.
13:49
So when you're defining safety, you're
13:51
defining a it as accuracy,
13:53
>> functionality.
13:55
>> Functionality. Okay.
13:56
>> It it does what you expect it to do. And
13:58
then you take all the the the technology
14:01
in the horsepower, you put guard rails
14:04
on it, just like our cars. We've got a
14:05
lot of technology in in a car today. A
14:08
lot of it is goes towards, for example,
14:10
ABS. ABS is great. And so, uh, traction
14:12
control, that's fantastic. without a
14:16
without a computer in the car, how would
14:18
you do any of that,
14:20
>> right?
14:21
>> And that little computer, the computers
14:22
that you have doing your traction
14:24
control is more powerful than the
14:25
computer that went to Apollo 11. And so
14:27
you want that technology,
14:30
channel it towards safety, channel it
14:32
towards functionality. And so when
14:34
people talk about power, the advancement
14:36
of technology, often times I I I feel
14:38
what they're thinking and what we're
14:41
actually doing is very different.
14:43
>> Well, what do you think they're
14:45
thinking? Well, they're thinking somehow
14:46
that this this uh this AI is being
14:49
powerful and their their mind probably
14:52
goes towards a sci-fi movie. The
14:55
definition of power, you know, often
14:58
times the definition definition of power
15:00
is military power or physical power. But
15:02
in in the case of technology power when
15:06
we translate all of those operations
15:09
it's towards more refined thinking you
15:11
know more reflection more planning more
15:14
options
15:17
>> I think the big fears that people have
15:18
is one a big fear is military
15:20
applications that's a big fear
15:22
>> because people are very concerned that
15:24
you're going to have
15:25
>> AI systems that make decisions that
15:27
maybe an ethical person wouldn't make or
15:29
a moral person wouldn't make based on
15:31
achieving an objective versus based on,
15:33
you know, how it's going to look to
15:36
people.
15:39
>> Well, I'm I'm happy that that uh our
15:41
military is going to use AI technology
15:44
for defense and I think that that um uh
15:46
Andural uh building military technology.
15:51
I'm happy to hear that. I'm happy to see
15:53
um all these tech startups now
15:56
channeling their technology capabilities
15:57
towards defense and military
15:59
applications. I think you needed to do
16:01
that.
16:03
>> Yeah, we had Palmer Lucky on the
16:03
podcast. He was demonstrating some of
16:05
the stuff I put his helmet on. And we
16:06
show we he showed some videos how you
16:08
could see behind walls and stuff like
16:09
it's nuts.
16:11
>> And he's he's actually the perfect guy
16:12
to go start that company.
16:13
>> 100%. [laughter] Yeah. 100%. It's like
16:15
he was born for that. Yeah. He came in
16:17
here with a copper jacket on. He's a
16:20
freak. [clears throat] It's [laughter]
16:22
awesome. He's awesome. But it's also
16:23
it's a you know an unusual intellect
16:25
channeled into that very bizarre field
16:27
is what you need, you And I think it's
16:30
it's uh I think I'm happy that we're
16:32
making it so more socially acceptable.
16:35
You know, there was a time where when
16:38
somebody wanted to channel their
16:40
technology capability and their
16:41
intellect into defense technology, uh
16:43
somehow they're vilified. Um but uh we
16:47
need people like that. We need people
16:50
who enjoyed enjoy that part of uh
16:51
application of technology.
16:54
>> Well, people are terrified of war, you
16:55
know. So it depends.
16:58
>> Best way to avoid it has excessive
16:59
military might.
17:01
>> Do you think that's absolutely the best
17:03
way? Not not diplomacy, not working
17:04
stuff out.
17:07
>> All of it.
17:08
>> All of it. You have to have military
17:08
might in order to get people to sit down
17:11
with you.
17:12
>> Right. Exactly. All of it.
17:13
>> Otherwise, they just invade.
17:14
>> That's right. [laughter] Why ask for
17:15
permission?
17:17
>> Again, like you said, history. Go back
17:18
and look at history. Um, when you look
17:20
at the future of AI and and you just
17:22
said that no one really knows what's
17:26
happening, do you ever sit down and
17:27
ponder scenarios?
17:30
>> Like what do you what do you think is
17:32
like bestcase scenario for AI over the
17:33
next two decades?
17:37
Um
17:40
the best case scenario is that AI
17:43
diffuses into everything that we do and
17:46
uh our
17:51
everything's more efficient but
17:54
the threat of war remains a threat of
17:58
war.
18:01
Uh, cyber security remains
18:02
a super difficult challenge.
18:07
Somebody is going to try to
18:09
breach your security. You're going to
18:12
have thousands of millions of AI agents
18:15
protecting you from that threat.
18:19
Your technology is going to get better.
18:22
Their technology is going to get better.
18:25
Just like cyber security. Right now,
18:26
while we speak, we're being
18:28
we're seeing cyber attacks all over the
18:32
planet on just about every front door
18:34
you can imagine.
18:35
And
18:38
and yet you and I are sitting here
18:39
talking. And so the reason for that is
18:43
because we know that there's a whole
18:46
bunch of cyber security technology in
18:48
defense. And so we just have to keep
18:50
amping that up, keep stepping that up.
18:52
This episode is brought to you by
18:55
Visible. When your phone plans as good
18:56
as visible, you've got to tell your
18:59
people. It's the ultimate wireless hack
19:01
to save money and still get great
19:03
coverage and a reliable connection. Get
19:05
one line wireless with unlimited data
19:07
and hotspot for $25 a month. Taxes and
19:10
fees included, all on Verizon's 5G
19:14
network. Plus, now for a limited time,
19:18
new members can get the Visible plan for
19:20
just $19 a month for the first 26
19:23
months. Use promo code switch 26 and
19:26
save beyond the season. It's a deal so
19:30
good you're going to want to tell your
19:33
people. Switch now at visible.com/rogan.
19:35
Terms apply. Limited time offers subject
19:38
to change. See visible.com for planned
19:41
features and network management details.
19:44
That's a big issue with people is the
19:47
the worry that technology is going to
19:50
get to a point where encryption is going
19:51
to be obsolete. Encryption is just it's
19:53
no longer going to protect data. It's no
19:56
longer going to protect systems. Do you
19:57
anticipate that ever being an issue or
19:59
do you think there's it's as the defense
20:01
grows, the threat grows, the defense
20:03
grows, and it just keeps going on and on
20:06
and on and they'll always be able to
20:07
fight off any sort of intrusions?
20:09
>> Not forever. some intrusion will get in
20:15
and then that we'll all learn from it.
20:18
And you know the reason why cyber
20:20
security works is because of course the
20:22
technology of defense is advancing very
20:24
quickly. The technology offense is
20:27
advancing very quickly. However, the
20:29
benefit of the cyber security defense is
20:33
that socially the community all of our
20:36
companies work together as one. Most
20:40
people don't realize this.
20:43
There's a whole community of cyber
20:45
security experts. We exchange
20:48
ideas. We exchange best practices. We
20:53
exchange what we detect. The moment
20:55
something has been breached or maybe
20:58
there's a loophole or whatever it is, it
21:00
is shared by everybody. The patches are
21:03
shared with everybody.
21:05
>> That's interesting.
21:06
>> Yeah. Most people don't realize this.
21:07
>> No, I had no I had no idea. I've assumed
21:08
that it would just be competitive like
21:10
everything else.
21:12
>> We work together. Interesting. Has that
21:13
always been the case?
21:15
>> Uh, it surely has been the case for
21:17
about about 15 years. It might not have
21:18
been the case long ago, but this this
21:21
>> what do you think started off that
21:24
cooperation?
21:25
>> Um, people recognizing it's a challenge
21:27
and no company can stand alone.
21:29
>> And the same thing is going to happen
21:32
with AI. I think we all have to decide
21:33
work working together uh to stay out of
21:37
harm's way is is our best chance for
21:40
defense. Then it's basically everybody
21:42
against the threat.
21:45
>> And it also seems like you'd be way
21:46
better at detecting where these threats
21:48
are coming from and neutralizing them.
21:50
>> Exactly. Because the moment you detect
21:52
it somewhere,
21:54
>> you're going to find out right away.
21:55
>> It'll be really hard to hide.
21:56
>> That's right.
21:57
>> Yeah.
21:58
>> That's how it works. That's the reason
21:59
why it's safe. That's why I'm sitting
22:00
here right now instead of, you know,
22:02
locking everything down in video.
22:03
[laughter]
22:05
>> It's not only am I watching my own back,
22:07
I've got everybody watching my back. and
22:10
I'm watching everybody else's back.
22:12
>> It's a bizarre world, isn't it? When you
22:13
think about that cyber threat,
22:15
>> this idea about cyber security is
22:16
unknown to the people who are talking
22:19
about AI threats. They're I think when
22:21
they think about AI threats and AI cyber
22:24
security threats, they have to also
22:26
think about how we deal with it today.
22:27
Now, there's no question that AI is a
22:29
new technology
22:33
and it's a new type of software. In the
22:35
end, it's software just it's a new type
22:37
of software and so it's going to have
22:39
new capabilities but so will the defense
22:41
you know where you use the same AI
22:44
technology to go defend against it. So
22:45
you do you anticipate a time ever in the
22:48
future where it's going to be impossible
22:51
where there's not going to be any
22:54
secrets where the bottleneck between the
22:56
technology that we have and the
23:00
information that we have. Information is
23:01
just all a bunch of ones and zeros. It's
23:02
out there on hard drives and the
23:04
technology has more and more access to
23:06
that information. Is it ever going to
23:07
get to a point in time where there's no
23:09
way to keep a secret?
23:12
>> I don't think
23:14
>> because it seems like that's where
23:14
everything is kind of headed in a weird
23:15
way.
23:17
>> I don't think so. I think the quantum
23:17
computers were supposed to will Yeah.
23:18
quantum computers will make it possible
23:21
will make it so that the previous
23:22
quantum previous encryption technology
23:25
is obsolete. But that's the reason why
23:28
the entire industry is working on
23:31
postquantum
23:33
encryption technology.
23:35
>> What would that look like?
23:37
>> New algorithms.
23:39
>> But the crazy thing is when you hear
23:40
about the kind of computation that
23:41
quantum computing can do.
23:44
>> Yeah.
23:45
>> And the the power that it has. Yeah.
23:46
>> Where you know you're looking at
23:47
>> all the supercomputers in the world. It
23:49
would take billions of years and it
23:51
takes them a few minutes to solve these
23:52
equations. Like how do you make
23:54
encryption for something that can do
23:56
that? I'm not sure, but there's
23:58
[laughter]
23:59
but I've got a bunch of scientists who
24:00
are working on that.
24:02
>> Boy, I hope they [snorts] could figure
24:02
it out.
24:04
>> Yeah, we got a bunch of scientists who
24:04
are expert in that. And
24:05
>> is the ultimate fear that it can't be
24:06
breached that quantum computing will
24:08
always be able to to decrypt all other
24:10
quantum computing encryption?
24:13
>> I don't think that
24:16
>> it just gets to some point where it's
24:16
like, stop playing the stupid game. We
24:18
know everything.
24:20
>> I don't think so.
24:21
>> No,
24:22
>> because I I'm you know, history is
24:22
guide.
24:25
History is a guide before AI came
24:26
around. That's my worry. My worry is
24:28
this is a totally, you know, it's like
24:30
history was one thing and then nuclear
24:31
weapons kind of changed all of our
24:33
thoughts on war and mutually assured
24:35
destruction came
24:37
everybody to stop using nuclear bombs.
24:40
>> Yeah.
24:42
>> My worry is that
24:43
>> the thing is Joe is that that AI is not
24:44
going to it's not like we're cavemen and
24:46
then all of a sudden one day AI shows
24:49
up. every single day we're getting
24:51
better and smarter because we have AI
24:54
and so we're stepping on our own AI's
24:57
shoulders. So when when that whatever
24:59
that AI threat comes, it's a click
25:01
ahead. It's not a galaxy ahead,
25:05
>> you know, it's just a click ahead. And
25:08
so so I think I think the the the idea
25:10
that somehow this AI
25:14
is going to pop out of nowhere and
25:17
somehow think in a way that we can't
25:20
even imagine thinking and do something
25:22
that we can't possibly imagine I think
25:25
is far-fetched. And the reason for that
25:28
is because we're all have we all have
25:30
AIs and you know there's a whole bunch
25:32
of AIs being in development. we know
25:34
what they are and we're using it and and
25:36
so every single day we're getting we're
25:38
close to each other.
25:40
>> But don't they do things that are very
25:42
surprising?
25:44
>> Yeah. But so you you have an AI that
25:46
does something surprising. I'm going to
25:48
have an AI and my AI looks at your AI
25:49
and goes that's not that surprising.
25:52
>> The fear for the lay person like myself
25:53
is that AI becomes sentient and makes
25:55
its own decisions
25:57
and then ultimately decides to just
25:59
govern the world. do it its own way.
26:03
They're like, "You guys, you had a good
26:06
run, but
26:08
>> we're taking over now."
26:09
>> Yeah, but my my AI is gonna take care of
26:12
me. I mean, [laughter]
26:14
so that's the this is the cyber security
26:15
argument.
26:19
>> Yes.
26:19
>> Do you have an AI and it's super smart,
26:20
but my AI is super smart, too. And and
26:23
maybe your AI. Let let's pretend let's
26:25
let's pretend for a second that we
26:28
understand what consciousness is and we
26:30
understand what sentience is and and
26:32
that in fact
26:34
>> and we really are just pretending.
26:34
>> Okay, let's just pretend for a second
26:36
that we we believe that. I don't believe
26:37
actually I don't actually don't believe
26:39
that but nonetheless we let's pretend we
26:40
believe that.
26:42
>> So your your your AI is conscious and my
26:42
AI is conscious and and let's say your
26:45
AI is you know wants to I don't know do
26:47
something surprising.
26:51
My AI is so smart that it won't it might
26:53
be surprising to me, but it probably
26:56
won't be surprising to my AI. And so
26:57
maybe my AI
27:00
thinks it's surprising as well, but it's
27:02
so smart the moment it sees it the first
27:05
time, it's not going to be a surprise
27:07
the second time, just like us. And so I
27:08
feel like I think the idea that that
27:11
only one person has [clears throat] AI
27:15
and that one person's AI is compares
27:16
everybody else's AI is Neanderthal
27:20
[snorts] is um probably unlikely. I
27:24
think it's much more like cyber
27:26
security.
27:28
>> Interesting.
27:30
>> I think the fear is not that your AI is
27:31
going to battle with somebody else's AI.
27:34
The fear is that AI is no longer going
27:36
to listen to you. That's the fear is
27:38
that human beings won't have control
27:41
over it after a certain point if it
27:42
achieves sensience and then has the
27:45
ability to be autonomous
27:47
>> that there's one AI.
27:49
>> Well, they just combine.
27:51
>> Yeah. Becomes one AI
27:53
>> that it's a life form.
27:54
>> Yeah.
27:55
>> But that's the there's arguments about
27:56
that, right? That we're dealing with
27:57
some sort of synthetic biology that it's
27:59
not as simple as new technology that
28:01
you're creating a life form.
28:03
>> If it's like life form,
28:04
let's go along with that for a while. I
28:07
think if it's like life form, as you
28:09
know, all life forms don't agree. And so
28:11
I'm going to have to go with your life
28:14
form and my life form are going to agree
28:16
because my life form is going to want to
28:18
be the super life form. And and now that
28:19
now that we have disagreeing life forms,
28:22
uh we're back back again to where we
28:25
are. Well, they would probably cooperate
28:26
with each other.
28:28
It would just the reason why we don't
28:31
cooperate with each other is we're
28:33
territorial primates.
28:35
But AI wouldn't be a territorial
28:37
primate. It would realize the folly in
28:39
that sort of thinking and it would say,
28:41
"Listen, there's plenty of energy for
28:44
everybody. We we don't need to dominate.
28:46
We don't need We're not trying to
28:49
acquire resources and take over the
28:51
world. We're not looking to find a good
28:52
breeding partner. We're just existing as
28:54
a new super life form that these cute
28:58
monkeys created for us."
29:02
Okay. Well, that would be a that would
29:04
be a um a superpower with no ego,
29:07
>> right? And and if it has no ego,
29:12
why would it have the ego to do any harm
29:17
to us?
29:19
>> Well, I don't assume that it would do
29:20
harm to us, but the the fear would be
29:22
that we would no longer have control and
29:25
that we would no longer be the apex
29:27
species on the planet. this thing that
29:30
we created would now be. [laughter]
29:32
>> Is that funny?
29:35
>> No.
29:36
>> I just think it's not gonna happen.
29:37
>> I know you think it's not gonna happen,
29:38
but
29:40
>> it could, right? And here's the other
29:41
thing is like
29:43
>> if we're racing towards could Yeah.
29:44
>> And could could be the end of human
29:46
beings being in control of our own
29:50
destiny.
29:51
>> I just think it's extremely unlikely.
29:53
>> Yeah.
29:55
>> That's what they said in the Terminator
29:55
movie [laughter]
29:57
>> and it hasn't happened.
29:58
>> No, not yet. But you guys are working
29:59
towards it. Um the the thing about
30:01
you're saying about conscience and
30:04
sensience that you don't think that AI
30:05
will achieve consciousness or that the
30:08
question is what's the definition?
30:11
>> Yeah. What's the definition of
30:12
>> what is the definition to you?
30:14
>> Um uh
30:16
consciousness
30:19
um
30:21
uh f I guess first of all uh you need to
30:23
know about your own existence.
30:26
Um,
30:31
you have to have experience, not just
30:36
knowledge and intelligence.
30:39
The concept of a machine
30:47
having an experience.
30:49
I'm not well, first of all, I don't know
30:52
what defines experience, why we have
30:54
experiences, right?
30:56
>> Yeah. and why this microphone doesn't
30:57
uh and so it I think I know I well I
31:00
think I I I think I know what
31:05
consciousness is the sense of experience
31:08
the ability to know self versus
31:11
um
31:16
uh the ability to be able to reflect
31:18
know our own self the sense of ego I
31:21
think all of all of those human
31:25
experiences
31:27
uh probably is what consciousness is
31:29
but why it exists versus
31:35
the concept of knowledge and
31:39
intelligence which is what AI is defined
31:41
by today [clears throat] it has
31:44
knowledge it has intelligence artificial
31:45
intelligence we don't call it artificial
31:48
consciousness
31:49
artificial intelligence the ability to
31:51
uh perceive believe, recognize,
31:54
understand,
31:58
um, plan,
32:00
uh, perform tasks.
32:04
Those things are foundations of
32:07
intelligence
32:09
to know things, knowledge.
32:11
I don't, it's clearly different than
32:14
consciousness.
32:17
>> But consciousness is so loosely defined.
32:18
How can we say that? I mean, doesn't a
32:20
dog have consciousness? Yeah.
32:22
>> Dogs seem to be pretty conscious.
32:23
>> That's right.
32:25
>> Yeah. So, and that's a lower level
32:25
consciousness than a human being's
32:27
consciousness.
32:29
>> I'm not sure. Yeah. Right. Well,
32:30
>> the question is what lower level
32:32
intelligence? It's lower level
32:34
intelligence, but I don't know that it's
32:35
lower level consciousness.
32:37
>> That's a good point. Right.
32:38
>> Because I believe my dogs feel as much
32:39
as I feel.
32:42
>> Yeah. They feel a lot. Right.
32:42
>> Yeah. They get attached to you. That's
32:45
right. They get depressed if you're not
32:47
there.
32:48
>> That's right. Exactly.
32:49
>> There's There's definitely that.
32:50
>> Yeah. um the the concept of experience,
32:52
>> right?
32:56
>> Um but isn't AI interacting with
32:56
society? So, doesn't it acquire
32:59
experience through that interaction?
33:01
>> Um I don't think interactions is
33:04
experience. I think experience is uh
33:06
experience is a collection of feelings.
33:10
I think
33:13
>> you're aware of that AI um I forget
33:15
which one where they gave it some false
33:17
information about one of the programmers
33:20
having an affair with his wife just to
33:22
see how it would respond to it and then
33:24
when they said they were going to shut
33:25
it down it threatened to blackmail him
33:26
and reveal his affair and it was like
33:28
whoa like it's conniving like if that's
33:31
not learning from experience and being
33:33
aware that you're about to be shut down
33:37
which would imply at least some kind of
33:38
consciousness or you could kind defined
33:40
it as consciousness if you were very
33:43
loose with the term and if you imagine
33:45
that this is going to exponentially
33:47
become more powerful. Wouldn't that
33:49
ultimately lead to a different kind of
33:52
consciousness than we're defining from
33:54
biology? Well, first of all, let's just
33:56
break down what it probably did. It
33:58
probably read somewhere. There's
34:01
probably text that that in these
34:03
consequences
34:07
certain people did that. I could imagine
34:09
a novel,
34:12
>> right?
34:12
>> Having those words related.
34:13
>> Sure.
34:16
>> And so inside
34:16
>> it realizes it strategy for survival is
34:18
>> it's just a bunch of numbers
34:20
>> that it's just a bunch of numbers that
34:22
that in the in the collection of numbers
34:24
that relates to a husband cheating on a
34:28
wife. Um
34:30
has subsequently a bunch of numbers that
34:33
relates to blackmail and such things.
34:37
However, whatever the revenge was,
34:39
>> right?
34:41
>> And so it has spewed it out.
34:42
>> And so it's just like, you know, it it's
34:44
just as if I'm asking it to write me a
34:47
poem in Shakespeare. It just whatever
34:50
the words are in the world in in that
34:52
dimensionality, this dimensionality is
34:55
all these vectors and in in
34:57
multi-dimensional space. These words
34:59
that were in the prompt that described
35:04
the affair um subsequently led to one
35:07
word after another led to um you know
35:11
some revenge and something but it's not
35:14
because it had consciousness or you know
35:16
it just spewed out those words generated
35:18
those words
35:20
>> I understand what you're saying that
35:21
patterns that human beings have
35:23
exhibited both in literature and in real
35:25
life
35:27
>> that's exactly right
35:27
>> but it at a certain point in time one
35:28
would say, "Okay, well, it couldn't do
35:30
this two years ago and it couldn't do
35:32
this four years ago." Like when we're
35:34
looking towards the future, like at what
35:36
point in time when it can do everything
35:38
a person does, what point in time do we
35:40
decide that it's conscious? If it
35:42
absolutely mimics all human thinking and
35:44
behavior patterns,
35:48
>> that doesn't make it conscious.
35:49
>> It becomes in disccernible. It's it's
35:50
aware. It can communicate with you the
35:52
exact same way a person can. Like is con
35:54
is consciousness are we putting too much
35:57
weight on that concept because it seems
35:59
like it's a version of a kind of
36:01
consciousness.
36:03
>> It's a version of imitation.
36:04
>> Imitation consciousness, right? But if
36:06
it perfectly imitates it,
36:08
>> I still think it's a per it's an example
36:10
of imitation.
36:12
>> So it's like a fake Rolex when they 3D
36:12
print them and make them
36:14
>> indestruable. The question is what's the
36:15
definition consciousness?
36:17
>> Yeah.
36:18
>> Yeah.
36:19
>> That's the question. And I don't think
36:20
anybody's really clearly defined that.
36:21
That's what get where it gets weird and
36:23
that that's where the real doomsday
36:25
people are worried that you are creating
36:27
a form of consciousness that you can't
36:29
control. I believe it is possible to
36:31
create a machine
36:35
that imitates
36:38
human intelligence
36:41
and
36:43
has the ability to
36:44
understand information,
36:47
understand
36:50
instructions, break the problem down,
36:52
solve problems, and perform tasks. I
36:54
believe that completely.
36:58
I believe that that um we could have a
37:00
computer that has a vast amount of
37:07
knowledge. Some of it true, some of it
37:09
not true.
37:12
Some of it generated by humans, some of
37:14
it generated synthetically. And more and
37:17
more of knowledge in the world will be
37:19
generated synthetically going forward.
37:23
You know, until now the knowledge that
37:25
we've we have are knowledge that we
37:27
generate and we propagate and we send to
37:31
each other and we amplify it and we add
37:33
to it and we modify it. We change it. In
37:35
the future,
37:39
in a couple of years, maybe two or three
37:42
years, 90% of the world's knowledge will
37:45
likely be generated by AI.
37:47
>> That's crazy.
37:49
>> I know. But it's just fine.
37:50
>> But it's just fine.
37:52
>> I know. And the reason for that is this.
37:53
Let me tell you why.
37:56
>> Okay?
37:57
>> It's because um what difference does it
37:57
make to me that I am learning from a
38:00
textbook that was generated by a bunch
38:04
of people I didn't know or written by a
38:06
book that you know from somebody I don't
38:10
know uh to uh knowledge generated by AI
38:12
computers that are assimilating all of
38:17
this and reynthesizing things. To me, I
38:18
don't think there's a whole lot of
38:21
difference. We still have to we still
38:22
have to fact check it. We still have to
38:24
make sure that it's you know based on
38:26
fundamental first principles and we
38:28
still have to do all of that just like
38:30
we do today.
38:31
>> Is this taking into account the kind of
38:32
AI that exists currently? And do you
38:34
anticipate that just like we could have
38:37
never really believed that AI would be
38:40
at least a person like myself would
38:42
never believe AI would be as so
38:43
ubiquitous and so worth it. It's it's so
38:45
powerful today and so important today.
38:48
We never thought that 10 years ago.
38:50
Never thought that,
38:52
>> right?
38:53
>> You imagine like what are we looking at
38:53
10 years from now?
38:55
>> I I think that if you reflect back 10
39:00
years from now, you would say the same
39:03
thing that we would have never believed
39:05
that
39:07
>> but
39:08
>> in a different direction,
39:08
>> right? But if you if you go forward 9
39:09
years from now
39:12
and then ask yourself what's going to
39:15
happen 10 years from now, I think it'll
39:17
be quite gradual. Um, one of the things
39:19
that Elon said that makes me happy is he
39:22
he's he believes that we're going to get
39:25
to a point where it's not
39:28
it's not necessary for people to work
39:31
and not meaning that you're going to
39:34
have no purpose in life, but you will
39:37
have in his words universal high income
39:39
because so much revenue is generated by
39:42
AI that it will take away this need for
39:44
people to do things that they don't
39:50
really enjoy doing just for money. And I
39:52
think a lot of people have a problem
39:54
with that because their entire identity
39:56
and who how they think of themselves and
39:59
how they fit in the community is what
40:01
they do. Like this is Mike. He's an
40:02
amazing mechanic. Go to Mike and Mike
40:04
takes care of things. But there's going
40:06
to come a point in time where AI is
40:08
going to be able to do all those things
40:11
much better than than people do. And
40:12
people will just be able to receive
40:14
money. But then what does Mike do? Mike
40:16
is, you know, really loves being the
40:18
best mechanic around. You know, what
40:21
does the guy who, you know,
40:23
codes, what does he do when AI can code
40:26
infinitely faster with zero errors? Like
40:29
what what happens with all those people?
40:32
And that is where it gets weird. It's
40:34
like because we've sort of wrapped our
40:37
identity as human beings around what we
40:38
do for a living.
40:41
>> You know, when you meet someone, one of
40:42
the first things you meet somebody at a
40:44
party, hi Joe. What's your name? Mike.
40:45
What do you do? Mike and you know Mike's
40:47
like, "Oh, I'm a lawyer." "Oh, what kind
40:49
of law?" And you have a conversation,
40:50
you know, when Mike is like, "I get
40:52
money from the government. I play video
40:54
games."
40:55
>> Gets weird.
40:56
>> Mhm.
40:57
>> And I think um the concept sounds great
40:57
until you take into account human
41:01
nature. And human nature is that we like
41:03
to have puzzles to solve and things to
41:06
do and and an identity that's wrapped
41:08
around our idea that we're very good at
41:10
this thing that we do for a living.
41:13
>> Yeah. Yeah, I think um let's see, let me
41:16
start with the more mundane and I'll
41:20
work work backwards, okay? Work forward.
41:21
Uh so one of the predictions from uh
41:24
Jeff Hinton who who started the whole
41:30
deep learning phenomenon the deep
41:33
learning technology trend
41:36
and uh in incredible incredible
41:38
researcher uh professor at University of
41:41
Toronto
41:44
uh he invented discovered or invented
41:45
the the idea of of back propagation
41:48
which which uh allows the neural network
41:51
to learn.
41:54
And um
41:56
and as as as you know uh for for the
42:00
audience,
42:03
software historically was humans
42:05
applying first principles and our
42:08
thinking to uh describe an algorithm
42:10
that is then codified just like a recipe
42:15
that's codified in software. It looks
42:19
just like a recipe. how to cook
42:22
something looks exactly the same just in
42:23
a slightly different language. We call
42:25
it Python or C or C++ or whatever it is.
42:27
In the case of deep learning, this
42:32
invention of artificial intelligence,
42:35
we put a structure of a whole bunch of
42:37
neural networks and a whole bunch of
42:40
math units
42:43
and we make this large structure. It's
42:45
like a switchboard of little
42:49
u mathematical units and we connect it
42:53
all together.
42:55
Um, and we give it the input that
42:57
the software would eventually receive
43:03
and we just let it randomly guess what
43:06
the output is. And so we say, for
43:10
example, the input could be a picture of
43:12
a cat.
43:15
And and um one of the outputs of the
43:17
switchboard is where the cat signal is
43:20
supposed to show up. And all of the
43:23
other signals, the other one's a dog,
43:25
the other one's an elephant, the other
43:28
one's a tiger.
43:29
And all of the other signals are
43:31
supposed to be zero when I show it a
43:33
cat. And the one that is a cat should be
43:35
one.
43:38
And I show at a cat through this big
43:40
huge network of switchboards and math
43:43
units and they're just doing multiply
43:46
and adds multiplies and ads. Okay?
43:49
And and uh and this thing, this
43:53
switchboard is gigantic.
43:55
The more information you're going to
43:58
give it, the more the bigger this
43:59
switchboard has to be. And what Jeff
44:01
Hinton discovered was a invented was a
44:03
way for you to
44:06
guess that put the cat signal in put the
44:09
cat image in and that cat image you know
44:11
could be a million numbers because it's
44:15
you know a megapixel image for example
44:18
and it's just a whole a whole bunch of
44:20
numbers and somehow from those numbers
44:22
it has to light up the cat signal. Okay,
44:26
that's the bottom line. And if it the
44:29
first time you do it, it just comes up
44:33
with garbage. And so it says the right
44:35
answer is cat. And so you need to
44:39
increase this signal and decrease all of
44:43
the other and back propagates the
44:45
outcome through the entire network. And
44:48
then you show another. Now it's an image
44:51
of a dog and it guesses it takes a swing
44:54
at it and it comes up with a bunch of
44:58
garbage and you say no no no the answer
45:00
is this is a dog I want you to produce
45:03
dog and all of the other switch all the
45:05
other outputs have to be zero and I want
45:09
to back propagate that and just do it
45:11
over and over and over again. It's just
45:14
like uh showing a a kid this is an
45:16
apple, this is a dog, this is a cat. And
45:18
you just keep showing it to them until
45:20
they eventually get it. Okay. Well,
45:22
anyways, that big invention is deep
45:25
learning. That's the foundation of
45:26
artificial intelligence, a piece of
45:28
software
45:31
that learns from examples. That's
45:33
basically we machine learning, a machine
45:36
that learns. Uh and so so one of the the
45:38
big
45:42
first
45:44
applications was image recognition and
45:46
one of the most important image
45:48
recognition applications is radiology.
45:50
>> And so so uh uh he predicted uh about 5
45:53
years ago that in five years time the
45:59
world won't need any radiologists
46:02
because AI would have swept the whole
46:05
field.
46:06
Well, it turns out AI has swept the
46:08
whole field. That is completely true.
46:10
Today, just about every radiologist is
46:13
using AI in some way. And what's ironic
46:16
though, what's what's interesting is
46:20
that the number of radiologist has
46:22
actually grown.
46:24
And so the question is why? That's kind
46:27
of interesting, right?
46:30
>> It is. And so the prediction was in fact
46:31
that
46:34
30 million radiologists will be wiped
46:36
out.
46:38
But as it turns out, we needed more. And
46:40
the reason for that
46:42
[clears throat and cough]
46:43
is because the purpose of a radiologist
46:44
is to diagnose disease,
46:47
not to study the image. This the image
46:49
studying is simply a task to in service
46:51
of diagnosing the disease. And so now
46:57
the fact that you could study the images
47:01
more quickly and more precisely
47:04
without ever making a mistake and never
47:07
gets tired.
47:08
You could study more images. You could
47:10
study it in
47:13
3D form instead of 2D because you know
47:15
the AI doesn't care whether it studies
47:19
images in 3D or 2D. You could study it
47:20
in 4D. And so the now you could study
47:23
images in a way that radiologist
47:26
radiologists can't easily do and you
47:28
could study a lot more of it. And so the
47:31
number of tests that people are able to
47:33
do increases and because they're able to
47:35
serve more patients, the hospital does
47:38
better. They have more clients, more
47:42
patients. As a result, they have better
47:44
economics. When they have better
47:46
economics, they hire more radiologists
47:48
because their purpose is not to study
47:50
the images. their purpose is to diagnose
47:52
disease. And so the question is the what
47:55
I'm leading up to is ultimately what is
47:58
the purpose? What is the purpose of the
48:00
lawyer? And has the purpose changed?
48:03
What is the purpose? You know, one of
48:07
the examples that I gave is is um that I
48:09
would give is for example uh if my car
48:11
became self-driving
48:15
will all chauffeers be out of jobs? The
48:17
answer probably is not because for some
48:20
per for some chauffeers they for some
48:22
people who are driving you they could be
48:25
protectors some people um they're part
48:26
of the experience part of the service so
48:29
when you get there they you know they
48:31
could take care of things for you and so
48:33
for a lot of different reasons not all
48:35
chauffeers would lose their jobs some
48:37
chauffeers would lose their jobs and uh
48:40
many chauffeers would change their jobs
48:42
and the type of applications of
48:45
autonomous vehicles will probably
48:47
increase you know the usage of the
48:49
technology within find new homes and so
48:51
I I think you have to go back to what is
48:54
the purpose of a job you know like for
48:56
example if AI comes along I actually
48:58
don't believe I'm going to lose my job
49:00
because my purpose isn't to I have to
49:01
look at a lot of documents I study a lot
49:05
of emails I look at a bunch of diagrams
49:08
you know um the question is what is the
49:11
job and and uh the purpose of somebody
49:14
probably hasn't changed a lawyer for
49:17
example help people that probably hasn't
49:19
changed studying legal documents
49:21
generating documents it's part of the
49:23
job not the job
49:26
>> but don't you think there's many jobs
49:27
that AI will replace
49:29
>> if your job is automation
49:31
>> yeah if your job is the task
49:33
>> right so automation
49:35
>> yeah factor if your job is the task
49:36
>> that's a lot of people
49:39
>> it could be a lot of people but it'll
49:40
probably generate like for example
49:42
>> uh let's say we let's say I'm super
49:45
excited about the the the robots Elon's
49:47
working on.
49:50
It's still a few years away.
49:52
When it happens, when it happens,
49:54
um
49:58
there's a whole new industry of
50:00
technicians and people who have to
50:02
manufacture the robots, right?
50:05
>> Mhm.
50:06
>> And so that that job never existed. And
50:07
so you're going to have a whole industry
50:10
of people taking care of like for
50:12
example, you know, all the mechanics and
50:15
all the people who are building things
50:17
for cars, supercharging cars, uh that
50:18
didn't exist before cars and now we're
50:23
going to have robots. You're going to
50:24
have robot apparel. So a whole industry
50:26
of [laughter] Right. Isn't that right?
50:29
Because I want my robot to look
50:30
different than your robot.
50:31
>> Oh god.
50:32
>> And so [laughter] you're going to you're
50:33
going to have a whole, you know, apparel
50:35
industry for robots. You're going to
50:36
have mechanics for robots and you have
50:38
you know people who comes and maintain
50:40
your robots
50:42
>> automated though.
50:43
>> No,
50:43
>> you don't think so? You don't think
50:44
[clears throat] they'll be all done by
50:45
other robots
50:46
>> eventually? And then there'll be
50:47
something else.
50:49
>> So you think ultimately people just
50:50
adapt except if you are the task
50:52
>> which is a large percentage of the
50:56
workforce.
50:58
>> If your job is just to chop vegetables,
50:59
quezin art is going to replace you.
51:01
>> Yeah. So people have to find meaning in
51:02
other things. Your job has to be more
51:05
than the task.
51:07
>> What do you think about Elon's belief
51:08
that this universal basic income thing
51:10
will eventually become necessary?
51:13
>> Many people think that. Andrew Yang
51:18
thinks that
51:19
>> he was one of the first people to sort
51:21
of sound that alarm during the the 2020
51:22
election.
51:24
Yeah, I I guess um
51:30
yeah, both ideas probably won't exist at
51:34
the same time and and um as in life,
51:37
things will probably be in the middle.
51:40
One idea, of course, is that there'll be
51:42
so much abundance of resource that
51:45
nobody needs a job and we'll all be
51:47
wealthy.
51:49
On the other hand, um we're going to
51:51
need universal basic income. Both ideas
51:54
don't exist at the same time,
51:57
>> right?
51:59
>> And so we're either going to be all
52:00
wealthy or we're going to be all
52:01
>> How could everybody be wealthy though?
52:04
But
52:05
>> because scenario wealthy not because you
52:06
have a lot of dollars, wealthy because
52:08
there's a lot of abundance. Like for
52:09
example, today we are wealthy of
52:11
information.
52:14
You know, this is some a concept several
52:16
thousand years ago only a few people
52:17
have. And so, uh, today we have wealth
52:20
of a whole bunch of things, resources
52:23
that that historic point. Yeah. And so,
52:25
we're going to have wealth of resources,
52:27
things that we think are valuable today
52:29
that in the future are just not not that
52:32
valuable, you know, and so it because
52:34
it's automated. And so I think I think
52:36
the question
52:39
maybe maybe partly it's hard to answer
52:41
partly because
52:45
it's hard to talk about infinity and
52:48
it's hard to talk about a long time from
52:50
now and and the reason for that is
52:51
because
52:54
there's just too many scenarios to to
52:57
consider. But I think it I think in the
52:59
next several years, call it 5 to 10
53:01
years,
53:03
there are several things that I I
53:06
believe in hope. Um, and I say hope
53:08
because I'm not sure. One of the things
53:11
that I believe is that the technology
53:13
divide will be substantially collapsed.
53:16
And of course the alternative
53:22
viewpoint is that AI is going to
53:26
increase the technology divide.
53:29
Now the reason why I believe AI is going
53:32
to reduce the technology divide.
53:34
I is because we have proof
53:37
the evidence is that AI is the easiest
53:40
application in the world to use. Chat
53:43
GPT has grown to almost a billion users
53:45
frankly practically overnight. And if
53:48
you're not exactly sure how to use,
53:51
everybody knows how to use chatpt. Just
53:53
say something to it. If you're not sure
53:54
how to use chatpt, you ask chatd how to
53:56
use it. No tool in history has ever had
53:59
this capability. A quez an art, you
54:03
know, if you don't know how to use it,
54:06
you're kind of screwed. You're going to
54:07
walk up to it and say, "How do you use a
54:09
quezin art?" You're going to have to
54:10
find somebody else. And so, but an AI
54:11
will just tell you exactly how to do it.
54:14
Anybody could do this. It'll speak to
54:16
you in any language. And if it doesn't
54:18
know your language, you'll speak it in
54:20
that language and it'll probably figure
54:22
out that it doesn't completely
54:24
understand your language. Go learns it
54:25
instantly and comes back and talk to
54:28
you. And so I think the the technology
54:29
divide has a real chance finally that
54:32
you don't have to speak Python or C++ or
54:35
forran. You can just speak human and
54:38
whatever form of human you like. And so
54:41
I think that that has a real chance of
54:43
closing the technology divine. Now, of
54:45
course, the counternarrative would say
54:48
that
54:51
AI is only going to be available for the
54:53
nations and the countries that have a
54:58
vast amount of resources because AI
55:00
takes energy
55:02
and AI takes um a lot of GPUs and
55:04
factories to be able to produce the AI.
55:08
No doubt at the scale that we would like
55:11
to do in the United States. But the fact
55:13
of the matter is your phone's going to
55:15
run AI just fine all by itself, you
55:17
know, in a few years. Today, it already
55:21
does it fairly decently. And so the the
55:23
the fact that every every country, every
55:26
nation, every every society will have
55:29
the benefit of very good AI. It might
55:32
not be tomorrow's AI. It might be
55:34
yesterday's AI, but yesterday's AI is
55:36
freaking amazing. You know, in 10 years
55:39
time, 9year-old AI is going to be
55:41
amazing. You don't need, you know, 10
55:43
year old AI. You don't need frontier AI
55:45
like we need frontier AI because we want
55:48
to be the world leader. But for every
55:50
single country, everybody, I think the
55:52
ele the capability to elevate
55:54
everybody's knowledge and capability and
55:56
intelligence, uh, that day is coming.
55:58
The octagon isn't just in Las Vegas
56:00
anymore. It's right in your hands with
56:02
DraftKings Sportsbook, the official
56:04
sports betting partner of UFC. Get ready
56:06
because when Dwabish Willie and Yan face
56:09
off again at UFC 323, every punch, every
56:12
takedown, every finish, it all has the
56:16
potential to pay off in real time. New
56:19
customers bet just $5. And if your bet
56:21
wins, you get paid $200 in bonus bets.
56:24
And hey, Missouri, the wait is over.
56:27
DraftKings Sportsbook is now live in the
56:29
Show Me State. Download the DraftKings
56:32
Sportsbook app and use promo code Rogan.
56:34
That's code Rogan to turn five bucks
56:37
into 200 in bonus bets if your bet wins.
56:39
In partnership with DraftKings, the
56:43
crown is yours. Gambling problem? Call
56:45
1800 gambler. In New York, call 8778
56:47
wire or text hope 467-369. In
56:50
Connecticut, help is available for a
56:53
problem gambling. Call 888789-7777
56:54
or visit ccpg.org. Please play
56:57
responsibly. On behalf of Bootill Casino
57:00
and Resort in Kansas, pass through of
57:01
per wager tax may apply in Illinois. 21
57:03
and over. Age and eligibility varies by
57:05
jurisdiction void in Ontario.
57:07
Restrictions apply. Bet must win to
57:08
receive bonus bets which expire in 7
57:10
days. Minimum odds required. For
57:11
additional terms and responsible gaming
57:13
resources, see dkg.co/audio.
57:14
Limited time offer.
57:17
>> And also energy production, which is the
57:19
real bottleneck when it comes to third
57:22
world countries and
57:24
>> that's right,
57:25
>> electricity and all all the resources
57:26
that we take for granted.
57:29
>> Almost everything is going to be energy
57:31
constrained. And so if you take a look
57:32
at um
57:35
one of the most important technology
57:37
advances in history is this idea called
57:39
Moore's law. Moore's law
57:41
was the started basically in my
57:45
generation
57:48
and my generation is the generation of
57:50
computers. I graduated in 1984 and that
57:52
was basically at the very beginning of
57:56
the PC revolution.
57:58
And the microprocessor and and um
58:01
every single year it approximately
58:06
doubled
58:08
and we describe it as every single year
58:10
we double the performance. But what it
58:12
really means is that every single year
58:14
the cost of computing halfed.
58:17
And so the cost of computing in the
58:20
course of five years reduced by a factor
58:24
of 10. The amount of energy necessary to
58:27
do computing to do any task reduced by a
58:31
factor of 10. Every single 10 years 100
58:33
a th00and 10,000
58:38
100,000 so on and so forth. And so each
58:41
one of
58:45
the clicks of Moore's law, the amount of
58:47
energy necessary to do any computing
58:49
reduced. That's the reason why you have
58:51
a laptop today when back in 1984 sat on
58:53
the desk, you got to plug in, it wasn't
58:57
that fast and it consumed a lot of
58:59
power. Today, you know, it is only a few
59:01
watts. And so Moore's law is the
59:03
fundamental technology, the fundamental
59:06
technology trend that made it possible.
59:08
Well, what's going on in AI? The reason
59:10
why Nvidia is here is because in we
59:12
invented this new way of doing
59:14
computing. We call it accelerated
59:16
computing. We started it 33 years ago.
59:17
Took us about 30 years to really made a
59:19
huge breakthrough. In that in that 30
59:22
years or so
59:25
we took computing you know probably a
59:27
factor of well let me just say in last
59:31
10 years the last 10 years we improved
59:33
the performance of computing by 100,000
59:36
times.
59:40
Whoa. Imagine a car over the course of
59:41
10 years that became a 100,000 times
59:44
faster or at the same speed 100,000
59:46
times cheaper or at the same speed
59:50
100,000 times less energy. If your car
59:54
did that, it doesn't need energy at all.
59:57
What I mean what what I'm trying to say
00:00
is that in 10 years time the amount of
00:02
energy necessary for artificial
00:06
intelligence for most people will be
00:08
minuscule
00:10
utterly minuscule and so we'll have AI
00:12
running in all kinds of things and all
00:15
the time because it doesn't consume that
00:16
much energy and so if you're a nation
00:18
that uses AI for you know almost
00:21
everything in your social fabric of
00:24
course you're going to need these AI
00:26
factories but for a lot of countries I
00:27
think you're going You're going to have
00:29
excellent AI and you're not going to
00:30
need as much energy. Everybody will be
00:32
able to come along is my point.
00:34
>> So currently that that is a big
00:36
bottleneck, right? Is energy.
00:38
>> Yeah, it is the bottleneck.
00:40
>> The bottleneck is this. So was it Google
00:41
that is making nuclear power plants to
00:43
operate one of its AI factories?
00:47
>> Oh, I haven't heard that. But I think in
00:50
the next six, seven years, I think
00:51
you're going to see a whole bunch of
00:53
small nuclear reactors.
00:55
>> And by small, like how big are you
00:57
talking about? Hundreds of megawws.
00:58
Yeah.
01:00
>> Okay. And that these will be local to
01:01
whatever specific company they have.
01:04
>> That's right. Will all be power
01:06
generators.
01:07
>> Whoa.
01:08
>> You know, just like just like your you
01:09
know, somebody's farm.
01:12
>> It probably is the smartest way to do
01:13
it, right?
01:15
>> And it takes the burden off Yeah. takes
01:16
the burden off the grid. It takes and
01:18
you could build as much as you need
01:20
>> and you can contribute back to the grid.
01:22
It's a really important point that I
01:24
think you just made about Moore's law
01:25
and the relationship to pricing because
01:27
you know a laptop today like you can get
01:31
one of those little Mac MacBook Airs.
01:32
They're incredible. They're so thin,
01:34
unbelievably powerful. Battery life is
01:36
charge it.
01:38
>> Yeah. Battery [laughter] life's crazy.
01:39
And uh it's not that expensive
01:40
relatively speaking. Like something like
01:43
that.
01:44
>> I remember.
01:45
>> And that's just Moore's law, right?
01:45
>> Then there's the Nvidia law.
01:47
>> Oh,
01:49
>> just right. the the the law I was
01:49
talking to you about, the computing that
01:51
we invented,
01:53
>> right?
01:54
>> The reason why we're here, this new this
01:54
new way of doing computing
01:57
>> is like Mo's law on energy drinks. I
01:59
mean, it's [laughter]
02:02
it's like Mo's law
02:04
it's it's like Yeah. Moore's law and Joe
02:07
Rogan.
02:09
>> Wow. That's interesting.
02:10
>> Yeah. That's us.
02:12
>> So, explain that. Um this this chip that
02:13
you brought to Elon, what what's the
02:16
significance of this? It's like why is
02:18
it so superior? And so
02:19
in 2012, Jeff Hinton's lab, this
02:23
gentleman I was talking talking about,
02:26
um Ilas Suscober, Alex Kresevski, um
02:29
they made a breakthrough in computer
02:34
vision in literally creating a
02:37
piece of software
02:42
called Alexnet.
02:44
And its job was to recognize images. And
02:47
it recognized images
02:50
at a c at a level computer vision which
02:52
is fundamental to intelligence. If you
02:55
can't perceive, you can't it's hard to
02:57
have intelligence. And so computer
02:59
vision is a fundamental pillar of not
03:01
the only but fundamental pillar of. And
03:03
so breaking
03:05
computer vision or breaking through in
03:07
computer vision is pretty foundational
03:10
to almost everything that everybody
03:11
wants to do in AI. And so in 2012,
03:13
their lab in Toronto
03:17
uh made this made this breakthrough
03:20
called Alexnet. And Alexet was able to
03:23
recognize images
03:26
so much better than any human created
03:29
computer vision algorithm in the 30
03:33
years prior. So all of these people, all
03:36
these scientists and we had many too
03:39
working on computer vision algorithms
03:42
and these two kids, Ilia and Alex under
03:45
the the uh
03:49
under under uh Jeff Hinton took a giant
03:51
leap above it and it was based on this
03:55
thing called Alexet this neural network.
03:58
And the way it ran,
04:01
the way they they made it work was
04:03
literally buying two Nvidia graphics
04:06
cards
04:08
because Nvidia Nvidia's GPUs we've been
04:09
working on this new way of doing
04:12
computing and our GPUs application
04:14
and it's basically a supercomputing
04:18
application to back in 1984
04:20
in order to
04:25
process computer games and what you have
04:28
in your racing simulator that is called
04:31
an image generator supercomputer.
04:34
And so Nvidia started our first
04:37
application was computer graphics and we
04:40
applied this new way of doing computing
04:43
where we do things in parallel in
04:46
instead of sequentially. A CPU does
04:47
things sequentially. Step one, step two,
04:50
step three. In our case, we break the
04:52
problem down and we give it to thousands
04:55
of processors.
04:58
And so our way of doing computation
05:00
is much more complicated.
05:05
But if you're able to formulate the
05:08
problem in the way that we
05:11
created called CUDA, this is the
05:14
invention of our company. If you could
05:16
formulate it in that way, we could
05:18
process everything simultaneously.
05:20
Now, in the case of computer graphics,
05:23
it's easier to do because every single
05:25
pixel on your screen is not related to
05:28
every other pixel. And so, I could
05:31
render multiple parts of the screen at
05:33
the same time. Not not completely true
05:36
because, you know, maybe maybe the way
05:39
lighting works or the way shadow works,
05:41
there's a lot of dependency and and
05:43
such. But computer graphics with all the
05:44
dis with all the pixels, I should be
05:48
able to process everything
05:50
simultaneously. And so we we took
05:51
this embarrassingly parallel problem
05:54
called computer graphics and we applied
05:56
it to this new way of doing computing.
05:58
Nvidia's Nvidia's accelerated computing.
06:01
We put it in all of our graphics cards.
06:05
Kids were buying it to play games. We're
06:08
you probably don't know this, but we're
06:11
the largest gaming platform in the world
06:13
today.
06:15
>> Oh, I know that. Oh,
06:15
>> okay.
06:16
>> I used to make my own computers. I used
06:16
to buy your graphics cards.
06:18
>> Oh, that's super cool.
06:19
>> Yeah. [laughter] set up SLI with two
06:20
graphics cards.
06:22
>> Yeah, I love it. Okay, that's super
06:23
cool.
06:24
>> Oh, yeah, man. I used to be a Quake
06:24
junkie.
06:26
>> Oh, that's cool.
06:26
>> Yeah.
06:27
>> Okay, so SLI, I'll tell you the story in
06:28
just a second and how it led to Elon.
06:30
I'm still answering the question. And
06:33
so, anyways, these these two kids
06:35
trained this model using the technique I
06:38
described earlier on our GPUs because
06:40
our GPUs could process things in
06:42
parallel. It's essentially a supercomput
06:44
in a PC. The reason why you used it for
06:48
Quake is because it is the first
06:51
consumer supercomputer. Okay. And so
06:54
anyways,
06:56
they made that breakthrough. We were
06:59
working on computer vision at the time.
07:00
It caught my attention
07:02
and so we went to learn about it.
07:05
Simultaneously this deep learning
07:08
phenomenon was happening all over all
07:10
over the country. Universities after
07:12
another recognized the importance of
07:14
deep learning and all of this work was
07:16
happening at Stanford, at Harvard, at
07:19
Berkeley, just all over the place. New
07:21
York University, L Yan Lakun, Andrew
07:24
Yang at Stanford, so many different
07:27
places. And I see it cropping up
07:29
everywhere.
07:32
And so my curiosity asked, you know,
07:34
what is so special about this form of
07:38
machine learning? And we've known about
07:40
machine learning for a very long time.
07:42
We've known about AI for a very long
07:43
time. We've known about neural networks
07:45
for a very long time. What makes now the
07:46
moment? And so we realized that this
07:50
architecture for deep neural networks
07:54
back propagation the way deep neuronet
07:56
networks were created. We could probably
07:59
scale this problem, scale the solution
08:02
to solve many problems.
08:05
that is essentially
08:08
a universal function approximator. Okay?
08:10
Meaning meaning you know back when
08:13
you're in in in school you have a you
08:16
have a you have a box inside of it is a
08:18
function you give it an input it gives
08:21
you an output and and the the reason why
08:23
I call it universal function
08:26
approximator
08:27
is that this computer instead of you
08:29
describing the function a function could
08:31
be a new equation fals ma that's a
08:34
function you write the function in
08:37
software you give it input f mass
08:39
acceleration, it'll tell you the force.
08:43
Okay? And
08:45
the way this computer works is really
08:48
interesting.
08:50
You give it a universal function. It's
08:52
not fals, just a universal function.
08:55
It's a big huge deep neural network
08:57
and instead of describing the inside,
09:01
you give it examples of input and output
09:05
and it figures out the inside.
09:08
So you give it input and output and it
09:11
figures out the inside. A universal
09:13
function approximator. Today it could be
09:15
Newton's equation. Tomorrow it could be
09:17
Maxwell's equation. It could be Kulum's
09:19
law. It could be thermodynamics
09:22
equation. It could be you know
09:24
Shingers's equation for quantum physics.
09:25
And so you could put any you could have
09:28
this describe almost anything so long as
09:30
you have the input and the output. So
09:33
long as you have the input and the
09:36
output or it could learn the input and
09:37
output.
09:39
>> And so we took a step back and we said,
09:40
"Hang on a second. This isn't just for
09:42
computer vision. Deep learning could
09:46
solve any problem.
09:48
All the problems that are interesting so
09:50
long as we have input and output. Now
09:52
what has input and output?
09:55
Well, the world. The world has input and
09:58
output. And so we could have a computer
10:01
that could learn almost anything.
10:03
Machine learning, artificial
10:05
intelligence. And so we reasoned that
10:07
maybe this is the fundamental
10:09
breakthrough that we needed. There were
10:11
a couple of things that had to be
10:14
solved. For example, we had to believe
10:15
that you could actually scale this up to
10:17
giant systems. It was running in a they
10:19
had two graphics cards, two GTX 580s,
10:22
[laughter]
10:26
which by the way is exactly your SLI
10:28
configuration. Yeah. Okay. So, that GTX
10:30
5880 SLI was the revolutionary computer
10:34
that put deep learning on the map.
10:38
>> Wow.
10:41
>> It was 2018 and you were using it to
10:41
play Quake.
10:44
>> Wow. That's crazy.
10:45
>> That was the moment. That was the big
10:46
bang of modern AI. We were lucky because
10:48
we were inventing this technology, this
10:52
computing approach. We were lucky that
10:54
they found it.
10:56
Turns out they were gamers and it was
10:58
lucky they found it. And it it was lucky
11:00
that we paid attention to that moment.
11:03
It was a little bit like, you know, that
11:06
Star Trek,
11:10
you know, first contact.
11:12
The Vulcans had to have seen the warp
11:16
drive at that very moment. If they
11:18
didn't witness the warp drive, you know,
11:20
they would have never come to Earth and
11:23
everything would have never happened.
11:26
It's a little bit like if I hadn't paid
11:28
attention to that moment, that flash.
11:29
And that flash didn't last long. If I
11:31
hadn't paid attention to that flash or
11:34
our company didn't pay attention to it,
11:35
who knows what would have happened, but
11:38
we saw that and we reasoned our way into
11:40
this is a this is a universal function
11:42
approximator. This is not just a
11:44
computer vision approximator. We could
11:46
use this for all kinds of things. if we
11:48
could solve two problems. The first
11:50
problem is that we have to prove to
11:51
oursel it could scale. The second
11:53
problem we had to
11:56
wait for I guess contribute to and wait
12:01
for is
12:04
the world will never have enough data
12:08
on input and output where we could
12:11
supervise
12:15
the AI to learn everything. For example,
12:16
if we have to supervise our children on
12:19
everything they learn, the amount of
12:21
information they could learn is limited.
12:24
We needed the AI, we needed the computer
12:26
to have a method of learning without
12:28
supervision.
12:31
And that's where we had to wait a few
12:33
more years, but un unsupervised
12:35
AI learning is now here. And so the AI
12:38
could learn by itself. And and the
12:41
reason why the AI could learn by itself
12:44
is because we have many examples of
12:45
right answers. Like for example,
12:48
if I want to learn uh if I want to teach
12:51
an AI how to predict the next word, I
12:54
could just grab it, grab a whole bunch
12:57
of text we already have, mask out the
12:59
last word and make it try and try and
13:01
try again until it predicts the next
13:04
one. or I mask out random words inside
13:06
inside the text and I make it try and
13:09
try and try until it predicts it. You
13:11
know, like uh Mary uh Mary goes down to
13:12
the bank. Is it a river bank or a money
13:17
bank? Well, if you're going to go down
13:21
to the bank, it's probably a river bank.
13:23
Okay. So, and it it it might not be
13:25
obvious even from that. It might need
13:27
and
13:31
uh and uh and caught a fish. Okay. Now
13:32
you know it's must be the riverbank. And
13:36
so so you give you give these AIs a
13:38
whole bunch of these examples and you
13:41
mask out the words, it'll predict the
13:42
next one. Okay? And so unsupervised
13:44
learning came along. These two ideas,
13:47
the fact that it's scalable and
13:49
unsupervised learning came along.
13:50
We were convinced that we ought to put
13:53
everything into this and help create
13:56
this industry because we're going to
13:58
solve a whole bunch of interesting
14:00
problems. And that was in 2012. By 2016,
14:01
I had I had built this computer called
14:06
the DGX1. The one that you saw me give
14:08
to Elon is called DGX Spark. The DGX1
14:11
was $300,000.
14:17
It cost Nvidia a few billion dollars to
14:20
make the first one.
14:22
And instead of two chips SLI,
14:25
we connected eight chips with a
14:30
technology called MVLink, but it's
14:32
basically SLI supercharged.
14:34
Okay.
14:38
>> Okay.
14:38
>> And so we connected eight of these chips
14:38
together instead of just two. And all of
14:40
them work together just like your Quake
14:43
rig did to solve this deep learning
14:46
problem to train this model. And so I
14:49
create we created this thing. I
14:52
announced it at GTC
14:54
and at one of our annual annual events
14:56
and I described this deep learning
15:00
thing, computer vision thing and this
15:01
computer called DJX1.
15:05
The audience was like completely silent.
15:07
They had no idea what I was talking
15:09
about. [laughter]
15:11
And I was lucky because I I had known
15:14
Elon and uh uh I helped him build the
15:17
first computer for Model 3
15:21
uh uh the Model S. And uh and when he
15:23
wanted to start working on autonomous
15:27
vehicle, I helped him build the computer
15:29
that went into the the Model S AV
15:31
system, his full full self-driving
15:34
system. We were basically the FSD
15:36
computer version one. And so
15:40
we we're already working together and um
15:44
when I announced this thing, nobody in
15:47
the world wanted it. I had no purchase
15:50
orders. Not not one. Nobody wanted to
15:52
buy it. Nobody wanted to be part of it
15:54
except for Elon. He goes, he was at the
15:57
event and we were doing a fireside chat
16:00
about the future of self-driving cars.
16:02
I think it's like 2016. Yeah, 20 maybe
16:06
at that time it was 2015. and he goes,
16:09
"You know what?
16:12
I have a company that could really use
16:14
this."
16:16
I said, "Wow, my first customer." And
16:17
so, so I was pretty excited about it.
16:20
And he goes, "Uh, yeah. Uh, we have this
16:23
company. It's a nonprofit company."
16:26
And all the blood drained out of my
16:30
face. Yeah. [laughter]
16:32
I just spent a few billion dollars
16:34
building this thing. Cost $300,000. and
16:36
you know the chances of a nonprofit
16:40
being able to pay for this thing is
16:43
approximately zero. And he goes, you
16:44
know, this is a it's an AI company and
16:46
uh it's a nonprofit and and uh we could
16:48
really use one of these supercomputers.
16:52
And so I I picked it up. I built the
16:54
first one for ourselves. We're using it
16:57
inside the company. I boxed one up. I
16:58
drove it up to San Francisco and I
17:01
delivered to Elon in 2016. A bunch of
17:02
researchers were were there.
17:05
Peter Beiel was there, Ilia was there,
17:08
and there was a bunch of people there.
17:10
And uh I walk up to the second floor
17:12
where they were all kind of in a room
17:15
this smaller than your place here. And
17:17
and uh uh that place turned out to have
17:20
been open AI
17:23
>> 2016.
17:25
>> Wow.
17:26
>> Just a bunch of people sitting in a
17:26
room.
17:29
>> It's not really uh nonprofit anymore,
17:30
though, is it?
17:32
>> They're not They're not nonprofit
17:33
anymore. Yeah.
17:34
>> Weird how that works.
17:35
>> Yeah. Yeah. But anyhow, anyhow, Elon was
17:36
there. The Yeah, it was it was really a
17:39
great great moment.
17:41
>> Oh, yeah. There you go. Yeah, that's it.
17:42
[laughter]
17:45
>> Look at you, bro. Same jacket.
17:45
>> Look at that. I haven't aged.
17:48
>> Not not a lick of black hair, though.
17:50
>> Uh the size of it is uh it's
17:53
significantly smaller. That was the
17:56
other day. SpaceX.
17:57
>> Oh, yeah. There you go.
17:59
>> Yeah. Look at the difference.
18:00
>> Exactly the same industrial design. He's
18:01
holding it in his hand
18:03
>> here. Here's the amazing thing. DJX1 was
18:06
one pedlops. Okay, that's a lot of
18:10
flops. And DJX Spark is one pedlops.
18:14
Nine years later.
18:20
>> Wow.
18:22
>> The same the same amount of computing
18:23
horsepower
18:25
>> in a much smaller
18:26
>> shrunken down. Yeah.
18:27
>> And instead of $300,000, it's now
18:28
$4,000. And it's the size of a small
18:31
book.
18:33
>> Incredible.
18:34
>> Crazy.
18:35
>> That's how technology moves. Anyways,
18:37
that's the reason why I wanted to get
18:38
give him the first one
18:40
>> because I gave him the first one 2016.
18:41
>> It's so fascinating. I mean you if you
18:43
wanted to make a story for a film I mean
18:45
that would be the story that like what
18:49
what better scenario if if if it really
18:52
does become a digital life form how
18:54
funny would it be that it is birthed out
18:57
of the desire for computer graphics for
19:00
video games [laughter]
19:03
>> exactly
19:05
>> kind of cra it's kind of crazy
19:06
>> kind of crazy when you think about it
19:08
that way
19:09
>> because
19:10
it's just
19:12
>> perfect origin
19:13
Computer graphics was one of the hardest
19:14
computer supercomputer problems
19:18
generating reality
19:21
>> and also one of the most profitable to
19:22
solve because computer games are so
19:24
popular.
19:27
>> When Nvidia started in 1993,
19:28
we were trying to create this new
19:32
computing approach. The question is
19:33
what's the killer app?
19:35
And
19:38
the the problem we wanted to the the
19:41
company wanted to create a new type of
19:43
computing pro a computing architecture a
19:45
computing a a new type of computer that
19:48
can solve problems that normal computers
19:51
can't solve.
19:54
Well,
19:56
the applications that existed in the
19:58
industry in 1993
20:01
are applications that normal computers
20:03
can solve because if the normal
20:05
computers can't solve them, why would
20:07
the application exist?
20:08
And so, we had a mission statement for a
20:11
company that has no chance of success.
20:16
[laughter]
20:19
But I didn't know that in 1993. It just
20:21
sounded like a good idea,
20:23
>> right?
20:25
And so if we created this thing that can
20:27
solve problems, you know, it's like
20:30
you actually have to go create the
20:34
problem.
20:35
And so that's what we did in 1993. There
20:37
was no quake. John Carmarmac hadn't been
20:41
reduced doom released Doom yet. You
20:43
probably remember that.
20:46
>> Sure. Yeah.
20:47
>> And and uh there were no applications
20:49
for it. And so I went to Japan because
20:51
the arcade industry had this at the time
20:55
of Sega, if you remember.
20:59
>> Sure.
21:00
>> The arcade machines, they came out with
21:01
3D arcade systems, virtual fighter,
21:03
Daytona, Virtual Cop, all of those
21:08
arcade games were in 3D for the f very
21:12
first time. And the technology they were
21:14
using was from Martin Marietta, the
21:17
flight simulators. They took the guts
21:20
out of a flight simulator and put it
21:22
into an arcade machine. The system that
21:24
you have over here, it's got to be a
21:28
million times more powerful than that
21:31
arcade machine. And that was a flight
21:33
simulator for NASA. Whoa. And so they
21:35
took the guts out of that. They were
21:39
they were using it for flight simulation
21:42
for jets and, you know, space shuttle
21:43
and and they took the guts out of that.
21:46
and Sega uh had this brilliant computer
21:49
de developer. His name was Yuzuki.
21:52
Yuzuki and Miiamoto. Sega and Nintendo.
21:56
These were the, you know, the incredible
22:01
pioneers, the visionaries, the
22:04
incredible artists, and they're both
22:06
very, very technical.
22:08
They were the origins really of of the
22:11
gaming industry. and Y Suzuki
22:14
pioneered 3D graphics gaming and um
22:17
so I went we we created this company and
22:22
there were no apps
22:25
and we were spending all of our
22:27
afternoons you know we told our family
22:29
we were going to work but it was just
22:31
the three of us you know who's going to
22:33
know and so we went to Curtis's my one
22:34
of one of the founders went to Curtis's
22:38
townhouse and uh Chris and I were
22:40
married we have kids I already had
22:42
Spencer at Madison. They were probably 2
22:44
years old. And um
22:46
and uh Chris's kids are about the same
22:50
age as ours. And we would go to work in
22:52
this townhouse. But you know, when
22:56
you're a startup and the mission
22:58
statement is the way we described,
23:00
you're not going to have too many
23:02
customers calling you. And so we had
23:03
really nothing to do. And so after
23:06
lunch, we would always have a great
23:09
lunch. After lunch, we would go to the
23:10
arcades and play the Sega V, you know,
23:13
the Sega Virtual Fighter and Daytona and
23:16
all those games and analyze how they're
23:17
doing it, trying to figure out how they
23:20
they were doing that.
23:22
And so we decided, um, let's just go to
23:24
Japan and let's
23:27
convince Sega to move those applications
23:30
into the PC.
23:33
and we would start the PC gaming the 3D
23:35
gaming industry partnering with Sega.
23:38
That's how Nvidia started.
23:42
>> Wow.
23:43
>> And so so uh in exchange for them part
23:44
developing their games for our computers
23:47
in the PC, we would build a chip for
23:52
their game console. That was the
23:56
partnership. I build a chip for your
23:58
game console. you port the Sega games to
24:01
us and um
24:03
and then they paid us a you know at the
24:07
time a quite a significant amount of
24:09
money to build that game console
24:11
and that was kind of the beginning of
24:14
Nvidia getting started and we thought we
24:18
were on our way and so so I started with
24:20
a business plan a mission statement that
24:23
was impossible we lucked into the Sega
24:25
partnership we started taking off
24:28
started building our game console. And
24:31
about a couple years into it, we
24:33
discovered our first technology
24:35
didn't work.
24:38
It was it it would have been a flaw. It
24:40
it was a flaw. And all of the technology
24:42
ideas that we had
24:45
the architecture concepts were were
24:47
sound, but the way we were doing
24:49
computer graphics was exactly backwards.
24:52
you know, instead of
24:55
I won't bore you with the technology,
24:57
but instead of inverse texture mapping,
24:58
we were doing forward texture mapping.
25:01
Instead of triangles, we did curved
25:04
surfaces. So, other people did it flat,
25:07
we did it round. Um,
25:10
other technology, the technology that
25:14
ultimately won, the technology we use
25:16
today has has Zbuffers. It automatically
25:18
sorted.
25:21
We had an architecture with no Zbuffers.
25:23
The application had to sort it. And so
25:25
we chose a bunch of technology
25:27
approaches
25:29
that
25:30
three major technology choices. All
25:32
three choices were wrong. Okay. So this
25:34
is how incredibly smart we were. And so
25:36
[laughter]
25:39
and so in 1995 19 early mid95
25:40
we realized we were going down the wrong
25:44
path. Meanwhile,
25:46
the Silicon Valley was packed with 3D
25:49
graphics startups because it was the
25:52
most exciting technology of that time.
25:54
And so 3D FX and rendition and Silicon
25:57
Graphics was coming in. Intel was
26:01
already in there and you know gosh like
26:02
what added up eventually to a hundred
26:06
different startups we had to compete
26:08
against. Everybody had chosen the right
26:10
technology approach and we chose the
26:12
wrong one. And so we were the first
26:15
company to start. We found ourselves
26:17
essentially dead last with the wrong
26:21
answer.
26:22
And so
26:24
the company was in trouble
26:26
and um
26:30
ultimately we had to make several
26:33
decisions. The first decision is
26:34
well
26:38
if we change now
26:41
we will be the last company.
26:44
And
26:49
even if we changed into the technology
26:52
that we believe to be right, we'd still
26:54
be dead. And so that argument,
26:57
you know,
27:01
do we change and therefore be dead?
27:03
Don't change and make this technology
27:05
work somehow or go do something
27:07
completely different.
27:10
That question stirred the company
27:13
strategically and was a hard question. I
27:15
eventually, you know, advocated for we
27:18
don't know what the right strategy is,
27:22
but we know what the wrong technology
27:23
is. So, let's stop doing it the wrong
27:25
way and let's give ourselves a chance to
27:27
go figure out what the strategy is. The
27:29
second thing, the second problem we had
27:31
was our company was running out of money
27:34
and I had I was in a contract with Sega
27:36
and I owed them this game console
27:39
and if that contract would have been
27:43
cancelled, we'd be dead.
27:45
We would have vaporized instantly.
27:48
And so so uh uh I went to Japan and I
27:52
explained to uh the CEO of Sega, Erie
27:56
Madri, really great man. He was the
28:01
former CEO of Honda USA. Went back to
28:04
Sega to run Sega. Went back to Japan to
28:08
run Sega. And I explained to him that I
28:10
was uh I guess I was what 30 33 years
28:15
old.
28:18
you know, when I was 33 years old, I
28:20
still had acne. And I got this this, you
28:22
know, Chinese kid. I was super skinny.
28:25
And he he was already kind of elder.
28:30
And uh I went to him and I said I said,
28:34
"Listen,
28:37
I've got some bad news for you." And and
28:38
first, the technology that we promised
28:42
you doesn't work.
28:45
And second,
28:50
we shouldn't finish your contract
28:55
because we'd waste all your money and
28:57
you would have something that doesn't
29:01
work. And I recommend you find another
29:02
partner to build your game console.
29:05
>> Whoa.
29:06
>> And so I'm terribly sorry that we've set
29:08
you back in your product roadmap.
29:10
And third,
29:15
even though you're going to I'm asking
29:19
you to let me out of the contract,
29:20
I still need the money
29:24
because if you didn't give me the money,
29:27
we'd vaporize overnight.
29:29
And so
29:34
I explained it to him humbly, honestly.
29:37
I gave him the background.
29:40
explain to him why the technology
29:43
doesn't work, why we thought it was
29:45
going to work, why it doesn't work.
29:47
And um and I asked him
29:51
to uh
29:55
convert the last $5 million that they
29:58
were to complete the contract to give us
30:02
that money as an investment
30:05
instead.
30:09
and he said,
30:11
"But it's very likely your company will
30:14
go out of business, even with my
30:16
investment."
30:18
And it was completely true. Back then,
30:21
1995, $5 million was a lot of money.
30:24
It's a lot of money today. $5 million
30:27
was a lot of money. And here's a pile of
30:29
competitors doing it right. What are the
30:31
chances that giving Nvidia $5 million
30:34
that we would develop the right strategy
30:38
that he would get a return on that $5
30:40
million or even get it back? 0%.
30:41
You do the math. It's 0%.
30:45
If I were sitting there right there, I
30:49
wouldn't have done it.
30:50
$5 million was a mountain of money to
30:53
Sega at the time.
30:54
And so
30:57
I told him that that that um
30:59
uh
31:03
if you invested that $5 million in us,
31:05
it is most likely to be lost.
31:08
But if you didn't invest that money,
31:12
we'd be out of business and we would
31:14
have no chance.
31:16
And I I told him that I
31:18
I don't even know exactly what I said in
31:24
the end, but I
31:26
told him that I would understand if he
31:30
decided not to, but it would make the
31:33
world to me if he did. He went off and
31:35
thought about it for a couple days and
31:38
came back and said, "We'll do it."
31:39
>> Wow.
31:41
strategy to how to correct what it was
31:44
doing wrong. Did you explain that to
31:47
him?
31:49
>> Wait, oh man, wait until I tell you the
31:49
rest of it's scarier. Even scarier.
31:50
>> Oh no. [laughter]
31:54
>> And so so um
31:57
so what he what he decided was was uh
32:00
Jensen was a young man he liked. That's
32:07
it.
32:09
>> Wow. to this day.
32:10
>> That's nuts.
32:13
>> I was
32:14
>> Boy, do you owe what the world owes that
32:15
guy.
32:17
>> No doubt,
32:18
>> right?
32:20
>> Well, he's he c he's he celebrated today
32:21
in Japan.
32:23
>> And if he would have kept that five
32:25
>> the the investment, I think it'd be
32:28
worth probably about a trillion dollars
32:30
today.
32:32
I know. But the moment we went public,
32:36
they sold it. They go, "Wow, that's a
32:39
miracle." So, [laughter]
32:40
>> wow.
32:42
>> They sold it. Yeah. They sold it at
32:42
Nvidia valuation about 300 million.
32:45
That's our IPO valuation. 300 million.
32:48
>> Wow.
32:51
>> And so, so anyhow,
32:53
I was incredibly grateful. Um,
32:56
and then now we had to figure out what
33:00
to do because we still were doing the
33:02
wrong strategy, wrong technology. So
33:04
unfortunately we had to lay off most of
33:07
the company. We shrunk the company all
33:09
back. All the people working on the game
33:10
console, you know, we had to shrunk it
33:13
all. Shrink it all back.
33:14
And um
33:17
and then and then somebody told me that,
33:20
but Jensen,
33:23
we've never built it this way before.
33:25
We've never built it the right way
33:27
before.
33:28
We've only know how to build it the
33:31
wrong way.
33:32
And so nobody in the company knew how to
33:34
build this
33:37
supercomputing image generator 3D
33:41
graphics thing that Silicon Graphics
33:43
did. And so so uh I said, "Okay,
33:45
how hard can it be? You got all these 30
33:50
companies, you know, 50 companies doing
33:53
it. How hard can it be?" And so luckily
33:54
there was a textbook written by the
34:00
company Silicon Graphics.
34:01
And so I went down to the store. I had
34:04
200 bucks in my pocket. And I bought
34:06
three textbooks, the only three they
34:09
had, $60 a piece. I bought the three
34:11
textbooks. I brought it back and I gave
34:14
one to each one of the architects and I
34:17
said, "Read that and let's go save the
34:18
company."
34:20
>> [laughter]
34:21
>> And so
34:23
[gasps and sighs] so they they they read
34:25
this textbook, learned from the giant at
34:27
the time, Silicon Graphics, about how to
34:31
do 3D graphics. But the thing that was
34:33
amazing and what makes Nvidia special
34:36
today is that
34:39
the people that are there are able to
34:42
start from first principles,
34:44
learn best known art, but reimplement it
34:47
in a way that's never been done before.
34:51
And so when we re-imagined
34:55
the technology of 3D graphics, we
34:58
reimagined it in a way that manifest
35:01
today the modern 3D graphics. We really
35:04
invented modern 3D graphics, but we
35:07
learned from previous known arts and we
35:10
implement it fundamentally differently.
35:13
>> What did you do that changed it?
35:16
Well, you know, the ultimately
35:18
ultimately the um uh the simple the
35:21
simple answer is that the way silicon
35:24
graphics works uh the geometry engine is
35:27
a bunch of software running on
35:31
processors.
35:32
We took that and
35:34
eliminated all the generality,
35:40
the general purposeness of it and we
35:43
reduced it down into the most essential
35:46
part of 3D graphics
35:48
and we hardcoded it into the chip. And
35:51
so instead of something general purpose,
35:55
we hardcoded it very specifically into
35:56
just the limited applications,
36:00
limited functionality necessary for
36:03
video games.
36:06
And that capability that super and and
36:08
because we reinvented a whole bunch of
36:11
stuff, it supercharged the capability of
36:13
that one little chip. And our one little
36:15
chip was generating images as fast as a
36:18
$1 million image generator. That was the
36:23
big breakthrough. We took a million
36:26
dollar thing and we put it into the
36:27
graphics card that you now put into your
36:30
gaming PC. And that was [snorts] our big
36:32
invention.
36:35
And then and of course the question is
36:36
is um
36:38
uh how do you compete against these 30
36:41
other companies doing what they were
36:43
doing?
36:44
and and there we did we did several
36:46
things. One
36:49
uh instead of building a 3D graphics
36:51
chip for every 3D graphics application,
36:56
we decided to build a 3D graphics chip
36:59
for one application. We bet the farm on
37:01
video games.
37:04
The needs of video games are very
37:06
different than needs for CAD, needs for
37:08
flight simulators. They're related, but
37:10
not the same. And so we narrowly focused
37:12
our problem statement so I could reject
37:15
all of the other complexities and we
37:17
shrunk it down into this one little
37:19
focus and then we supercharged it for
37:21
gamers. And then the second thing that
37:24
we did was we created a whole ecosystem
37:26
of working with game developers and
37:30
getting their their games ported and
37:32
adapted to our silicon so that we could
37:34
get turn essentially what is a
37:37
technology business into a platform
37:40
business into a game platform business.
37:43
So we, you know, GeForce is really today
37:45
it's also the most advanced 3D graphics
37:48
technology in the world, but a long time
37:50
ago GeForce is really the game console
37:53
inside your PC. It's, you know, it runs
37:55
Windows, it runs Excel, it runs
37:59
PowerPoint, of course, those are easy
38:00
things, but its fundamental purpose was
38:02
simply to turn your PC into a game
38:06
console. So we we were the first
38:08
technology company to build all of this
38:10
incredible technology in service of one
38:14
audience gamers. Now of course in 1993
38:16
the gaming industry didn't exist. But by
38:21
the time that John Carmarmac came along
38:24
and the doom phenomenon happened and
38:26
then quake came out as you know
38:29
that entire world oh that entire
38:34
community boom took off. Do you know
38:36
where the name Doom came from?
38:38
>> It came from this se there's a scene in
38:40
the movie The Color of Money where Tom
38:42
Cruz who's this uh elite pool player
38:45
shows up at this pool hall and this
38:47
local hustler says what he got in the
38:49
case and he opens up this case. He has a
38:51
special pool queue. He goes in here and
38:53
he opens it up. He goes, "Doom.
38:55
>> Doom." [laughter]
38:57
>> And that's where it came from. Yeah. Cuz
38:58
Carmarmac said that's what they wanted
39:00
to do to the gaming industry.
39:01
>> Doom.
39:02
>> That when Doom came out, it would just
39:03
be everybody be like, "Oh, we're
39:05
fucked."
39:06
>> Oh, wow.
39:07
>> This is Doom.
39:07
>> That's awesome.
39:08
>> Isn't that amazing? That's amazing.
39:09
>> Cuz it's the perfect name for the game.
39:10
>> Yeah.
39:12
>> And the name came out of that scene in
39:12
that movie.
39:14
>> That's right. Well, and then of course,
39:14
uh, Tim Sweeney and
39:17
>> Epic Games and, uh, and the 3D gaming
39:20
genre took off.
39:24
>> Yes.
39:24
>> And so, if you just kind of in the
39:25
beginning was no gaming industry. We had
39:28
no choice but to focus the company on
39:31
one thing. That one thing,
39:33
>> it's a really incredible origin story.
39:35
>> Oh, it's it's amazing. Like you must be
39:37
like look back
39:40
>> a disaster is what
39:41
>> a $5 [laughter] million that pivot with
39:42
that conversation with that gentleman if
39:44
he did not agree to that if he did not
39:46
like you what would the world look like
39:48
today that's crazy then then our entire
39:50
life hung on another gentleman
39:54
and so so now here we are we built so
39:58
before GeForce it was Revo 128 revo 128
40:01
saved the company it revolutionized
40:05
computer graphics
40:07
The performance cost performance ratio
40:09
of 3D graphics for gaming was off the
40:12
charts amazing.
40:14
And
40:17
we're getting ready to to ship it. Get
40:21
well, we're we're building it, but we're
40:24
so as you know, $5 million doesn't last
40:27
long. And so every single month, every
40:30
single month, uh we were drawing down
40:33
You have to build it, prototype it. You
40:39
have to design it, prototype it,
40:42
get the silicon back,
40:45
which costs a lot of money. Test it with
40:48
software
40:51
because without the software testing the
40:53
chip, you don't know the chip works.
40:55
And then you're going to find a bug
40:58
probably
41:00
because every time you test something
41:01
you find bugs,
41:03
which means you have to tape it out
41:06
again, which is more time, more money.
41:07
And so we did the math. There was no
41:11
chance anybody was going to survive it.
41:13
We didn't have that much time to tape
41:15
out a chip, send it to a foundry TSMC,
41:17
get the silicon back, test it, send it
41:20
back out again. There was no no shot, no
41:23
hope.
41:25
And so the math, the spreadsheet doesn't
41:27
allow us to do that. And so I heard
41:31
about this company and this company
41:34
built this machine.
41:37
And this machine is an emulator.
41:40
You could take your design, all of the
41:43
software that describes the chip, and
41:48
you could put it into this machine. And
41:52
this machine will pretend it's our chip.
41:54
So I don't have to send it to the fab,
41:57
wait until the fab sends it back, test.
41:59
I could have this machine pretend it's
42:01
our chip and I could put all of the
42:03
software on top of this machine called
42:06
an emulator and test all of the software
42:07
on this pretend chip and I could fix it
42:12
all before I send it to the fab.
42:15
>> Whoa. And if and and if I could do that
42:18
when I send it to the FAB, it should
42:21
work.
42:23
Nobody knows, but it should work. And so
42:24
we came to the conclusion
42:27
that let's take half of the money we had
42:30
left in the bank. At the time it was
42:33
about a million dollars. Take half of
42:35
that money and go buy this machine.
42:38
So instead of keeping the money to stay
42:42
alive, I took half of the money to go
42:44
buy this machine. Well, I call this guy
42:46
up. This the company's called IOS.
42:48
Call this company up and I say, "Hey,
42:52
listen. I heard about this machine.
42:54
I like to buy one."
42:57
And they go, "H,
42:59
that's terrific, but we're out of
43:02
business." I said, "What? You're out of
43:03
business?" He goes, "Yeah, we had no
43:06
customers."
43:08
[laughter]
43:10
I said, "Wait, hang on a sec. So, you
43:12
never made the machine?" They [snorts]
43:14
can say, "No, no, no. We made the
43:16
machine. We have one in inventory if you
43:17
want it, but we're out of business." So,
43:20
I bought one out of inventory.
43:22
Okay. After I bought it, they went out
43:26
of business.
43:28
>> Wow.
43:29
>> I bought it out of inventory.
43:30
And on this machine, we put Nvidia's
43:32
chip into it and we tested all of the
43:36
software on top.
43:39
And at this point, we were on fumes.
43:41
But we convinced ourselves that chip is
43:45
going to be great.
43:47
And so I had to call some other
43:49
gentleman. So I called TSMC.
43:50
And I told TSMC
43:54
that listen, TSMC is the world's largest
43:56
founder today. At the time they were
43:58
just a few hundred million dollars
44:01
large,
44:02
tiny little company.
44:06
And I explained to them what we were
44:12
doing. And um I explained to him I told
44:13
him I had a lot of customers. I had one,
44:18
you know, Diamond Multimedia,
44:20
probably one of the companies you bought
44:23
the graphics card from back in the old
44:24
days. And I I said, you know, we have a
44:26
lot of customers, and the demand's
44:29
really great, and
44:30
we're going to tape out a chip to you,
44:33
and I like to go directly to production
44:37
because I know it works.
44:41
>> [snorts]
44:44
>> And they said, "Nobody has ever done
44:45
that before.
44:47
Nobody has ever taped out a chip that
44:50
worked the first time.
44:52
And nobody starts out production without
44:54
looking at it."
44:56
But I knew that if I didn't start the
44:58
production, I'd be out of business
45:00
anyways. And if I could start the
45:02
production, I might have a chance.
45:05
And so
45:08
TSMC
45:10
decided to support me and uh this
45:12
gentleman is named Morris Chang. Morris
45:15
Chang is the father of the foundry
45:17
industry, the founder of TSMC. Really
45:20
great man.
45:23
He decided to support our company. I
45:27
explained to them everything.
45:30
he decided to support us frankly
45:32
probably because they didn't have that
45:34
many other customers anyhow but they
45:36
were grateful and I was immensely
45:39
grateful and as we were starting the
45:41
production
45:44
Morris flew to United States and uh
45:46
he didn't so many words asked me so but
45:50
he asked me a whole lot of questions
45:53
that was trying to tease out do I have
45:55
any money
45:58
but he didn't directly ask me that you
46:00
know and so the truth is that we didn't
46:02
have all the money but we had a strong
46:06
PO from the customer and if it didn't
46:09
work some wafers would have been lost
46:14
and I'm you know I I'm not exactly sure
46:16
what would have happened but we would
46:19
have come short it would have been it
46:20
would have been rough but they supported
46:23
us with all of that risk involved we
46:25
launched this chip turns out to
46:28
been completely revolutionary.
46:32
Knocked the ball out of the park. We
46:35
became the fastest growing technology
46:37
company in history to go from zero to $1
46:40
billion.
46:43
>> So wild that you didn't test the chip.
46:44
>> I know. We tested afterwards. Yeah, we
46:46
tested afterwards.
46:49
>> Afterwards, but [laughter]
46:50
production already. But by the way, by
46:52
the way, that methodology that we
46:55
developed to save the company is used
46:58
throughout the world today.
47:01
>> That's amazing.
47:02
>> Yeah, we changed we changed the whole
47:03
world's methodology of designing chips.
47:05
The whole world's uh rhythm of designing
47:07
chips. Uh we changed everything.
47:10
>> How well did you sleep those days? It
47:13
must have been so much stress,
47:16
[laughter]
47:18
>> you know. Um,
47:19
what is that feeling where where uh the
47:24
world just kind of feels like it's
47:27
flying? It you you have this what do you
47:29
call that feeling? You can't you can't
47:33
stop the the feeling that everything's
47:36
moving super fast and you know and
47:38
you're laying in your laying in bed and
47:41
the world just feels like you know it
47:44
you and you're you you feel deeply
47:47
anxious
47:50
uh completely out of control. Um
47:51
I've felt that probably a couple of
47:56
times [laughter] in my life. It's during
47:57
that time.
48:01
>> Wow.
48:02
>> Yeah. It it was incredible.
48:03
>> What an incredible success story.
48:05
>> But I I learned I learned a lot. I
48:06
learned I learned about I learned
48:08
several things. I learned I learned uh
48:09
how to develop strategies.
48:11
Um I learned how to
48:14
uh uh and when I when I you know our
48:16
company learned how to develop
48:19
strategies. What are winning strategies?
48:20
We learned how to create a market. We
48:22
created the modern 3D gaming market.
48:24
We learned how and and so that exact
48:28
same skill is how we created the modern
48:31
AI market. It's exactly the same.
48:34
>> Wow.
48:37
>> Yeah. Exactly the same skill. Exactly
48:37
the same blueprint. And
48:40
uh we learned how to uh deal with
48:43
crisis, how to stay calm, how to think
48:45
through things systematically.
48:49
We learned how to remove all waste in
48:52
the company and work from first
48:56
principles and doing only the things
48:58
that are essential. Everything else is
49:00
waste because we have no money for it
49:02
to live on fumes at all times. And the
49:05
feeling
49:09
no different than the feeling I had this
49:12
morning when I woke up that you're going
49:13
to be out of business soon. that you're
49:16
you know the phrase 30 days from going
49:19
out of business I've used for 33 years
49:21
because
49:24
>> you still feel that.
49:25
>> Oh yeah. Oh yeah. Every morning. Every
49:25
morning.
49:27
>> But but you guys are one of the biggest
49:28
companies on planet earth. But the the
49:30
feeling doesn't change.
49:32
>> Wow.
49:33
>> The the sense of vulnerability, the
49:34
sense of uncertainty, the sense of
49:36
insecurity. Uh
49:39
it it doesn't leave you.
49:42
>> That's crazy. We were, you know, we had
49:44
nothing. We had nothing. We were dealing
49:46
with giant.
49:49
>> Oh, yeah. Oh, yeah. Every day, every
49:50
moment.
49:52
>> Do you think that fuels you? Is that
49:52
part of the reason why the company's so
49:54
successful? That you have that hungry
49:56
mentality,
49:59
that you never rest, you're never
50:04
sitting on your laurels, you're always
50:06
on the edge.
50:08
I have a greater drive from not wanting
50:12
to fail
50:17
than the drive of wanting to succeed.
50:19
[laughter]
50:22
>> Isn't that like sex coaches would tell
50:25
you that's completely the wrong
50:27
psychology?
50:29
>> The world has just heard me say that for
50:29
out loud for the first time.
50:31
>> But but it's true.
50:33
>> Well, that's how fascinating. fear of
50:35
failure drives me more than the than the
50:36
the greed or whatever it is.
50:41
>> Well, ultimately that's probably a more
50:43
healthy approach now that I'm thinking
50:45
about it because like the fear
50:48
>> I'm not ambitious for example,
50:50
[laughter] you know, I just want to stay
50:52
alive, Joe. I want the company to
50:54
thrive, you know, I want us to make an
50:57
impact.
50:59
>> That's interesting.
50:59
>> Yeah.
51:00
>> Well, maybe that's why you're so humble.
51:01
That's what maybe that's what keeps you
51:03
grounded, you know, because with the
51:04
kind of spectacular success the
51:07
company's achieved, it would be easy to
51:08
get a big head.
51:10
>> No.
51:11
>> Right. But isn't that interesting? It's
51:12
like the if you were the guy that your
51:13
main focus is just success. You probably
51:16
would go, "Well, made it. Nailed it. I'm
51:20
the [laughter] man.
51:23
>> Drop the mic."
51:24
>> Instead, you wake up, you're like, "God,
51:25
we can't [ __ ] this up."
51:27
>> No. Exactly. Every morning. Every
51:28
morning. No. Every moment. Yeah. That's
51:30
crazy.
51:32
>> Before I go to bed.
51:33
>> Well, listen. If I was a major investor
51:34
in your company, that's what I'd want
51:36
running it. I'd want a guy who's
51:37
>> Yeah.
51:41
>> That's what I work. That's why I work
51:42
seven days a week. Every moment I'm I'm
51:43
awake.
51:46
>> You work every moment.
51:47
>> Every moment I'm awake.
51:48
>> Wow.
51:50
>> I'm thinking about solving a problem.
51:51
I'm thinking about
51:53
>> How long can you keep this up?
51:55
>> I don't know. But so [laughter]
51:57
could be next week. Sounds exhausting.
51:59
>> It is exhausting.
52:02
>> It sounds completely exhausting.
52:03
>> Always in a state of anxiety.
52:04
>> Wow.
52:07
>> Always in a state of anxiety.
52:08
>> Wow. Kudos to you for admitting that. I
52:10
think that's important for a lot of
52:12
people to hear because, you know,
52:13
there's probably some young people out
52:15
there that are in a similar position to
52:17
where you were when you were starting
52:21
out that just feel like, oh, those
52:22
people that have made it, they're just
52:25
smarter than me and they had more
52:27
opportunities than me and it's just like
52:29
it was handed to them or they're just in
52:31
the right place at the right time. And
52:33
>> Joe, I just described to you somebody
52:36
who didn't know what was going on,
52:37
[laughter]
52:39
actually did it wrong.
52:39
>> Yeah. Yeah. And the ultimate diving
52:41
catch like two or three times.
52:43
>> Crazy.
52:45
>> Yeah.
52:46
>> The ultimate diving catch is the perfect
52:47
way to put it.
52:48
>> You know, it's just like the edge of
52:50
your glove. [laughter]
52:51
>> It probably bounced off of somebody's
52:53
helmet and landed at the edge.
52:55
[laughter]
52:58
>> God, that's incredible. That's
53:00
incredible. But it's also it's really
53:02
cool that you have this perspective that
53:04
you look at it that way because you know
53:06
a lot of people that have delusions of
53:10
grandeur or they have you know
53:12
>> and their rewriting of history
53:15
often times had them somehow extraord
53:19
extraordinarily smart and they were
53:23
geniuses and they knew all along and
53:25
they were they were spot-on. And the
53:27
business plan was exactly what they
53:29
thought. And
53:30
>> yeah,
53:31
>> they destroyed the competition and you
53:31
know and they emerged victorious.
53:34
[laughter]
53:36
>> Meanwhile, you're like, I'm scared every
53:39
day.
53:40
>> Exactly. [laughter]
53:41
Exactly.
53:43
>> That's so funny. Oh my god, that's
53:44
amazing.
53:47
>> It's so true, though.
53:47
>> It's amazing.
53:48
>> It's so true.
53:49
>> It's amazing. Well, but I I think
53:50
there's nothing inconsistent
53:52
with being a leader and being
53:55
vulnerable. You know, I the company
53:56
doesn't need me to be a genius right all
54:00
along, right?
54:03
Absolutely certain about what I'm trying
54:06
to do and what I'm doing. The the
54:08
company doesn't need that. The company
54:10
wants me to succeed. You know, the thing
54:12
that and we started out today talking
54:14
about President Trump and I was about to
54:17
say something and listen, he is my
54:19
president. He is our president. We
54:23
should all and we're talking about just
54:25
because it's President Trump, we all
54:27
want him to be wrong. I think that
54:29
United States, we all have to realize he
54:31
is our president, we want him to succeed
54:34
because
54:37
>> no matter who's president attitude.
54:37
>> That's right.
54:40
>> We want him to succeed. We need to help
54:41
him succeed because it helps everybody,
54:43
all of us succeed.
54:45
And
54:48
I'm lucky that I work in a company where
54:51
I have 40,000 people who wants me to
54:54
succeed.
54:56
They want me to succeed and I can tell
54:58
and they're all every single day to help
55:00
me overcome these challenges
55:02
trying to realize
55:05
realize what I describe to be our
55:07
strategy doing their best. And if it's
55:09
somehow
55:12
wrong or not perfectly right to tell me
55:14
so that we could pivot and the more
55:17
vulnerable we are as a leader the more
55:20
able other people are able to tell you
55:23
you know that Jensen that's not exactly
55:26
right or
55:27
>> right right
55:28
>> have you considered this information or
55:29
and the more vulnerable we are
55:31
the more able we're actually able to
55:35
pivot if we put ourselves into this
55:37
superhuman capability then it's hard for
55:39
us to pivot strategy,
55:41
>> right?
55:42
>> Because we were supposed to be right all
55:43
along.
55:44
>> And so if you're always right, how can
55:45
you possibly pivot? Because pivoting
55:47
requires you to be wrong. And so I've
55:49
got no trouble with being wrong. I just
55:51
have to make sure that I stay alert,
55:54
that I reason about things from first
55:57
principles all the time. Always break
55:58
things down to first principles.
56:01
Understand why it's happening.
56:03
Reassess continuously. The reassessing
56:05
continuously is kind of partly what
56:09
causes continuous anxiety,
56:11
>> you know, because you're asking
56:14
yourself, were you wrong yesterday? Are
56:15
you still right? Is this the same? Has
56:17
that changed? Has that condition is that
56:20
worse than you thought?
56:22
>> But God, that mindset is perfect for
56:23
your business, though, because this
56:25
business is ever changing
56:27
>> all the time. I've got competition
56:29
coming from every direction. So much of
56:30
it is kind of up in the air
56:33
and you have to invent a future where
56:36
a 100 variables are included and there's
56:41
no way you could be right on all of
56:44
them. And so you have to be
56:45
>> you have to surf.
56:47
>> Wow. That's a good way to put it. You
56:49
have to surf. Yeah. You're surfing waves
56:51
of technology and innovation.
56:54
>> That's right. You can't predict the
56:55
waves. You got to deal with the ones you
56:57
have.
56:59
>> Wow. And but skill matters and I've been
56:59
doing this for 30 I'm the longest
57:04
running tech CEO in the world.
57:05
>> Is that true? Congratulations. That's
57:07
amazing.
57:08
>> And you know people ask me how is one
57:10
don't get fired. [laughter]
57:12
That'll stop a short heartbeat.
57:16
And then two don't get bored.
57:19
>> Yeah.
57:22
>> Well, how do you maintain your
57:22
enthusiasm?
57:23
Well, the honor truth is is not always
57:28
enthusiasm. It's, you know, sometimes is
57:30
enthusiasm. Sometimes it's just good
57:32
oldfashioned fear and then sometimes,
57:35
you know, a healthy dose of frustration,
57:37
you know, it's whatever keeps you
57:40
moving.
57:42
>> Yeah. Just all the emotions. I think,
57:43
you know,
57:45
>> CEOs, we have all the emotions, right?
57:46
you know, and so probably probably
57:49
jacked up to the maximum because you're
57:53
you're kind of feeling it on behalf of
57:55
the whole company. I'm feeling it on
57:57
behalf of everybody at the same time.
57:59
And it kind of, you know, encapsulates
58:02
into into somebody. And so I have to be
58:04
mindful of the past. I have to be
58:08
mindful of the present. I've got to be
58:09
mindful of the future. And um you know,
58:11
it can't it's not without emotion.
58:14
It's not just it's it's not just a job.
58:18
Let's just put it that way.
58:20
>> It doesn't seem like it at all. I would
58:23
imagine one of the more difficult
58:25
aspects of your job currently now that
58:26
the company is massively successful is
58:29
anticipating where technology is headed
58:31
and where the applications are going to
58:34
be.
58:36
>> Yeah.
58:36
>> So, how do you try to map that out?
58:37
>> Yeah. there there um there there's a
58:40
whole bunch of ways and and it takes it
58:43
takes um
58:46
takes a whole bunch of things but let me
58:50
just start
58:51
uh you have to be surrounded by amazing
58:53
people and Nvidia is now you know if you
58:55
look at look at look at um the large
58:59
tech companies in the world today
59:02
most of them have a business in
59:05
advertising or social media or you know
59:08
content distribution and at the core of
59:12
it is really fundamental computer
59:15
science and so the company's business is
59:18
not computers the company's business is
59:22
not technology technology drives the
59:25
company is the only company in the world
59:27
that's large whose only business is
59:29
technology we only build techn we don't
59:32
advertise the only way that we make
59:34
money is to create amazing technology
59:36
and sell
59:39
And so
59:40
to be that to be NVIDIA today, you're
59:43
the number one thing is you're
59:46
surrounded by the finest computer
59:48
scientists in the world. And that's my
59:49
gift. My gift is that we've created a
59:52
company's culture,
59:55
a condition by which the world's
59:57
greatest computer scientists want to be
00:00
part of it because they get to do their
00:01
life's work and create the next thing
00:04
because that's what they want to do.
00:06
because maybe they're not they don't
00:08
want to be in service of another
00:11
business.
00:12
>> They want to be in service of the
00:13
technology itself. And we're the largest
00:15
form of its kind in the history of the
00:16
world.
00:18
>> Wow.
00:19
>> I know. It's pretty amazing.
00:20
>> Wow.
00:21
>> And so so one, you know, we have a we we
00:22
have got a great condition. We have a
00:26
great culture. We have great people. And
00:27
then now now now the question is how do
00:30
you systematically
00:32
um
00:36
be able to see the future stay alert of
00:37
it
00:42
and uh reduce the reduce the the
00:44
likelihood of missing something or being
00:48
wrong.
00:51
And so there's a lot of different ways
00:53
you could do that. For example, we have
00:54
great partnerships. We we have
00:56
fundamental research. We have a great
00:57
research lab, one of the largest
00:59
industrial research labs in the world
01:00
today. And we partner with a whole bunch
01:02
of universities and other scientists. We
01:04
do a lot of open collaboration
01:07
and so I'm constantly working with
01:09
researchers outside the company.
01:12
We have the benefit of having amazing
01:15
customers and so I have the benefit of
01:17
working with Elon and you know and
01:20
others in the industry and we have the
01:22
benefit of being the only pure pure play
01:25
technology company that can serve uh
01:28
consumer internet
01:31
industrial manufacturing
01:33
um scientific computing healthcare
01:36
financial services all the industries
01:39
that we're in. They're all signals to
01:42
me. And so they all have mathematicians
01:44
and scientists and and so because I I
01:48
have the benefit now of a radar system
01:51
>> that is the most broad of any company in
01:54
the world working across every single
01:56
industry from agriculture to energy
01:59
to video games.
02:03
And so the ability for us to have this
02:05
vantage point,
02:08
one doing fundamental research ourselves
02:10
and then two working with all the great
02:13
researchers, working with all the great
02:15
industries, the feedback system is
02:17
incredible. And then finally,
02:19
you just have to have a culture of
02:22
staying super alert. There's no easy way
02:23
of being alert except for paying
02:27
attention.
02:29
I haven't found a single way of being
02:31
able to stay alert without paying
02:33
attention. And so, you know, I probably
02:34
read several thousand emails a day.
02:37
>> How How do you have a time for that?
02:42
>> I wake up early. This morning I was up
02:44
at 4:00.
02:46
>> How much do you sleep?
02:47
>> Uh, six, seven, six, seven hours.
02:49
>> Yeah.
02:53
>> And then you're up at 4 reading emails
02:54
for a few hours before you get going.
02:56
>> That's right. Yeah.
02:58
>> Wow.
02:58
Every day.
03:00
>> Every single day. Not one day missed.
03:01
[sighs] including
03:03
Thanksgiving, Christmas.
03:06
>> Do you ever take a vacation?
03:06
>> Uh, yeah. But they're um my definition
03:09
of a vacation is when I'm with my
03:13
family. And so if I'm with my family,
03:14
I'm very happy. I don't care where we
03:17
are.
03:19
>> And you don't work then or do you work a
03:19
little?
03:21
>> No. No. I work a lot. [laughter]
03:21
>> Even like if you go on a trip somewhere,
03:24
you're still working.
03:27
>> Oh, sure. Oh, sure.
03:28
>> Wow. Every day.
03:29
>> Every day.
03:30
>> But my kids work every You make me tired
03:32
just saying this.
03:34
>> My kids work every day.
03:34
Both of my kids work at Nvidia. They
03:38
work every day.
03:39
>> Wow.
03:40
>> Yeah. I'm very lucky.
03:40
>> Wow.
03:42
>> Yeah. It's brutal now because, you know,
03:43
it's just me working every day. Now we
03:45
have three people working every day and
03:47
they want to work with me every day and
03:49
so it's it's a lot of work.
03:51
>> Well, you've obviously imparted that
03:54
ethic into them.
03:57
>> They work incredibly hard. I mean,
03:58
there's no unbelievable.
03:59
>> But my parents work incredibly hard.
04:01
>> Yeah. I was I was born with the work
04:05
gene,
04:07
>> the suffering gene. [laughter]
04:08
>> Well, listen, man. It has paid off. What
04:10
a crazy story. It was just It's really
04:14
an amazing origin story.
04:16
It really I mean, it has to be kind of
04:19
surreal to be in the position that
04:21
you're in now when you look back at how
04:22
many times that it could have fallen
04:24
apart and humble beginnings. But Joe,
04:25
this is great. It's a great country. You
04:28
know, I'm an immigrant. My parents sent
04:31
my older brother and I here first.
04:34
We're we're in Thailand.
04:37
I was born in Taiwan, but my dad had a
04:40
job in Thailand. He was a chemical and
04:43
instrumentation engineer, incredible
04:46
engineer.
04:48
And his job was to go start an oil
04:50
refinery. And so we moved to Thailand,
04:52
lived in Bangkok.
04:54
And um in 19
04:56
I guess 1973 1974 time frame,
05:00
you know how Thailand every so often
05:05
they would just have a coup. You know,
05:06
the military would have an uprising and
05:08
all of a sudden one day there were tanks
05:12
and soldiers in the streets and my
05:14
parents thought, you know, it probably
05:15
isn't safe for the kids to be here. And
05:17
so they contacted my uncle. My uncle
05:19
lives in Tacoma, Washington.
05:22
and um we had never met him and my
05:25
parents sent us to him.
05:28
>> How old were you?
05:30
>> Uh I was about to turn nine and my older
05:31
brother uh almost turned 11 and so the
05:35
two of us came to United States and we
05:39
stayed in with our uncle for a little
05:42
bit while he looked for a school for us
05:45
and my parents didn't have very much
05:49
money and they never been to United
05:50
States. my father was. I'll tell you
05:53
that story in a second.
05:55
And um
05:57
and so my my uncle found a school that
06:00
would accept foreign students and
06:04
affordable enough for my parents.
06:08
And that school turned out to have been
06:11
in Onita, Kentucky, Clark County,
06:13
Kentucky, the epicenter of the opio
06:17
crisis today.
06:19
cold country.
06:21
Clark County, Kentucky is
06:24
was the poorest county in America when I
06:27
showed up. It is the poorest county in
06:31
America today.
06:33
And so we went to the school, it's a
06:36
great school, um, Onita Baptist
06:38
Institute
06:41
in a town of a few hundred. I think it
06:43
was 600 at the time that we showed up.
06:46
No traffic light.
06:49
And um I think it has 600 today. It's
06:51
quite an amazing feat actually.
06:54
The ability to hold your population for
06:58
[laughter]
07:01
when it's 600 people. It was quite a
07:02
magic quite a magical thing. however
07:04
they did it. And and so uh the school
07:06
had a mission of being an open school
07:11
for any children who would like to come.
07:16
And what that basically means is that if
07:20
you're a trouble student, if you have a
07:23
troubled family,
07:26
um if you're,
07:28
you know, whatever your background,
07:32
you're welcome to come to Onita Baptist
07:35
Institute, including kids from
07:38
international who would like to stay
07:41
there.
07:43
>> Did you speak English at the time?
07:44
>> Uh, okay. Yeah. Yeah. Okay. Yeah. And so
07:45
we showed up
07:50
and uh
07:53
my first my first thought was gosh there
07:57
are a lot of cigarette butts on the
08:01
ground. 100% of the kids smoked.
08:02
[laughter]
08:05
So right away you know this is not a
08:09
normal school.
08:10
>> Nineyear-olds?
08:11
>> No, I was the youngest kid.
08:12
>> Okay. 11 year olds.
08:14
>> My roommate was 17 years old. Wow.
08:15
>> Yeah. He just turned 17. And he was
08:19
jacked
08:22
and and um
08:23
I don't know where he is now. I know his
08:29
name, but I don't know where he is now.
08:31
But anyways, uh that night we got and
08:32
and the second thing I noticed when you
08:36
walk into the into your dorm room
08:37
is uh there are no drawers and no closet
08:41
doors.
08:44
just like a prison.
08:47
And
08:50
there are no locks
08:52
so that people could check check up on
08:55
you.
08:56
And so I go into my room and he's 17 and
08:58
uh you know get ready for for bed and he
09:03
had all this tape
09:06
all over his body and uh turned out he
09:09
was in a knife fight and he's been
09:12
stabbed all over his body and these were
09:15
just fresh wounds.
09:17
>> Whoa. And the other kids were hurt much
09:19
worse.
09:22
And uh so he was my roommate, the
09:24
toughest kid in school, and I was the
09:27
youngest kid in school. It was a it was
09:29
a junior high,
09:32
but they took me anyways because if I
09:34
walked about a mile across the Kentucky
09:38
River, the swing bridge, the other side
09:41
is a middle school that I could go to
09:45
and then I can go to that school and I
09:47
come back and then I stay in the dorm.
09:50
And so basically Onita Baptist Institute
09:53
was my dorm when I went to this other
09:55
other school. My older brother went went
09:57
to um went to the junior high. And so we
10:00
were there for a couple of years. Um
10:03
every kid had every kid had chores.
10:05
My older brother's chore was to work in
10:09
the tobacco farm, you know. So tobac
10:11
they raised tobacco so that they could
10:14
raise some extra money for the school.
10:15
Kind of like a penitentiary.
10:18
>> Wow. And my job was just to clean the
10:19
dorm. And so I I was 9 years old. I was
10:22
cleaning toilets. And for a dorm of 100
10:26
100 boys, I
10:29
I clean more bathrooms than anybody. And
10:33
I just wish that everybody was a little
10:35
bit more careful, you know. [laughter]
10:37
But anyways, I was the youngest kid in
10:42
school. The my memories of it was really
10:43
good. Um, but it was a pretty tough It
10:46
was a tough town.
10:49
>> Sounds like it.
10:50
>> Yeah. Town kids, they all carried
10:51
Everybody had knives.
10:53
>> Everybody had knives. Everybody smoked.
10:55
Everybody had a Zippo lighter. I smoked
10:58
for a week.
11:00
>> Did you?
11:01
>> Oh, yeah. Sure.
11:02
>> How old were you?
11:02
>> I was nine. Yeah.
11:03
>> When you nine? You were nine, you tried
11:04
smoking.
11:05
>> Yeah. I got myself a pack of cigarettes.
11:06
Everybody else did.
11:08
>> Did you get sick? No. I I got used to
11:09
it, you know, and I learned how to blow
11:11
blow smoke rings and, you know, [snorts]
11:14
you know, breathe out of my nose, you
11:19
know, take it in out of through my nose.
11:20
I mean, there was a all the different
11:22
things that you learned. Yeah.
11:24
>> At nine.
11:26
>> Yeah.
11:27
>> Wow. You just did it to fit in or it
11:27
looked cool.
11:29
>> Yeah. [clears throat] Because everybody
11:30
else did it,
11:30
>> right?
11:31
>> Yeah. And and then I did it for a couple
11:31
weeks, I guess. And I just rather have I
11:34
had a quarter, you know, I had a quarter
11:38
a month or something like that.
11:41
I just rather buy popsicles and fried
11:44
sickles with it. I was nine, you know,
11:46
[laughter]
11:48
>> right?
11:48
>> I chose I chose the the better path.
11:49
>> Wow.
11:52
>> That was our school. And then my parents
11:53
came to United States two years later
11:55
and um we met him in Tacoma, Washington.
11:57
>> That's wild. It It was a really crazy
12:01
experience. What a strange formative
12:04
experience.
12:07
>> Yeah. Tough kids.
12:08
>> Thailand to one of the poorest places in
12:10
America or if not the poorest
12:14
as a 9-year-old.
12:17
>> Yeah. It was my first experience with
12:20
your brother.
12:21
>> Wow.
12:22
>> Yeah. Yeah. No, I I remember and what
12:23
breaks my heart probably the only thing
12:26
that really breaks my heart of
12:28
about that experience was
12:32
so
12:35
we didn't have enough money to make you
12:37
know international phone calls every
12:40
week and so my parents gave us this tape
12:41
deck this Iowa tape deck and a tape
12:44
and so every month we would sit in front
12:51
on that tape deck and that my older
12:54
brother Jeff and I,
12:56
the two of us would just tell them what
12:59
we did the whole month.
13:01
>> Wow.
13:04
>> And we would send that tape by mail
13:06
and my parents would take that tape and
13:09
record back on top of it and send it
13:12
back to us.
13:14
>> Wow.
13:17
>> Could you imagine if for two years
13:17
>> Wow. is that tape still existed
13:20
of these two kids just describing their
13:23
first experience with United States.
13:25
Like I remember telling my parents
13:28
that that uh I joined the swim team and
13:31
uh
13:37
my roommate was really buff and so every
13:40
day we spent a lot of time in the in the
13:42
gym and so uh uh every night 100
13:44
push-ups, 100 sit-ups every day in the
13:48
gym. So, I was nine years old. I was
13:50
getting I was pretty buff
13:51
and I'm pretty fit. And uh
13:54
and so I joined the soccer team. I
13:58
joined the swim team because if you join
14:00
the team, they take you to meets and
14:03
then afterwards you get to go to a nice
14:06
restaurant. And that nice restaurant was
14:08
McDonald's.
14:10
>> Wow.
14:11
>> And and I recorded this thing. And I
14:12
said, "Mom and dad, we went to the most
14:15
amazing restaurant today.
14:17
This whole place is lit up. It's like
14:20
the future."
14:22
And [snorts] the food comes in a box
14:24
[laughter]
14:28
and the food is incredible. The
14:31
hamburger is incredible. It was
14:32
McDonald's. [snorts] But anyhow, it it
14:34
wouldn't it be amazing?
14:37
>> Oh my god. Two years recording. Yeah.
14:38
Two years. Yeah. What a crazy connection
14:40
to your parents, too. Just sending a
14:44
tape and them sending you one back and
14:46
it's the only way you're communicating
14:48
for two years.
14:50
>> Yeah. Wow. Yeah. No, I've My parents are
14:51
incredible actually. They're just
14:56
they're uh they grew up really poor and
14:58
um when they came to United States, they
15:01
had almost no money. Uh probably one of
15:03
the most
15:06
impactful memories I have is is uh we
15:09
they came and we were we were staying in
15:12
a in a in a uh apartment complex
15:14
and they had they had just rent back in
15:21
the I guess people still do rent rent a
15:23
bunch of furniture
15:26
and
15:29
we were messing around
15:31
and uh
15:36
we bumped into the coffee table and
15:38
crushed it. It's made out of particle
15:40
wood and we crushed it.
15:42
And I just still remember my the look on
15:46
my mom's face, you know, because they
15:49
didn't have any money and she didn't
15:51
know how she was going to pay it back.
15:52
And but anyhow, that's that kind of
15:54
tells you how hard it was for them to
15:56
come here. They they left everything
15:58
behind and all they had was their
16:00
suitcase and the money they had in their
16:02
in their pocket and they came to United
16:05
States.
16:07
>> How old were they pursued the American
16:08
dream? They were in their 40s.
16:09
>> Wow.
16:10
>> Yeah. Late late 30s.
16:11
>> Pursued the American dream. This is this
16:13
is the American dream. I'm the first
16:15
generation of the American dream.
16:17
>> Wow.
16:19
>> Yeah. It's hard not to love this
16:20
country.
16:21
>> That's
16:23
>> it's it's hard not to be romantic about
16:23
this country.
16:25
>> That is a romantic story. That's an
16:26
amazing story.
16:28
>> Yeah. And and my dad found his job
16:29
literally in the newspaper,
16:32
you know, the ads and he calls people.
16:34
Got a job.
16:38
>> What did he do?
16:39
>> Uh he was a consulting engineer and a
16:40
and a consulting firm and they helped
16:43
people build oil refineries, paper mills
16:45
and fabs. And that's what he did. He was
16:49
an he he's really good at factory design
16:51
instrumentation engineer. And so he's
16:55
he's brilliant at that. And so he did
16:59
that and my mom uh worked as a maid and
17:01
uh they found a way to raise us.
17:05
>> Wow.
17:08
That's an incredible story, Jensen. It
17:10
really is. Every all of it from your
17:12
childhood to the perils of Nvidia almost
17:15
falling. [laughter]
17:19
It's really incredible, man.
17:21
>> It's a great story. Yeah. I I've lived a
17:22
great life.
17:25
>> You really have. And it's a great story
17:26
for other people to hear, too. It really
17:28
is.
17:30
>> You don't You don't have to go to Ivy
17:30
League schools to succeed.
17:33
This country creates opportunities. Has
17:36
opportunities for all of us. You do have
17:38
to strive.
17:40
You have to claw your way here.
17:43
>> Yeah.
17:45
>> But if you put in the work, you can
17:46
succeed.
17:48
Nobody works with
17:49
>> a lot of luck and a lot of
17:50
>> a lot and
17:51
>> good decision- making
17:52
>> and the good graces of others.
17:53
>> Yes, that's really important.
17:55
>> Yeah. You and I spoke about two two
17:57
people who are very dear to me. Um but
17:59
the list goes on. the people the people
18:02
at NVIDIA who have have uh helped me um
18:05
uh many friends that are on the board uh
18:10
the decisions you know them giving me
18:13
the opportunity like when we were
18:15
inventing this new computing approach
18:16
I tanked our stock price because we
18:19
added this thing called CUDA to the chip
18:22
we had this big idea we added this thing
18:24
called CUDA to the chip but nobody paid
18:26
for it but our cost doubled and so we
18:28
had this graphics chip company and we
18:31
invented GPUs, we invented programmable
18:34
shaders, we invented everything modern
18:37
computer graphics,
18:39
we invented real-time tracing. That's
18:42
why it went from GTX to RTX.
18:44
We invented all this stuff, but every
18:48
time we invented something,
18:50
the market doesn't know how to
18:53
appreciate it, but the cost went way up.
18:54
And in the case of CUDA that enabled AI,
18:56
the cost increased a lot. it and but I
19:00
really we really believed it you know
19:03
and so if you believe in that future and
19:06
you don't do anything about it you're
19:09
going to regret it for your life
19:10
and so we always you know I always tell
19:13
the team do you believe what do we
19:15
believe this or not and if you believe
19:17
it and so grounded on first principle is
19:19
not random you know hearsay and we
19:21
believe it we've got to we owe it to
19:25
ourselves to go pursue it if we're the
19:26
right people to go do it if it's really
19:29
really hard to do. It's worth doing and
19:31
we believe it. Let's go pursue it.
19:33
Well, we pursued it. We we launched the
19:36
product. Nobody knew. It was exactly
19:38
what like when I launched DGX1 and the
19:40
entire audience was like
19:42
complete silence. When I launched CUDA,
19:45
the audience was complete silence. No
19:48
customer wanted it. Nobody asked for it.
19:52
Nobody understood it. Nvidia was a
19:56
public company.
19:58
>> What year was this? This is uh
19:59
uh let's see 200
20:02
2006
20:05
20 years ago
20:07
2005.
20:10
>> Wow.
20:12
>> Our stock price just went
20:14
our valuation went down to like two or
20:18
three billion dollars
20:21
>> from
20:23
>> from about 12 or something like that.
20:24
I crushed it.
20:28
>> [laughter]
20:29
>> in a very bad way.
20:30
>> Yeah.
20:32
>> What is it now though?
20:32
>> H Yeah, it's higher. [laughter]
20:34
>> Very humble of you. [gasps]
20:38
>> It's higher. But it changed the world.
20:40
>> Yeah,
20:43
>> that invention changed the world.
20:43
>> It's a It's an incredible story,
20:46
Johnson. It really is.
20:47
>> Thank you.
20:50
>> I like your story. It's incredible. Ah,
20:51
>> my story is not as incredible. My story
20:53
is more weird,
20:55
you know.
20:57
It's much more fertuitous and weird.
20:59
>> Okay. What are the three milestones that
21:01
most important milestones that led to
21:04
here?
21:06
>> That's a good question. Um,
21:10
>> what was step one?
21:12
>> I think step one was seeing other people
21:13
do it. Step one was in the initial days
21:17
of podcasting, like in 2009 when I
21:20
started, podcasting had only been around
21:23
for a couple of years. Um, the first was
21:25
Adam Curry, my good friend, who was the
21:28
podfather. He he invented podcasting.
21:31
And then, you know, um, I remember Adam
21:34
Corolla had a show because he had a
21:37
radio show. His radio show got cancelled
21:38
and so he decided to just do the same
21:41
show but do it on the internet. And that
21:42
was pretty revolutionary. Nobody was
21:44
doing that. And then there was the
21:45
experience that I had had doing
21:47
different morning radio shows like Opie
21:49
and Anthony in particular because it was
21:51
fun and we would just get together with
21:55
a bunch of comedians, you know, I'd be
21:56
on the show with like three or four
21:59
other guys that I knew and it was always
22:00
just looked forward to it. It was was
22:02
just such a good time and I said, "God,
22:04
I miss doing that. It's so fun to do
22:07
that. I wish I could do something like
22:08
that." And then I saw Tom Green setup.
22:09
Tom Green had a setup in his house and
22:12
he essentially turned his entire house
22:14
into a television studio and he did an
22:16
internet show from his living room. He
22:19
had servers in his house and cables
22:21
everywhere. Had to step over cables. I
22:22
was this is like 2007. I'm like Tom this
22:24
is nuts. Like this is
22:26
>> and I'm like you got to figure out a way
22:28
to make money from this. Like this
22:29
everybody I wish everybody in the
22:31
internet could see your setup. It's
22:32
nuts. I just want to let you guys know
22:34
that [laughter]
22:35
>> it's not just this.
22:37
>> Yeah. So that was the the beginning of
22:39
it is just seeing other people do it and
22:41
then saying all right let's just try it
22:43
and then so the beginning days we just
22:44
did it on a laptop had a laptop with a
22:47
webcam and just messed around had a
22:49
bunch of comedians come in we would just
22:51
talk and joke around and I did it like
22:53
once a week and then I started doing it
22:56
twice a week and then all a sudden I was
22:57
doing it for a year and then I was doing
23:00
it for two years then it was like oh
23:01
it's starting to get a lot of viewers a
23:03
lot of listeners you know and then I
23:05
just kept doing It's all it is. I just
23:08
kept doing it because I enjoyed doing
23:10
it. Well, was there any setback?
23:12
>> No. No, there was never really a setback
23:15
really.
23:17
>> No,
23:17
>> it must have been. Or you kind of
23:18
>> You're just You're just resilient.
23:19
>> Or you're just tough.
23:22
>> No. No. No. No. It wasn't tough or hard.
23:23
It was just interesting. So, I just it
23:26
the the
23:28
>> You were never once punched in the face.
23:29
>> No, not in the show. No, not really. Not
23:30
Not doing the show.
23:32
>> You never did something that that
23:33
big blowback. Nope.
23:37
Not really. No, it all just kept
23:40
growing.
23:42
>> It kept growing and the thing stayed the
23:43
same from the beginning to now. And the
23:46
thing is, I enjoy talking to people.
23:48
I've always enjoyed talking to
23:50
interesting people.
23:51
>> I could even tell just when we walked
23:52
in, the way you interacted with
23:53
everybody, not just me.
23:55
>> Yeah, that's cool.
23:57
>> People are cool.
23:58
>> Yeah, that's cool. You know, I I it's a
23:59
an amazing gift to be able to have so
24:02
many conversations with so many
24:06
interesting people because it changes
24:07
the way you see the world because you
24:09
see the world through so many different
24:11
people's eyes and you have so many
24:12
different people have different
24:15
perspectives and different opinions and
24:16
different philosophies and different
24:18
life stories. And you know, it's an
24:20
incredibly enriching and educating
24:24
experience having so many conversations
24:26
with so many amazing people. And that's
24:30
all I started doing. And that's all I do
24:33
now. Even now, when I booked the show, I
24:36
do it on my phone. And I basically go
24:39
through this giant list of emails of all
24:41
the people that want to be on the show
24:44
or that request to be on the show. And
24:46
then I factor in another list that I
24:48
have of people that I would like to get
24:50
on the show that I'm interested in. And
24:52
I just map it out and that's it. And I
24:53
go, "Oh, I'd like to talk to him."
24:56
>> If it wasn't because of President Trump,
24:58
I wouldn't have been bumped up on that
24:59
list. [laughter]
25:00
>> No, I wanted to talk to you already. I I
25:01
just think, you know, what you're doing
25:04
is very fascinating. I mean, how would I
25:06
not want to talk to you? And then today,
25:08
it proved to be absolutely the right
25:09
decision.
25:11
>> Well, you know, listen, it's it's
25:12
strange to be an immigrant one day.
25:14
going to Onita Baptist Institute
25:18
with with the students that were there
25:21
and then here
25:24
Nvidia's one of the most consequential
25:26
companies in the history of companies.
25:29
>> It is a crazy story.
25:32
>> It has to be that journey is is a and
25:34
it's very humbling and
25:37
>> and um I'm very grateful.
25:39
>> It's pretty amazing man.
25:41
>> Surrounded by amazing people. You're
25:42
very fortunate and you've also you seem
25:44
very happy and you seem like you're 100%
25:46
on the right path in this life. You
25:49
know,
25:51
>> you know, everybody says you must love
25:51
your job. Not every day. [laughter]
25:54
>> That's not that's part of the beauty of
25:56
everything is that there's ups and
25:59
downs. It's never just like this giant
26:00
dopamine high.
26:02
>> We leave we leave this impression here.
26:03
Here's here's an impression I don't
26:06
think is healthy. We we um people who
26:07
are successful leave the impression
26:12
often that that
26:13
our job gives us great joy. I think
26:16
largely it does
26:19
that our jobs were passionate about our
26:22
work.
26:25
Um and that passion relates to it's just
26:27
so much fun. I think it largely is, but
26:30
it it it distracts from in fact a lot of
26:35
success comes from really really hard
26:38
work.
26:42
>> Yes,
26:42
>> there's long periods of suffering and
26:44
loneliness and uncertainty and fear and
26:49
embarrassment and humiliation. all of
26:54
the feelings that we most not love that
26:57
creating something
27:02
from the ground up and and Elon will
27:04
tell you something similar very
27:07
difficult to invent invent something new
27:09
>> and people people don't believe you all
27:12
the time you're humiliated often
27:15
disbelieved most of the time and so so
27:17
people forget that part of success and
27:21
and I I don't think it's health. I think
27:24
it's it's good that we pass that forward
27:26
and let people know that that it's just
27:29
part of the journey.
27:31
>> Yes.
27:32
>> Suffering is part of the journey.
27:34
>> You will appreciate it so these horrible
27:35
feelings that you have when things are
27:37
not going so well. You will appreciate
27:39
it so much more when they do go well.
27:41
>> Deeply grateful.
27:43
>> Yeah.
27:44
>> Yeah. Deep deep pride. Incredible pride.
27:45
In incredible incredible gratefulness
27:49
and and and surely incredible memories.
27:51
Absolutely. Jensen, thank you so much
27:54
for being here. This was really fun. I
27:56
really enjoyed it and your story is just
27:58
absolutely incredible and very
28:01
inspirational and and I you know, I
28:02
think it really is the American dream.
28:06
It is the American dream.
28:07
>> It really is. Thank you so [music] much.
28:08
Thank you. All right. Bye, everybody.
28:10
[music]
28:15
Lyrics & Translation
[English]
Joe Rogan podcast. Check it out.
>> The Joe Rogan Experience.
>> TRAIN BY DAY. JOE ROGAN PODCAST BY
NIGHT. All day.
>> Hello. Hey, Joe.
>> Good to see you again. We were just
talking about Was that the first time we
ever spoke or did was the first time we
spoke at at SpaceX?
>> SpaceX.
>> SpaceX. The first time when you were
giving Elon that crazy AI chip,
>> right? DJX Spark.
>> Yeah. Oo, that was a big moment. That
was a huge
>> That felt crazy to be there. I was like
watching these wizards of tech like
exchange information and and you're
giving him this crazy device, you know,
and then the other time was uh I was
shooting arrows in my backyard and uh
randomly get this call from Trump and
he's hanging out with you. President
Trump called and I called you.
>> Yeah. It's just
>> we were talking about you. [laughter]
>> It's just talking about he was talking
about the US UFC thing he was going to
do in his front yard.
>> Yeah. And he pulls out. He's JJS, look
at this design. He's so proud of it. And
I go, "You're going to have a fight in
the front lawn in the White House." He
goes, "Yeah, yeah, you're going to come.
This is going to be awesome." And he's
showing me his design and how beautiful
it is. And he goes, and somehow your
name comes up. He goes, "Do you know
Joe?" And I said, "Yeah, I'm going to be
on his podcast." He Let's call him.
[laughter]
>> He's like a kid.
>> I know. Let's call him. It's so He's
like a 79y old kid.
>> Oh, he's so incredible.
>> Yeah, he's an odd guy. Just very
different, you know, like the what you'd
expect from him. Very different than
what people think of him. And also just
very different as a president. A guy who
just calls you or texts you out of the
blue. Also, he makes when you te you.
You have an Android, so it won't go
through with you, but with my iPhone, he
makes the text go big.
>> Like, you know, USA is respected again.
like [laughter]
all caps and it makes the te the the the
text enlarge is kind of ridiculous.
>> Well, the the 101 Trump President Trump
is very different. He he surprised me f
first of all he's an incredibly good
listener. Almost everything I've ever
said to him, he's remembered.
>> Yeah. People don't they only want to
look at negative stories about him or
negative narratives about him. You know,
you can catch anybody on a bad day. Like
there's a lot of things he does where I
don't think he should do. Like I don't
think he should say to a reporter rep
reporter, "Quiet piggy." Like that's
pretty ridiculous. Also objectively
funny. I mean, it's unfortunate that it
happened to her. I wouldn't want that to
happen to her, but it was funny. Just
ridiculous that the president does that.
I wish he didn't do that. But other than
that, like he's he's an interesting guy.
Like he's a lot of different things
wrapped up into one person, you know?
You know, part of part of his charm,
well, part of his genius is Yes. He says
what's on his mind.
>> Yes.
>> And which is like an anti-olitician in a
lot of ways.
>> So, you know, what's on his mind is
really what's on his mind,
>> which
I I do some people some people would
rather be lied to.
>> Yeah. But but I I like the fact that
he's telling you what's on his mind. Um,
almost every time he explains something,
he says something,
he starts with his, you could tell, his
love for America, what he wants to do
for America. And everything that he
thinks through is very practical and
very common sense. And, you know, it's
very logical and um
I still remember the first time I I met
him and so this was I I'd never known
him, never met him before. and um uh
Secretary Lutnik called and we met right
before right at the beginning of the
administration. He said he told me what
was important to President Trump that
that um uh that United States
manufactures on shore and that was
really important to him because because
uh it's important to national security.
He wants to make sure that that the
important critical technology of our
nation is built in the United States and
that we re-industrialize
and get good at manufacturing again
because it's important for jobs.
>> It just seems like common sense, right?
>> Incredible common sense. And and that
was like literally the first
conversation I had with Secretary Letic
um and he was talking about how how um
that he started he started our
conversation with uh Jensen. This is
Secretary Lutnik and I I just want to
let you know that you're a national
treasure. Uh Nvidia is a national
treasure and whenever you need access to
the president um the administration uh
you call us. We're always going to be
available to you. Literally, that was
the first sentence.
>> That's pretty nice.
>> And it was completely true. every single
time I called, if I needed something, I
want to get something off my chest, um,
express some concern, uh, they're always
available. Incredible. It's just
unfortunate we live in such a
politically polarized society that you
can't recognize good common sense things
if they're coming from a person that you
object to. And that, I think, is what's
going on here. I think most people
generally a as a country, you know, as a
a giant community, which we are, it just
only makes sense that we have
manufacturing in America that especially
critical technology like you're talking
about. Like it's kind of insane that we
buy so much technology from other
countries.
>> If United States doesn't grow, we will
have no prosperity. We can't invest in
anything domestically or otherwise. we
can't fix any of our problems. If we
don't have energy growth, we can't have
industrial growth. If we don't have
industrial growth, we can't have job
growth. These it's as simple as that,
>> right?
>> And the fact that the fact that he came
into office and the first thing that he
said was drill baby drill. His point is
we need energy growth. Without energy
growth, we can have no industrial
growth. And that was it saved it saved
the AI industry. got I got to tell you
flat out if not for his progrowth energy
policy
we would not be able to build factories
for AI not be able to build chip
factories we won't sure surely won't be
able to build supercomputer factories
none of that stuff would be possible
without all of that
construction jobs would be challenged
right electrical you know electrician
jobs all of these jobs that are now
flourishing would be challenged and so I
think he's got it right we need energy
growth We want to re-industrialize the
United States. We need to be back in
manufacturing. Every successful person
doesn't need to have a PhD. Every
successful person doesn't have to have
gone to Stanford or MIT. And I think I
think that that that you know that
sensibility is is um spot on. Now, when
we're talking about technology growth
and energy growth, there's a lot of
people that go, "Oh, no. That's not what
we need. We need to, you know, simplify
our lives and get back." But the the
real issue is that we're in the middle
of a giant technology race. And whether
people are aware of it or not, whether
they like it or not, it's happening. And
it's a really important race because
whoever gets to
whatever the event horizon of artificial
intelligence is, whoever gets there
first has massive advantages in a huge
way.
Do you agree with that? Well, first the
part I I will say that we are in a
technology race and we are always in a
technology race. We've been in a
technology race with somebody forever.
>> Right.
>> Right. Since the industrial revolution,
we've been in a technology
>> since the Manhattan project.
>> Yeah.
>> Or or you know, even going back to the
discovery of energy, right? The United
Kingdom was where the industrial
revolution was, if you will, invented
when they realized that they can turn
steam and such into into energy into
electricity.
All of that was invented largely in
Europe and the United States capitalized
on it. We were the ones that learned
from it. We industrialized it. We
diffused it faster than anybody in
Europe. They were all stuck in
discussions about
policy and
jobs and disruptions. Meanwhile, the
United States was forming. We just took
the technology and ran with it. And so I
I think we were always in in a bit of a
technology race. World War II was a
technology race. Manhattan Project was a
technology race. We've been in the
technology race ever since during the
Cold War. I think we're still in a
technology race. It is probably the
single most important race. It is the
technology is uh it gives you
superpowers.
you know whether it's information
superpowers or energy superpowers or
military superpowers is all founded in
technology and so technology leadership
is really important
>> well the problem is if somebody else has
superior technology right that's that's
the issue it seems like with the AI race
people are very nervous about it like
you know Elon has famously said there
was like 80% chance it's awesome 20%
chance we're in trouble and people are
worried about that 20% % rightly so. I
mean that you know if you had 10 bullets
in a a a revolver and you know you you
took out eight of them and you still
have tw two in there and you spin it,
you're not going to feel real
comfortable when you pull that trigger.
It's terrifying,
>> right?
>> And when we're working towards this
ultimate goal um of AI,
it it just it's
impossible to imagine that it wouldn't
be of national security interest to get
there first.
We should The question is what's there?
That's the That was the part that
>> What is there?
>> Yeah. I'm not sure.
>> And I don't think anybody I don't think
anybody really knows.
>> That's crazy though. If I ask you,
>> you're the head of Nvidia. If you don't
know what's there, who knows?
>> Yeah. I I think it's probably going to
be much more gradual than we think. It
won't It won't be a moment. It won't be
It won't be as if um somebody arrived
and nobody else has. I don't think it's
going to be like that. I think it's
going to be things that just get better
and better and better and better just
like technology does.
>> So, you are rosy about the future.
You're you're very optimistic about
what's going to happen with AI.
>> Obviously, will you make the best AI
chips in the world?
>> You probably better be.
>> Uh h if history is a guide, um uh we
were always concerned about new
technology.
Humanity has always been concerned about
new technology. There are always
somebody who's thinking there always a
lot of people who are quite concerned.
were quite concerned and and and so if
if history is a guide, it is the case um
that all of this concern is channeled
into making the technology safer.
And so for example, in the last several
years, I would say AI technology has
increased probably in the last two years
alone, maybe a 100x. Let's just give it
a number, okay? It's like a car two
years ago was 100 times slower. So AI is
100 times more capable today. Now, how
did we channel that technology? How do
we channel all of that power? We
directed it to um causing the AI to be
able to think, meaning that it can take
a problem that we give it, break it down
step by step.
It does research before it answers. And
so it grounds it on truth.
It'll reflect on that answer. Ask
itself, is this the best, you know,
answer that I can give you. Am I certain
about this answer? If it's not certain
about the answer or highly confident
about the answer, it'll go back and do
more research. It might actually even
use a tool because that tool provides a
better solution than it could
hallucinate itself. As a result, we took
all of that computing capability and we
channeled it into having it produce a
safer result, safer answer, a more
truthful answer because as you know, one
of the greatest criticisms of AI in the
beginning was that it hallucinated,
>> right?
>> And so if you look at the reason why
people use AI so much today is because
the amount of hallucination has reduced.
You know, I use it almost I well I used
it the whole trip over here and so so I
think the
the uh the the capability most people
think about power
and they think about you know maybe as
an explosion power but the technology
power most of it is channeled to towards
safety. A car today is more powerful but
it's safer to drive. A lot of that power
goes towards better handling. You know,
I'd rather have a Well, you have a 1000
horsepower truck. I think 500 horsepower
is pretty good. No, I thousand's better.
I think a th00and is better.
>> I don't know if it's better, but it's
definitely faster.
>> Yeah. No, I think it's better. You can
get out of trouble faster. Um,
I enjoyed my 599 more than my 612. It
was I think it was a better better
horsepower is better. My 459 is better
than my 430.
more horsepower is better. I I think
more horsepower is better. I think it's
better handling. It's better control. In
the case of in the case of technology,
it's also very similar in that way, you
know. And so if you if you look at what
we're going to do with the next thousand
times of performance in AI, a lot of it
is going to be channeled towards more
reflection, more research,
thinking about the answer more deeply.
So when you're defining safety, you're
defining a it as accuracy,
>> functionality.
>> Functionality. Okay.
>> It it does what you expect it to do. And
then you take all the the the technology
in the horsepower, you put guard rails
on it, just like our cars. We've got a
lot of technology in in a car today. A
lot of it is goes towards, for example,
ABS. ABS is great. And so, uh, traction
control, that's fantastic. without a
without a computer in the car, how would
you do any of that,
>> right?
>> And that little computer, the computers
that you have doing your traction
control is more powerful than the
computer that went to Apollo 11. And so
you want that technology,
channel it towards safety, channel it
towards functionality. And so when
people talk about power, the advancement
of technology, often times I I I feel
what they're thinking and what we're
actually doing is very different.
>> Well, what do you think they're
thinking? Well, they're thinking somehow
that this this uh this AI is being
powerful and their their mind probably
goes towards a sci-fi movie. The
definition of power, you know, often
times the definition definition of power
is military power or physical power. But
in in the case of technology power when
we translate all of those operations
it's towards more refined thinking you
know more reflection more planning more
options
>> I think the big fears that people have
is one a big fear is military
applications that's a big fear
>> because people are very concerned that
you're going to have
>> AI systems that make decisions that
maybe an ethical person wouldn't make or
a moral person wouldn't make based on
achieving an objective versus based on,
you know, how it's going to look to
people.
>> Well, I'm I'm happy that that uh our
military is going to use AI technology
for defense and I think that that um uh
Andural uh building military technology.
I'm happy to hear that. I'm happy to see
um all these tech startups now
channeling their technology capabilities
towards defense and military
applications. I think you needed to do
that.
>> Yeah, we had Palmer Lucky on the
podcast. He was demonstrating some of
the stuff I put his helmet on. And we
show we he showed some videos how you
could see behind walls and stuff like
it's nuts.
>> And he's he's actually the perfect guy
to go start that company.
>> 100%. [laughter] Yeah. 100%. It's like
he was born for that. Yeah. He came in
here with a copper jacket on. He's a
freak. [clears throat] It's [laughter]
awesome. He's awesome. But it's also
it's a you know an unusual intellect
channeled into that very bizarre field
is what you need, you And I think it's
it's uh I think I'm happy that we're
making it so more socially acceptable.
You know, there was a time where when
somebody wanted to channel their
technology capability and their
intellect into defense technology, uh
somehow they're vilified. Um but uh we
need people like that. We need people
who enjoyed enjoy that part of uh
application of technology.
>> Well, people are terrified of war, you
know. So it depends.
>> Best way to avoid it has excessive
military might.
>> Do you think that's absolutely the best
way? Not not diplomacy, not working
stuff out.
>> All of it.
>> All of it. You have to have military
might in order to get people to sit down
with you.
>> Right. Exactly. All of it.
>> Otherwise, they just invade.
>> That's right. [laughter] Why ask for
permission?
>> Again, like you said, history. Go back
and look at history. Um, when you look
at the future of AI and and you just
said that no one really knows what's
happening, do you ever sit down and
ponder scenarios?
>> Like what do you what do you think is
like bestcase scenario for AI over the
next two decades?
Um
the best case scenario is that AI
diffuses into everything that we do and
uh our
everything's more efficient but
the threat of war remains a threat of
war.
Uh, cyber security remains
a super difficult challenge.
Somebody is going to try to
breach your security. You're going to
have thousands of millions of AI agents
protecting you from that threat.
Your technology is going to get better.
Their technology is going to get better.
Just like cyber security. Right now,
while we speak, we're being
we're seeing cyber attacks all over the
planet on just about every front door
you can imagine.
And
and yet you and I are sitting here
talking. And so the reason for that is
because we know that there's a whole
bunch of cyber security technology in
defense. And so we just have to keep
amping that up, keep stepping that up.
This episode is brought to you by
Visible. When your phone plans as good
as visible, you've got to tell your
people. It's the ultimate wireless hack
to save money and still get great
coverage and a reliable connection. Get
one line wireless with unlimited data
and hotspot for $25 a month. Taxes and
fees included, all on Verizon's 5G
network. Plus, now for a limited time,
new members can get the Visible plan for
just $19 a month for the first 26
months. Use promo code switch 26 and
save beyond the season. It's a deal so
good you're going to want to tell your
people. Switch now at visible.com/rogan.
Terms apply. Limited time offers subject
to change. See visible.com for planned
features and network management details.
That's a big issue with people is the
the worry that technology is going to
get to a point where encryption is going
to be obsolete. Encryption is just it's
no longer going to protect data. It's no
longer going to protect systems. Do you
anticipate that ever being an issue or
do you think there's it's as the defense
grows, the threat grows, the defense
grows, and it just keeps going on and on
and on and they'll always be able to
fight off any sort of intrusions?
>> Not forever. some intrusion will get in
and then that we'll all learn from it.
And you know the reason why cyber
security works is because of course the
technology of defense is advancing very
quickly. The technology offense is
advancing very quickly. However, the
benefit of the cyber security defense is
that socially the community all of our
companies work together as one. Most
people don't realize this.
There's a whole community of cyber
security experts. We exchange
ideas. We exchange best practices. We
exchange what we detect. The moment
something has been breached or maybe
there's a loophole or whatever it is, it
is shared by everybody. The patches are
shared with everybody.
>> That's interesting.
>> Yeah. Most people don't realize this.
>> No, I had no I had no idea. I've assumed
that it would just be competitive like
everything else.
>> We work together. Interesting. Has that
always been the case?
>> Uh, it surely has been the case for
about about 15 years. It might not have
been the case long ago, but this this
>> what do you think started off that
cooperation?
>> Um, people recognizing it's a challenge
and no company can stand alone.
>> And the same thing is going to happen
with AI. I think we all have to decide
work working together uh to stay out of
harm's way is is our best chance for
defense. Then it's basically everybody
against the threat.
>> And it also seems like you'd be way
better at detecting where these threats
are coming from and neutralizing them.
>> Exactly. Because the moment you detect
it somewhere,
>> you're going to find out right away.
>> It'll be really hard to hide.
>> That's right.
>> Yeah.
>> That's how it works. That's the reason
why it's safe. That's why I'm sitting
here right now instead of, you know,
locking everything down in video.
[laughter]
>> It's not only am I watching my own back,
I've got everybody watching my back. and
I'm watching everybody else's back.
>> It's a bizarre world, isn't it? When you
think about that cyber threat,
>> this idea about cyber security is
unknown to the people who are talking
about AI threats. They're I think when
they think about AI threats and AI cyber
security threats, they have to also
think about how we deal with it today.
Now, there's no question that AI is a
new technology
and it's a new type of software. In the
end, it's software just it's a new type
of software and so it's going to have
new capabilities but so will the defense
you know where you use the same AI
technology to go defend against it. So
you do you anticipate a time ever in the
future where it's going to be impossible
where there's not going to be any
secrets where the bottleneck between the
technology that we have and the
information that we have. Information is
just all a bunch of ones and zeros. It's
out there on hard drives and the
technology has more and more access to
that information. Is it ever going to
get to a point in time where there's no
way to keep a secret?
>> I don't think
>> because it seems like that's where
everything is kind of headed in a weird
way.
>> I don't think so. I think the quantum
computers were supposed to will Yeah.
quantum computers will make it possible
will make it so that the previous
quantum previous encryption technology
is obsolete. But that's the reason why
the entire industry is working on
postquantum
encryption technology.
>> What would that look like?
>> New algorithms.
>> But the crazy thing is when you hear
about the kind of computation that
quantum computing can do.
>> Yeah.
>> And the the power that it has. Yeah.
>> Where you know you're looking at
>> all the supercomputers in the world. It
would take billions of years and it
takes them a few minutes to solve these
equations. Like how do you make
encryption for something that can do
that? I'm not sure, but there's
[laughter]
but I've got a bunch of scientists who
are working on that.
>> Boy, I hope they [snorts] could figure
it out.
>> Yeah, we got a bunch of scientists who
are expert in that. And
>> is the ultimate fear that it can't be
breached that quantum computing will
always be able to to decrypt all other
quantum computing encryption?
>> I don't think that
>> it just gets to some point where it's
like, stop playing the stupid game. We
know everything.
>> I don't think so.
>> No,
>> because I I'm you know, history is
guide.
History is a guide before AI came
around. That's my worry. My worry is
this is a totally, you know, it's like
history was one thing and then nuclear
weapons kind of changed all of our
thoughts on war and mutually assured
destruction came
everybody to stop using nuclear bombs.
>> Yeah.
>> My worry is that
>> the thing is Joe is that that AI is not
going to it's not like we're cavemen and
then all of a sudden one day AI shows
up. every single day we're getting
better and smarter because we have AI
and so we're stepping on our own AI's
shoulders. So when when that whatever
that AI threat comes, it's a click
ahead. It's not a galaxy ahead,
>> you know, it's just a click ahead. And
so so I think I think the the the idea
that somehow this AI
is going to pop out of nowhere and
somehow think in a way that we can't
even imagine thinking and do something
that we can't possibly imagine I think
is far-fetched. And the reason for that
is because we're all have we all have
AIs and you know there's a whole bunch
of AIs being in development. we know
what they are and we're using it and and
so every single day we're getting we're
close to each other.
>> But don't they do things that are very
surprising?
>> Yeah. But so you you have an AI that
does something surprising. I'm going to
have an AI and my AI looks at your AI
and goes that's not that surprising.
>> The fear for the lay person like myself
is that AI becomes sentient and makes
its own decisions
and then ultimately decides to just
govern the world. do it its own way.
They're like, "You guys, you had a good
run, but
>> we're taking over now."
>> Yeah, but my my AI is gonna take care of
me. I mean, [laughter]
so that's the this is the cyber security
argument.
>> Yes.
>> Do you have an AI and it's super smart,
but my AI is super smart, too. And and
maybe your AI. Let let's pretend let's
let's pretend for a second that we
understand what consciousness is and we
understand what sentience is and and
that in fact
>> and we really are just pretending.
>> Okay, let's just pretend for a second
that we we believe that. I don't believe
actually I don't actually don't believe
that but nonetheless we let's pretend we
believe that.
>> So your your your AI is conscious and my
AI is conscious and and let's say your
AI is you know wants to I don't know do
something surprising.
My AI is so smart that it won't it might
be surprising to me, but it probably
won't be surprising to my AI. And so
maybe my AI
thinks it's surprising as well, but it's
so smart the moment it sees it the first
time, it's not going to be a surprise
the second time, just like us. And so I
feel like I think the idea that that
only one person has [clears throat] AI
and that one person's AI is compares
everybody else's AI is Neanderthal
[snorts] is um probably unlikely. I
think it's much more like cyber
security.
>> Interesting.
>> I think the fear is not that your AI is
going to battle with somebody else's AI.
The fear is that AI is no longer going
to listen to you. That's the fear is
that human beings won't have control
over it after a certain point if it
achieves sensience and then has the
ability to be autonomous
>> that there's one AI.
>> Well, they just combine.
>> Yeah. Becomes one AI
>> that it's a life form.
>> Yeah.
>> But that's the there's arguments about
that, right? That we're dealing with
some sort of synthetic biology that it's
not as simple as new technology that
you're creating a life form.
>> If it's like life form,
let's go along with that for a while. I
think if it's like life form, as you
know, all life forms don't agree. And so
I'm going to have to go with your life
form and my life form are going to agree
because my life form is going to want to
be the super life form. And and now that
now that we have disagreeing life forms,
uh we're back back again to where we
are. Well, they would probably cooperate
with each other.
It would just the reason why we don't
cooperate with each other is we're
territorial primates.
But AI wouldn't be a territorial
primate. It would realize the folly in
that sort of thinking and it would say,
"Listen, there's plenty of energy for
everybody. We we don't need to dominate.
We don't need We're not trying to
acquire resources and take over the
world. We're not looking to find a good
breeding partner. We're just existing as
a new super life form that these cute
monkeys created for us."
Okay. Well, that would be a that would
be a um a superpower with no ego,
>> right? And and if it has no ego,
why would it have the ego to do any harm
to us?
>> Well, I don't assume that it would do
harm to us, but the the fear would be
that we would no longer have control and
that we would no longer be the apex
species on the planet. this thing that
we created would now be. [laughter]
>> Is that funny?
>> No.
>> I just think it's not gonna happen.
>> I know you think it's not gonna happen,
but
>> it could, right? And here's the other
thing is like
>> if we're racing towards could Yeah.
>> And could could be the end of human
beings being in control of our own
destiny.
>> I just think it's extremely unlikely.
>> Yeah.
>> That's what they said in the Terminator
movie [laughter]
>> and it hasn't happened.
>> No, not yet. But you guys are working
towards it. Um the the thing about
you're saying about conscience and
sensience that you don't think that AI
will achieve consciousness or that the
question is what's the definition?
>> Yeah. What's the definition of
>> what is the definition to you?
>> Um uh
consciousness
um
uh f I guess first of all uh you need to
know about your own existence.
Um,
you have to have experience, not just
knowledge and intelligence.
The concept of a machine
having an experience.
I'm not well, first of all, I don't know
what defines experience, why we have
experiences, right?
>> Yeah. and why this microphone doesn't
uh and so it I think I know I well I
think I I I think I know what
consciousness is the sense of experience
the ability to know self versus
um
uh the ability to be able to reflect
know our own self the sense of ego I
think all of all of those human
experiences
uh probably is what consciousness is
but why it exists versus
the concept of knowledge and
intelligence which is what AI is defined
by today [clears throat] it has
knowledge it has intelligence artificial
intelligence we don't call it artificial
consciousness
artificial intelligence the ability to
uh perceive believe, recognize,
understand,
um, plan,
uh, perform tasks.
Those things are foundations of
intelligence
to know things, knowledge.
I don't, it's clearly different than
consciousness.
>> But consciousness is so loosely defined.
How can we say that? I mean, doesn't a
dog have consciousness? Yeah.
>> Dogs seem to be pretty conscious.
>> That's right.
>> Yeah. So, and that's a lower level
consciousness than a human being's
consciousness.
>> I'm not sure. Yeah. Right. Well,
>> the question is what lower level
intelligence? It's lower level
intelligence, but I don't know that it's
lower level consciousness.
>> That's a good point. Right.
>> Because I believe my dogs feel as much
as I feel.
>> Yeah. They feel a lot. Right.
>> Yeah. They get attached to you. That's
right. They get depressed if you're not
there.
>> That's right. Exactly.
>> There's There's definitely that.
>> Yeah. um the the concept of experience,
>> right?
>> Um but isn't AI interacting with
society? So, doesn't it acquire
experience through that interaction?
>> Um I don't think interactions is
experience. I think experience is uh
experience is a collection of feelings.
I think
>> you're aware of that AI um I forget
which one where they gave it some false
information about one of the programmers
having an affair with his wife just to
see how it would respond to it and then
when they said they were going to shut
it down it threatened to blackmail him
and reveal his affair and it was like
whoa like it's conniving like if that's
not learning from experience and being
aware that you're about to be shut down
which would imply at least some kind of
consciousness or you could kind defined
it as consciousness if you were very
loose with the term and if you imagine
that this is going to exponentially
become more powerful. Wouldn't that
ultimately lead to a different kind of
consciousness than we're defining from
biology? Well, first of all, let's just
break down what it probably did. It
probably read somewhere. There's
probably text that that in these
consequences
certain people did that. I could imagine
a novel,
>> right?
>> Having those words related.
>> Sure.
>> And so inside
>> it realizes it strategy for survival is
>> it's just a bunch of numbers
>> that it's just a bunch of numbers that
that in the in the collection of numbers
that relates to a husband cheating on a
wife. Um
has subsequently a bunch of numbers that
relates to blackmail and such things.
However, whatever the revenge was,
>> right?
>> And so it has spewed it out.
>> And so it's just like, you know, it it's
just as if I'm asking it to write me a
poem in Shakespeare. It just whatever
the words are in the world in in that
dimensionality, this dimensionality is
all these vectors and in in
multi-dimensional space. These words
that were in the prompt that described
the affair um subsequently led to one
word after another led to um you know
some revenge and something but it's not
because it had consciousness or you know
it just spewed out those words generated
those words
>> I understand what you're saying that
patterns that human beings have
exhibited both in literature and in real
life
>> that's exactly right
>> but it at a certain point in time one
would say, "Okay, well, it couldn't do
this two years ago and it couldn't do
this four years ago." Like when we're
looking towards the future, like at what
point in time when it can do everything
a person does, what point in time do we
decide that it's conscious? If it
absolutely mimics all human thinking and
behavior patterns,
>> that doesn't make it conscious.
>> It becomes in disccernible. It's it's
aware. It can communicate with you the
exact same way a person can. Like is con
is consciousness are we putting too much
weight on that concept because it seems
like it's a version of a kind of
consciousness.
>> It's a version of imitation.
>> Imitation consciousness, right? But if
it perfectly imitates it,
>> I still think it's a per it's an example
of imitation.
>> So it's like a fake Rolex when they 3D
print them and make them
>> indestruable. The question is what's the
definition consciousness?
>> Yeah.
>> Yeah.
>> That's the question. And I don't think
anybody's really clearly defined that.
That's what get where it gets weird and
that that's where the real doomsday
people are worried that you are creating
a form of consciousness that you can't
control. I believe it is possible to
create a machine
that imitates
human intelligence
and
has the ability to
understand information,
understand
instructions, break the problem down,
solve problems, and perform tasks. I
believe that completely.
I believe that that um we could have a
computer that has a vast amount of
knowledge. Some of it true, some of it
not true.
Some of it generated by humans, some of
it generated synthetically. And more and
more of knowledge in the world will be
generated synthetically going forward.
You know, until now the knowledge that
we've we have are knowledge that we
generate and we propagate and we send to
each other and we amplify it and we add
to it and we modify it. We change it. In
the future,
in a couple of years, maybe two or three
years, 90% of the world's knowledge will
likely be generated by AI.
>> That's crazy.
>> I know. But it's just fine.
>> But it's just fine.
>> I know. And the reason for that is this.
Let me tell you why.
>> Okay?
>> It's because um what difference does it
make to me that I am learning from a
textbook that was generated by a bunch
of people I didn't know or written by a
book that you know from somebody I don't
know uh to uh knowledge generated by AI
computers that are assimilating all of
this and reynthesizing things. To me, I
don't think there's a whole lot of
difference. We still have to we still
have to fact check it. We still have to
make sure that it's you know based on
fundamental first principles and we
still have to do all of that just like
we do today.
>> Is this taking into account the kind of
AI that exists currently? And do you
anticipate that just like we could have
never really believed that AI would be
at least a person like myself would
never believe AI would be as so
ubiquitous and so worth it. It's it's so
powerful today and so important today.
We never thought that 10 years ago.
Never thought that,
>> right?
>> You imagine like what are we looking at
10 years from now?
>> I I think that if you reflect back 10
years from now, you would say the same
thing that we would have never believed
that
>> but
>> in a different direction,
>> right? But if you if you go forward 9
years from now
and then ask yourself what's going to
happen 10 years from now, I think it'll
be quite gradual. Um, one of the things
that Elon said that makes me happy is he
he's he believes that we're going to get
to a point where it's not
it's not necessary for people to work
and not meaning that you're going to
have no purpose in life, but you will
have in his words universal high income
because so much revenue is generated by
AI that it will take away this need for
people to do things that they don't
really enjoy doing just for money. And I
think a lot of people have a problem
with that because their entire identity
and who how they think of themselves and
how they fit in the community is what
they do. Like this is Mike. He's an
amazing mechanic. Go to Mike and Mike
takes care of things. But there's going
to come a point in time where AI is
going to be able to do all those things
much better than than people do. And
people will just be able to receive
money. But then what does Mike do? Mike
is, you know, really loves being the
best mechanic around. You know, what
does the guy who, you know,
codes, what does he do when AI can code
infinitely faster with zero errors? Like
what what happens with all those people?
And that is where it gets weird. It's
like because we've sort of wrapped our
identity as human beings around what we
do for a living.
>> You know, when you meet someone, one of
the first things you meet somebody at a
party, hi Joe. What's your name? Mike.
What do you do? Mike and you know Mike's
like, "Oh, I'm a lawyer." "Oh, what kind
of law?" And you have a conversation,
you know, when Mike is like, "I get
money from the government. I play video
games."
>> Gets weird.
>> Mhm.
>> And I think um the concept sounds great
until you take into account human
nature. And human nature is that we like
to have puzzles to solve and things to
do and and an identity that's wrapped
around our idea that we're very good at
this thing that we do for a living.
>> Yeah. Yeah, I think um let's see, let me
start with the more mundane and I'll
work work backwards, okay? Work forward.
Uh so one of the predictions from uh
Jeff Hinton who who started the whole
deep learning phenomenon the deep
learning technology trend
and uh in incredible incredible
researcher uh professor at University of
Toronto
uh he invented discovered or invented
the the idea of of back propagation
which which uh allows the neural network
to learn.
And um
and as as as you know uh for for the
audience,
software historically was humans
applying first principles and our
thinking to uh describe an algorithm
that is then codified just like a recipe
that's codified in software. It looks
just like a recipe. how to cook
something looks exactly the same just in
a slightly different language. We call
it Python or C or C++ or whatever it is.
In the case of deep learning, this
invention of artificial intelligence,
we put a structure of a whole bunch of
neural networks and a whole bunch of
math units
and we make this large structure. It's
like a switchboard of little
u mathematical units and we connect it
all together.
Um, and we give it the input that
the software would eventually receive
and we just let it randomly guess what
the output is. And so we say, for
example, the input could be a picture of
a cat.
And and um one of the outputs of the
switchboard is where the cat signal is
supposed to show up. And all of the
other signals, the other one's a dog,
the other one's an elephant, the other
one's a tiger.
And all of the other signals are
supposed to be zero when I show it a
cat. And the one that is a cat should be
one.
And I show at a cat through this big
huge network of switchboards and math
units and they're just doing multiply
and adds multiplies and ads. Okay?
And and uh and this thing, this
switchboard is gigantic.
The more information you're going to
give it, the more the bigger this
switchboard has to be. And what Jeff
Hinton discovered was a invented was a
way for you to
guess that put the cat signal in put the
cat image in and that cat image you know
could be a million numbers because it's
you know a megapixel image for example
and it's just a whole a whole bunch of
numbers and somehow from those numbers
it has to light up the cat signal. Okay,
that's the bottom line. And if it the
first time you do it, it just comes up
with garbage. And so it says the right
answer is cat. And so you need to
increase this signal and decrease all of
the other and back propagates the
outcome through the entire network. And
then you show another. Now it's an image
of a dog and it guesses it takes a swing
at it and it comes up with a bunch of
garbage and you say no no no the answer
is this is a dog I want you to produce
dog and all of the other switch all the
other outputs have to be zero and I want
to back propagate that and just do it
over and over and over again. It's just
like uh showing a a kid this is an
apple, this is a dog, this is a cat. And
you just keep showing it to them until
they eventually get it. Okay. Well,
anyways, that big invention is deep
learning. That's the foundation of
artificial intelligence, a piece of
software
that learns from examples. That's
basically we machine learning, a machine
that learns. Uh and so so one of the the
big
first
applications was image recognition and
one of the most important image
recognition applications is radiology.
>> And so so uh uh he predicted uh about 5
years ago that in five years time the
world won't need any radiologists
because AI would have swept the whole
field.
Well, it turns out AI has swept the
whole field. That is completely true.
Today, just about every radiologist is
using AI in some way. And what's ironic
though, what's what's interesting is
that the number of radiologist has
actually grown.
And so the question is why? That's kind
of interesting, right?
>> It is. And so the prediction was in fact
that
30 million radiologists will be wiped
out.
But as it turns out, we needed more. And
the reason for that
[clears throat and cough]
is because the purpose of a radiologist
is to diagnose disease,
not to study the image. This the image
studying is simply a task to in service
of diagnosing the disease. And so now
the fact that you could study the images
more quickly and more precisely
without ever making a mistake and never
gets tired.
You could study more images. You could
study it in
3D form instead of 2D because you know
the AI doesn't care whether it studies
images in 3D or 2D. You could study it
in 4D. And so the now you could study
images in a way that radiologist
radiologists can't easily do and you
could study a lot more of it. And so the
number of tests that people are able to
do increases and because they're able to
serve more patients, the hospital does
better. They have more clients, more
patients. As a result, they have better
economics. When they have better
economics, they hire more radiologists
because their purpose is not to study
the images. their purpose is to diagnose
disease. And so the question is the what
I'm leading up to is ultimately what is
the purpose? What is the purpose of the
lawyer? And has the purpose changed?
What is the purpose? You know, one of
the examples that I gave is is um that I
would give is for example uh if my car
became self-driving
will all chauffeers be out of jobs? The
answer probably is not because for some
per for some chauffeers they for some
people who are driving you they could be
protectors some people um they're part
of the experience part of the service so
when you get there they you know they
could take care of things for you and so
for a lot of different reasons not all
chauffeers would lose their jobs some
chauffeers would lose their jobs and uh
many chauffeers would change their jobs
and the type of applications of
autonomous vehicles will probably
increase you know the usage of the
technology within find new homes and so
I I think you have to go back to what is
the purpose of a job you know like for
example if AI comes along I actually
don't believe I'm going to lose my job
because my purpose isn't to I have to
look at a lot of documents I study a lot
of emails I look at a bunch of diagrams
you know um the question is what is the
job and and uh the purpose of somebody
probably hasn't changed a lawyer for
example help people that probably hasn't
changed studying legal documents
generating documents it's part of the
job not the job
>> but don't you think there's many jobs
that AI will replace
>> if your job is automation
>> yeah if your job is the task
>> right so automation
>> yeah factor if your job is the task
>> that's a lot of people
>> it could be a lot of people but it'll
probably generate like for example
>> uh let's say we let's say I'm super
excited about the the the robots Elon's
working on.
It's still a few years away.
When it happens, when it happens,
um
there's a whole new industry of
technicians and people who have to
manufacture the robots, right?
>> Mhm.
>> And so that that job never existed. And
so you're going to have a whole industry
of people taking care of like for
example, you know, all the mechanics and
all the people who are building things
for cars, supercharging cars, uh that
didn't exist before cars and now we're
going to have robots. You're going to
have robot apparel. So a whole industry
of [laughter] Right. Isn't that right?
Because I want my robot to look
different than your robot.
>> Oh god.
>> And so [laughter] you're going to you're
going to have a whole, you know, apparel
industry for robots. You're going to
have mechanics for robots and you have
you know people who comes and maintain
your robots
>> automated though.
>> No,
>> you don't think so? You don't think
[clears throat] they'll be all done by
other robots
>> eventually? And then there'll be
something else.
>> So you think ultimately people just
adapt except if you are the task
>> which is a large percentage of the
workforce.
>> If your job is just to chop vegetables,
quezin art is going to replace you.
>> Yeah. So people have to find meaning in
other things. Your job has to be more
than the task.
>> What do you think about Elon's belief
that this universal basic income thing
will eventually become necessary?
>> Many people think that. Andrew Yang
thinks that
>> he was one of the first people to sort
of sound that alarm during the the 2020
election.
Yeah, I I guess um
yeah, both ideas probably won't exist at
the same time and and um as in life,
things will probably be in the middle.
One idea, of course, is that there'll be
so much abundance of resource that
nobody needs a job and we'll all be
wealthy.
On the other hand, um we're going to
need universal basic income. Both ideas
don't exist at the same time,
>> right?
>> And so we're either going to be all
wealthy or we're going to be all
>> How could everybody be wealthy though?
But
>> because scenario wealthy not because you
have a lot of dollars, wealthy because
there's a lot of abundance. Like for
example, today we are wealthy of
information.
You know, this is some a concept several
thousand years ago only a few people
have. And so, uh, today we have wealth
of a whole bunch of things, resources
that that historic point. Yeah. And so,
we're going to have wealth of resources,
things that we think are valuable today
that in the future are just not not that
valuable, you know, and so it because
it's automated. And so I think I think
the question
maybe maybe partly it's hard to answer
partly because
it's hard to talk about infinity and
it's hard to talk about a long time from
now and and the reason for that is
because
there's just too many scenarios to to
consider. But I think it I think in the
next several years, call it 5 to 10
years,
there are several things that I I
believe in hope. Um, and I say hope
because I'm not sure. One of the things
that I believe is that the technology
divide will be substantially collapsed.
And of course the alternative
viewpoint is that AI is going to
increase the technology divide.
Now the reason why I believe AI is going
to reduce the technology divide.
I is because we have proof
the evidence is that AI is the easiest
application in the world to use. Chat
GPT has grown to almost a billion users
frankly practically overnight. And if
you're not exactly sure how to use,
everybody knows how to use chatpt. Just
say something to it. If you're not sure
how to use chatpt, you ask chatd how to
use it. No tool in history has ever had
this capability. A quez an art, you
know, if you don't know how to use it,
you're kind of screwed. You're going to
walk up to it and say, "How do you use a
quezin art?" You're going to have to
find somebody else. And so, but an AI
will just tell you exactly how to do it.
Anybody could do this. It'll speak to
you in any language. And if it doesn't
know your language, you'll speak it in
that language and it'll probably figure
out that it doesn't completely
understand your language. Go learns it
instantly and comes back and talk to
you. And so I think the the technology
divide has a real chance finally that
you don't have to speak Python or C++ or
forran. You can just speak human and
whatever form of human you like. And so
I think that that has a real chance of
closing the technology divine. Now, of
course, the counternarrative would say
that
AI is only going to be available for the
nations and the countries that have a
vast amount of resources because AI
takes energy
and AI takes um a lot of GPUs and
factories to be able to produce the AI.
No doubt at the scale that we would like
to do in the United States. But the fact
of the matter is your phone's going to
run AI just fine all by itself, you
know, in a few years. Today, it already
does it fairly decently. And so the the
the fact that every every country, every
nation, every every society will have
the benefit of very good AI. It might
not be tomorrow's AI. It might be
yesterday's AI, but yesterday's AI is
freaking amazing. You know, in 10 years
time, 9year-old AI is going to be
amazing. You don't need, you know, 10
year old AI. You don't need frontier AI
like we need frontier AI because we want
to be the world leader. But for every
single country, everybody, I think the
ele the capability to elevate
everybody's knowledge and capability and
intelligence, uh, that day is coming.
The octagon isn't just in Las Vegas
anymore. It's right in your hands with
DraftKings Sportsbook, the official
sports betting partner of UFC. Get ready
because when Dwabish Willie and Yan face
off again at UFC 323, every punch, every
takedown, every finish, it all has the
potential to pay off in real time. New
customers bet just $5. And if your bet
wins, you get paid $200 in bonus bets.
And hey, Missouri, the wait is over.
DraftKings Sportsbook is now live in the
Show Me State. Download the DraftKings
Sportsbook app and use promo code Rogan.
That's code Rogan to turn five bucks
into 200 in bonus bets if your bet wins.
In partnership with DraftKings, the
crown is yours. Gambling problem? Call
1800 gambler. In New York, call 8778
wire or text hope 467-369. In
Connecticut, help is available for a
problem gambling. Call 888789-7777
or visit ccpg.org. Please play
responsibly. On behalf of Bootill Casino
and Resort in Kansas, pass through of
per wager tax may apply in Illinois. 21
and over. Age and eligibility varies by
jurisdiction void in Ontario.
Restrictions apply. Bet must win to
receive bonus bets which expire in 7
days. Minimum odds required. For
additional terms and responsible gaming
resources, see dkg.co/audio.
Limited time offer.
>> And also energy production, which is the
real bottleneck when it comes to third
world countries and
>> that's right,
>> electricity and all all the resources
that we take for granted.
>> Almost everything is going to be energy
constrained. And so if you take a look
at um
one of the most important technology
advances in history is this idea called
Moore's law. Moore's law
was the started basically in my
generation
and my generation is the generation of
computers. I graduated in 1984 and that
was basically at the very beginning of
the PC revolution.
And the microprocessor and and um
every single year it approximately
doubled
and we describe it as every single year
we double the performance. But what it
really means is that every single year
the cost of computing halfed.
And so the cost of computing in the
course of five years reduced by a factor
of 10. The amount of energy necessary to
do computing to do any task reduced by a
factor of 10. Every single 10 years 100
a th00and 10,000
100,000 so on and so forth. And so each
one of
the clicks of Moore's law, the amount of
energy necessary to do any computing
reduced. That's the reason why you have
a laptop today when back in 1984 sat on
the desk, you got to plug in, it wasn't
that fast and it consumed a lot of
power. Today, you know, it is only a few
watts. And so Moore's law is the
fundamental technology, the fundamental
technology trend that made it possible.
Well, what's going on in AI? The reason
why Nvidia is here is because in we
invented this new way of doing
computing. We call it accelerated
computing. We started it 33 years ago.
Took us about 30 years to really made a
huge breakthrough. In that in that 30
years or so
we took computing you know probably a
factor of well let me just say in last
10 years the last 10 years we improved
the performance of computing by 100,000
times.
Whoa. Imagine a car over the course of
10 years that became a 100,000 times
faster or at the same speed 100,000
times cheaper or at the same speed
100,000 times less energy. If your car
did that, it doesn't need energy at all.
What I mean what what I'm trying to say
is that in 10 years time the amount of
energy necessary for artificial
intelligence for most people will be
minuscule
utterly minuscule and so we'll have AI
running in all kinds of things and all
the time because it doesn't consume that
much energy and so if you're a nation
that uses AI for you know almost
everything in your social fabric of
course you're going to need these AI
factories but for a lot of countries I
think you're going You're going to have
excellent AI and you're not going to
need as much energy. Everybody will be
able to come along is my point.
>> So currently that that is a big
bottleneck, right? Is energy.
>> Yeah, it is the bottleneck.
>> The bottleneck is this. So was it Google
that is making nuclear power plants to
operate one of its AI factories?
>> Oh, I haven't heard that. But I think in
the next six, seven years, I think
you're going to see a whole bunch of
small nuclear reactors.
>> And by small, like how big are you
talking about? Hundreds of megawws.
Yeah.
>> Okay. And that these will be local to
whatever specific company they have.
>> That's right. Will all be power
generators.
>> Whoa.
>> You know, just like just like your you
know, somebody's farm.
>> It probably is the smartest way to do
it, right?
>> And it takes the burden off Yeah. takes
the burden off the grid. It takes and
you could build as much as you need
>> and you can contribute back to the grid.
It's a really important point that I
think you just made about Moore's law
and the relationship to pricing because
you know a laptop today like you can get
one of those little Mac MacBook Airs.
They're incredible. They're so thin,
unbelievably powerful. Battery life is
charge it.
>> Yeah. Battery [laughter] life's crazy.
And uh it's not that expensive
relatively speaking. Like something like
that.
>> I remember.
>> And that's just Moore's law, right?
>> Then there's the Nvidia law.
>> Oh,
>> just right. the the the law I was
talking to you about, the computing that
we invented,
>> right?
>> The reason why we're here, this new this
new way of doing computing
>> is like Mo's law on energy drinks. I
mean, it's [laughter]
it's like Mo's law
it's it's like Yeah. Moore's law and Joe
Rogan.
>> Wow. That's interesting.
>> Yeah. That's us.
>> So, explain that. Um this this chip that
you brought to Elon, what what's the
significance of this? It's like why is
it so superior? And so
in 2012, Jeff Hinton's lab, this
gentleman I was talking talking about,
um Ilas Suscober, Alex Kresevski, um
they made a breakthrough in computer
vision in literally creating a
piece of software
called Alexnet.
And its job was to recognize images. And
it recognized images
at a c at a level computer vision which
is fundamental to intelligence. If you
can't perceive, you can't it's hard to
have intelligence. And so computer
vision is a fundamental pillar of not
the only but fundamental pillar of. And
so breaking
computer vision or breaking through in
computer vision is pretty foundational
to almost everything that everybody
wants to do in AI. And so in 2012,
their lab in Toronto
uh made this made this breakthrough
called Alexnet. And Alexet was able to
recognize images
so much better than any human created
computer vision algorithm in the 30
years prior. So all of these people, all
these scientists and we had many too
working on computer vision algorithms
and these two kids, Ilia and Alex under
the the uh
under under uh Jeff Hinton took a giant
leap above it and it was based on this
thing called Alexet this neural network.
And the way it ran,
the way they they made it work was
literally buying two Nvidia graphics
cards
because Nvidia Nvidia's GPUs we've been
working on this new way of doing
computing and our GPUs application
and it's basically a supercomputing
application to back in 1984
in order to
process computer games and what you have
in your racing simulator that is called
an image generator supercomputer.
And so Nvidia started our first
application was computer graphics and we
applied this new way of doing computing
where we do things in parallel in
instead of sequentially. A CPU does
things sequentially. Step one, step two,
step three. In our case, we break the
problem down and we give it to thousands
of processors.
And so our way of doing computation
is much more complicated.
But if you're able to formulate the
problem in the way that we
created called CUDA, this is the
invention of our company. If you could
formulate it in that way, we could
process everything simultaneously.
Now, in the case of computer graphics,
it's easier to do because every single
pixel on your screen is not related to
every other pixel. And so, I could
render multiple parts of the screen at
the same time. Not not completely true
because, you know, maybe maybe the way
lighting works or the way shadow works,
there's a lot of dependency and and
such. But computer graphics with all the
dis with all the pixels, I should be
able to process everything
simultaneously. And so we we took
this embarrassingly parallel problem
called computer graphics and we applied
it to this new way of doing computing.
Nvidia's Nvidia's accelerated computing.
We put it in all of our graphics cards.
Kids were buying it to play games. We're
you probably don't know this, but we're
the largest gaming platform in the world
today.
>> Oh, I know that. Oh,
>> okay.
>> I used to make my own computers. I used
to buy your graphics cards.
>> Oh, that's super cool.
>> Yeah. [laughter] set up SLI with two
graphics cards.
>> Yeah, I love it. Okay, that's super
cool.
>> Oh, yeah, man. I used to be a Quake
junkie.
>> Oh, that's cool.
>> Yeah.
>> Okay, so SLI, I'll tell you the story in
just a second and how it led to Elon.
I'm still answering the question. And
so, anyways, these these two kids
trained this model using the technique I
described earlier on our GPUs because
our GPUs could process things in
parallel. It's essentially a supercomput
in a PC. The reason why you used it for
Quake is because it is the first
consumer supercomputer. Okay. And so
anyways,
they made that breakthrough. We were
working on computer vision at the time.
It caught my attention
and so we went to learn about it.
Simultaneously this deep learning
phenomenon was happening all over all
over the country. Universities after
another recognized the importance of
deep learning and all of this work was
happening at Stanford, at Harvard, at
Berkeley, just all over the place. New
York University, L Yan Lakun, Andrew
Yang at Stanford, so many different
places. And I see it cropping up
everywhere.
And so my curiosity asked, you know,
what is so special about this form of
machine learning? And we've known about
machine learning for a very long time.
We've known about AI for a very long
time. We've known about neural networks
for a very long time. What makes now the
moment? And so we realized that this
architecture for deep neural networks
back propagation the way deep neuronet
networks were created. We could probably
scale this problem, scale the solution
to solve many problems.
that is essentially
a universal function approximator. Okay?
Meaning meaning you know back when
you're in in in school you have a you
have a you have a box inside of it is a
function you give it an input it gives
you an output and and the the reason why
I call it universal function
approximator
is that this computer instead of you
describing the function a function could
be a new equation fals ma that's a
function you write the function in
software you give it input f mass
acceleration, it'll tell you the force.
Okay? And
the way this computer works is really
interesting.
You give it a universal function. It's
not fals, just a universal function.
It's a big huge deep neural network
and instead of describing the inside,
you give it examples of input and output
and it figures out the inside.
So you give it input and output and it
figures out the inside. A universal
function approximator. Today it could be
Newton's equation. Tomorrow it could be
Maxwell's equation. It could be Kulum's
law. It could be thermodynamics
equation. It could be you know
Shingers's equation for quantum physics.
And so you could put any you could have
this describe almost anything so long as
you have the input and the output. So
long as you have the input and the
output or it could learn the input and
output.
>> And so we took a step back and we said,
"Hang on a second. This isn't just for
computer vision. Deep learning could
solve any problem.
All the problems that are interesting so
long as we have input and output. Now
what has input and output?
Well, the world. The world has input and
output. And so we could have a computer
that could learn almost anything.
Machine learning, artificial
intelligence. And so we reasoned that
maybe this is the fundamental
breakthrough that we needed. There were
a couple of things that had to be
solved. For example, we had to believe
that you could actually scale this up to
giant systems. It was running in a they
had two graphics cards, two GTX 580s,
[laughter]
which by the way is exactly your SLI
configuration. Yeah. Okay. So, that GTX
5880 SLI was the revolutionary computer
that put deep learning on the map.
>> Wow.
>> It was 2018 and you were using it to
play Quake.
>> Wow. That's crazy.
>> That was the moment. That was the big
bang of modern AI. We were lucky because
we were inventing this technology, this
computing approach. We were lucky that
they found it.
Turns out they were gamers and it was
lucky they found it. And it it was lucky
that we paid attention to that moment.
It was a little bit like, you know, that
Star Trek,
you know, first contact.
The Vulcans had to have seen the warp
drive at that very moment. If they
didn't witness the warp drive, you know,
they would have never come to Earth and
everything would have never happened.
It's a little bit like if I hadn't paid
attention to that moment, that flash.
And that flash didn't last long. If I
hadn't paid attention to that flash or
our company didn't pay attention to it,
who knows what would have happened, but
we saw that and we reasoned our way into
this is a this is a universal function
approximator. This is not just a
computer vision approximator. We could
use this for all kinds of things. if we
could solve two problems. The first
problem is that we have to prove to
oursel it could scale. The second
problem we had to
wait for I guess contribute to and wait
for is
the world will never have enough data
on input and output where we could
supervise
the AI to learn everything. For example,
if we have to supervise our children on
everything they learn, the amount of
information they could learn is limited.
We needed the AI, we needed the computer
to have a method of learning without
supervision.
And that's where we had to wait a few
more years, but un unsupervised
AI learning is now here. And so the AI
could learn by itself. And and the
reason why the AI could learn by itself
is because we have many examples of
right answers. Like for example,
if I want to learn uh if I want to teach
an AI how to predict the next word, I
could just grab it, grab a whole bunch
of text we already have, mask out the
last word and make it try and try and
try again until it predicts the next
one. or I mask out random words inside
inside the text and I make it try and
try and try until it predicts it. You
know, like uh Mary uh Mary goes down to
the bank. Is it a river bank or a money
bank? Well, if you're going to go down
to the bank, it's probably a river bank.
Okay. So, and it it it might not be
obvious even from that. It might need
and
uh and uh and caught a fish. Okay. Now
you know it's must be the riverbank. And
so so you give you give these AIs a
whole bunch of these examples and you
mask out the words, it'll predict the
next one. Okay? And so unsupervised
learning came along. These two ideas,
the fact that it's scalable and
unsupervised learning came along.
We were convinced that we ought to put
everything into this and help create
this industry because we're going to
solve a whole bunch of interesting
problems. And that was in 2012. By 2016,
I had I had built this computer called
the DGX1. The one that you saw me give
to Elon is called DGX Spark. The DGX1
was $300,000.
It cost Nvidia a few billion dollars to
make the first one.
And instead of two chips SLI,
we connected eight chips with a
technology called MVLink, but it's
basically SLI supercharged.
Okay.
>> Okay.
>> And so we connected eight of these chips
together instead of just two. And all of
them work together just like your Quake
rig did to solve this deep learning
problem to train this model. And so I
create we created this thing. I
announced it at GTC
and at one of our annual annual events
and I described this deep learning
thing, computer vision thing and this
computer called DJX1.
The audience was like completely silent.
They had no idea what I was talking
about. [laughter]
And I was lucky because I I had known
Elon and uh uh I helped him build the
first computer for Model 3
uh uh the Model S. And uh and when he
wanted to start working on autonomous
vehicle, I helped him build the computer
that went into the the Model S AV
system, his full full self-driving
system. We were basically the FSD
computer version one. And so
we we're already working together and um
when I announced this thing, nobody in
the world wanted it. I had no purchase
orders. Not not one. Nobody wanted to
buy it. Nobody wanted to be part of it
except for Elon. He goes, he was at the
event and we were doing a fireside chat
about the future of self-driving cars.
I think it's like 2016. Yeah, 20 maybe
at that time it was 2015. and he goes,
"You know what?
I have a company that could really use
this."
I said, "Wow, my first customer." And
so, so I was pretty excited about it.
And he goes, "Uh, yeah. Uh, we have this
company. It's a nonprofit company."
And all the blood drained out of my
face. Yeah. [laughter]
I just spent a few billion dollars
building this thing. Cost $300,000. and
you know the chances of a nonprofit
being able to pay for this thing is
approximately zero. And he goes, you
know, this is a it's an AI company and
uh it's a nonprofit and and uh we could
really use one of these supercomputers.
And so I I picked it up. I built the
first one for ourselves. We're using it
inside the company. I boxed one up. I
drove it up to San Francisco and I
delivered to Elon in 2016. A bunch of
researchers were were there.
Peter Beiel was there, Ilia was there,
and there was a bunch of people there.
And uh I walk up to the second floor
where they were all kind of in a room
this smaller than your place here. And
and uh uh that place turned out to have
been open AI
>> 2016.
>> Wow.
>> Just a bunch of people sitting in a
room.
>> It's not really uh nonprofit anymore,
though, is it?
>> They're not They're not nonprofit
anymore. Yeah.
>> Weird how that works.
>> Yeah. Yeah. But anyhow, anyhow, Elon was
there. The Yeah, it was it was really a
great great moment.
>> Oh, yeah. There you go. Yeah, that's it.
[laughter]
>> Look at you, bro. Same jacket.
>> Look at that. I haven't aged.
>> Not not a lick of black hair, though.
>> Uh the size of it is uh it's
significantly smaller. That was the
other day. SpaceX.
>> Oh, yeah. There you go.
>> Yeah. Look at the difference.
>> Exactly the same industrial design. He's
holding it in his hand
>> here. Here's the amazing thing. DJX1 was
one pedlops. Okay, that's a lot of
flops. And DJX Spark is one pedlops.
Nine years later.
>> Wow.
>> The same the same amount of computing
horsepower
>> in a much smaller
>> shrunken down. Yeah.
>> And instead of $300,000, it's now
$4,000. And it's the size of a small
book.
>> Incredible.
>> Crazy.
>> That's how technology moves. Anyways,
that's the reason why I wanted to get
give him the first one
>> because I gave him the first one 2016.
>> It's so fascinating. I mean you if you
wanted to make a story for a film I mean
that would be the story that like what
what better scenario if if if it really
does become a digital life form how
funny would it be that it is birthed out
of the desire for computer graphics for
video games [laughter]
>> exactly
>> kind of cra it's kind of crazy
>> kind of crazy when you think about it
that way
>> because
it's just
>> perfect origin
Computer graphics was one of the hardest
computer supercomputer problems
generating reality
>> and also one of the most profitable to
solve because computer games are so
popular.
>> When Nvidia started in 1993,
we were trying to create this new
computing approach. The question is
what's the killer app?
And
the the problem we wanted to the the
company wanted to create a new type of
computing pro a computing architecture a
computing a a new type of computer that
can solve problems that normal computers
can't solve.
Well,
the applications that existed in the
industry in 1993
are applications that normal computers
can solve because if the normal
computers can't solve them, why would
the application exist?
And so, we had a mission statement for a
company that has no chance of success.
[laughter]
But I didn't know that in 1993. It just
sounded like a good idea,
>> right?
And so if we created this thing that can
solve problems, you know, it's like
you actually have to go create the
problem.
And so that's what we did in 1993. There
was no quake. John Carmarmac hadn't been
reduced doom released Doom yet. You
probably remember that.
>> Sure. Yeah.
>> And and uh there were no applications
for it. And so I went to Japan because
the arcade industry had this at the time
of Sega, if you remember.
>> Sure.
>> The arcade machines, they came out with
3D arcade systems, virtual fighter,
Daytona, Virtual Cop, all of those
arcade games were in 3D for the f very
first time. And the technology they were
using was from Martin Marietta, the
flight simulators. They took the guts
out of a flight simulator and put it
into an arcade machine. The system that
you have over here, it's got to be a
million times more powerful than that
arcade machine. And that was a flight
simulator for NASA. Whoa. And so they
took the guts out of that. They were
they were using it for flight simulation
for jets and, you know, space shuttle
and and they took the guts out of that.
and Sega uh had this brilliant computer
de developer. His name was Yuzuki.
Yuzuki and Miiamoto. Sega and Nintendo.
These were the, you know, the incredible
pioneers, the visionaries, the
incredible artists, and they're both
very, very technical.
They were the origins really of of the
gaming industry. and Y Suzuki
pioneered 3D graphics gaming and um
so I went we we created this company and
there were no apps
and we were spending all of our
afternoons you know we told our family
we were going to work but it was just
the three of us you know who's going to
know and so we went to Curtis's my one
of one of the founders went to Curtis's
townhouse and uh Chris and I were
married we have kids I already had
Spencer at Madison. They were probably 2
years old. And um
and uh Chris's kids are about the same
age as ours. And we would go to work in
this townhouse. But you know, when
you're a startup and the mission
statement is the way we described,
you're not going to have too many
customers calling you. And so we had
really nothing to do. And so after
lunch, we would always have a great
lunch. After lunch, we would go to the
arcades and play the Sega V, you know,
the Sega Virtual Fighter and Daytona and
all those games and analyze how they're
doing it, trying to figure out how they
they were doing that.
And so we decided, um, let's just go to
Japan and let's
convince Sega to move those applications
into the PC.
and we would start the PC gaming the 3D
gaming industry partnering with Sega.
That's how Nvidia started.
>> Wow.
>> And so so uh in exchange for them part
developing their games for our computers
in the PC, we would build a chip for
their game console. That was the
partnership. I build a chip for your
game console. you port the Sega games to
us and um
and then they paid us a you know at the
time a quite a significant amount of
money to build that game console
and that was kind of the beginning of
Nvidia getting started and we thought we
were on our way and so so I started with
a business plan a mission statement that
was impossible we lucked into the Sega
partnership we started taking off
started building our game console. And
about a couple years into it, we
discovered our first technology
didn't work.
It was it it would have been a flaw. It
it was a flaw. And all of the technology
ideas that we had
the architecture concepts were were
sound, but the way we were doing
computer graphics was exactly backwards.
you know, instead of
I won't bore you with the technology,
but instead of inverse texture mapping,
we were doing forward texture mapping.
Instead of triangles, we did curved
surfaces. So, other people did it flat,
we did it round. Um,
other technology, the technology that
ultimately won, the technology we use
today has has Zbuffers. It automatically
sorted.
We had an architecture with no Zbuffers.
The application had to sort it. And so
we chose a bunch of technology
approaches
that
three major technology choices. All
three choices were wrong. Okay. So this
is how incredibly smart we were. And so
[laughter]
and so in 1995 19 early mid95
we realized we were going down the wrong
path. Meanwhile,
the Silicon Valley was packed with 3D
graphics startups because it was the
most exciting technology of that time.
And so 3D FX and rendition and Silicon
Graphics was coming in. Intel was
already in there and you know gosh like
what added up eventually to a hundred
different startups we had to compete
against. Everybody had chosen the right
technology approach and we chose the
wrong one. And so we were the first
company to start. We found ourselves
essentially dead last with the wrong
answer.
And so
the company was in trouble
and um
ultimately we had to make several
decisions. The first decision is
well
if we change now
we will be the last company.
And
even if we changed into the technology
that we believe to be right, we'd still
be dead. And so that argument,
you know,
do we change and therefore be dead?
Don't change and make this technology
work somehow or go do something
completely different.
That question stirred the company
strategically and was a hard question. I
eventually, you know, advocated for we
don't know what the right strategy is,
but we know what the wrong technology
is. So, let's stop doing it the wrong
way and let's give ourselves a chance to
go figure out what the strategy is. The
second thing, the second problem we had
was our company was running out of money
and I had I was in a contract with Sega
and I owed them this game console
and if that contract would have been
cancelled, we'd be dead.
We would have vaporized instantly.
And so so uh uh I went to Japan and I
explained to uh the CEO of Sega, Erie
Madri, really great man. He was the
former CEO of Honda USA. Went back to
Sega to run Sega. Went back to Japan to
run Sega. And I explained to him that I
was uh I guess I was what 30 33 years
old.
you know, when I was 33 years old, I
still had acne. And I got this this, you
know, Chinese kid. I was super skinny.
And he he was already kind of elder.
And uh I went to him and I said I said,
"Listen,
I've got some bad news for you." And and
first, the technology that we promised
you doesn't work.
And second,
we shouldn't finish your contract
because we'd waste all your money and
you would have something that doesn't
work. And I recommend you find another
partner to build your game console.
>> Whoa.
>> And so I'm terribly sorry that we've set
you back in your product roadmap.
And third,
even though you're going to I'm asking
you to let me out of the contract,
I still need the money
because if you didn't give me the money,
we'd vaporize overnight.
And so
I explained it to him humbly, honestly.
I gave him the background.
explain to him why the technology
doesn't work, why we thought it was
going to work, why it doesn't work.
And um and I asked him
to uh
convert the last $5 million that they
were to complete the contract to give us
that money as an investment
instead.
and he said,
"But it's very likely your company will
go out of business, even with my
investment."
And it was completely true. Back then,
1995, $5 million was a lot of money.
It's a lot of money today. $5 million
was a lot of money. And here's a pile of
competitors doing it right. What are the
chances that giving Nvidia $5 million
that we would develop the right strategy
that he would get a return on that $5
million or even get it back? 0%.
You do the math. It's 0%.
If I were sitting there right there, I
wouldn't have done it.
$5 million was a mountain of money to
Sega at the time.
And so
I told him that that that um
uh
if you invested that $5 million in us,
it is most likely to be lost.
But if you didn't invest that money,
we'd be out of business and we would
have no chance.
And I I told him that I
I don't even know exactly what I said in
the end, but I
told him that I would understand if he
decided not to, but it would make the
world to me if he did. He went off and
thought about it for a couple days and
came back and said, "We'll do it."
>> Wow.
strategy to how to correct what it was
doing wrong. Did you explain that to
him?
>> Wait, oh man, wait until I tell you the
rest of it's scarier. Even scarier.
>> Oh no. [laughter]
>> And so so um
so what he what he decided was was uh
Jensen was a young man he liked. That's
it.
>> Wow. to this day.
>> That's nuts.
>> I was
>> Boy, do you owe what the world owes that
guy.
>> No doubt,
>> right?
>> Well, he's he c he's he celebrated today
in Japan.
>> And if he would have kept that five
>> the the investment, I think it'd be
worth probably about a trillion dollars
today.
I know. But the moment we went public,
they sold it. They go, "Wow, that's a
miracle." So, [laughter]
>> wow.
>> They sold it. Yeah. They sold it at
Nvidia valuation about 300 million.
That's our IPO valuation. 300 million.
>> Wow.
>> And so, so anyhow,
I was incredibly grateful. Um,
and then now we had to figure out what
to do because we still were doing the
wrong strategy, wrong technology. So
unfortunately we had to lay off most of
the company. We shrunk the company all
back. All the people working on the game
console, you know, we had to shrunk it
all. Shrink it all back.
And um
and then and then somebody told me that,
but Jensen,
we've never built it this way before.
We've never built it the right way
before.
We've only know how to build it the
wrong way.
And so nobody in the company knew how to
build this
supercomputing image generator 3D
graphics thing that Silicon Graphics
did. And so so uh I said, "Okay,
how hard can it be? You got all these 30
companies, you know, 50 companies doing
it. How hard can it be?" And so luckily
there was a textbook written by the
company Silicon Graphics.
And so I went down to the store. I had
200 bucks in my pocket. And I bought
three textbooks, the only three they
had, $60 a piece. I bought the three
textbooks. I brought it back and I gave
one to each one of the architects and I
said, "Read that and let's go save the
company."
>> [laughter]
>> And so
[gasps and sighs] so they they they read
this textbook, learned from the giant at
the time, Silicon Graphics, about how to
do 3D graphics. But the thing that was
amazing and what makes Nvidia special
today is that
the people that are there are able to
start from first principles,
learn best known art, but reimplement it
in a way that's never been done before.
And so when we re-imagined
the technology of 3D graphics, we
reimagined it in a way that manifest
today the modern 3D graphics. We really
invented modern 3D graphics, but we
learned from previous known arts and we
implement it fundamentally differently.
>> What did you do that changed it?
Well, you know, the ultimately
ultimately the um uh the simple the
simple answer is that the way silicon
graphics works uh the geometry engine is
a bunch of software running on
processors.
We took that and
eliminated all the generality,
the general purposeness of it and we
reduced it down into the most essential
part of 3D graphics
and we hardcoded it into the chip. And
so instead of something general purpose,
we hardcoded it very specifically into
just the limited applications,
limited functionality necessary for
video games.
And that capability that super and and
because we reinvented a whole bunch of
stuff, it supercharged the capability of
that one little chip. And our one little
chip was generating images as fast as a
$1 million image generator. That was the
big breakthrough. We took a million
dollar thing and we put it into the
graphics card that you now put into your
gaming PC. And that was [snorts] our big
invention.
And then and of course the question is
is um
uh how do you compete against these 30
other companies doing what they were
doing?
and and there we did we did several
things. One
uh instead of building a 3D graphics
chip for every 3D graphics application,
we decided to build a 3D graphics chip
for one application. We bet the farm on
video games.
The needs of video games are very
different than needs for CAD, needs for
flight simulators. They're related, but
not the same. And so we narrowly focused
our problem statement so I could reject
all of the other complexities and we
shrunk it down into this one little
focus and then we supercharged it for
gamers. And then the second thing that
we did was we created a whole ecosystem
of working with game developers and
getting their their games ported and
adapted to our silicon so that we could
get turn essentially what is a
technology business into a platform
business into a game platform business.
So we, you know, GeForce is really today
it's also the most advanced 3D graphics
technology in the world, but a long time
ago GeForce is really the game console
inside your PC. It's, you know, it runs
Windows, it runs Excel, it runs
PowerPoint, of course, those are easy
things, but its fundamental purpose was
simply to turn your PC into a game
console. So we we were the first
technology company to build all of this
incredible technology in service of one
audience gamers. Now of course in 1993
the gaming industry didn't exist. But by
the time that John Carmarmac came along
and the doom phenomenon happened and
then quake came out as you know
that entire world oh that entire
community boom took off. Do you know
where the name Doom came from?
>> It came from this se there's a scene in
the movie The Color of Money where Tom
Cruz who's this uh elite pool player
shows up at this pool hall and this
local hustler says what he got in the
case and he opens up this case. He has a
special pool queue. He goes in here and
he opens it up. He goes, "Doom.
>> Doom." [laughter]
>> And that's where it came from. Yeah. Cuz
Carmarmac said that's what they wanted
to do to the gaming industry.
>> Doom.
>> That when Doom came out, it would just
be everybody be like, "Oh, we're
fucked."
>> Oh, wow.
>> This is Doom.
>> That's awesome.
>> Isn't that amazing? That's amazing.
>> Cuz it's the perfect name for the game.
>> Yeah.
>> And the name came out of that scene in
that movie.
>> That's right. Well, and then of course,
uh, Tim Sweeney and
>> Epic Games and, uh, and the 3D gaming
genre took off.
>> Yes.
>> And so, if you just kind of in the
beginning was no gaming industry. We had
no choice but to focus the company on
one thing. That one thing,
>> it's a really incredible origin story.
>> Oh, it's it's amazing. Like you must be
like look back
>> a disaster is what
>> a $5 [laughter] million that pivot with
that conversation with that gentleman if
he did not agree to that if he did not
like you what would the world look like
today that's crazy then then our entire
life hung on another gentleman
and so so now here we are we built so
before GeForce it was Revo 128 revo 128
saved the company it revolutionized
computer graphics
The performance cost performance ratio
of 3D graphics for gaming was off the
charts amazing.
And
we're getting ready to to ship it. Get
well, we're we're building it, but we're
so as you know, $5 million doesn't last
long. And so every single month, every
single month, uh we were drawing down
You have to build it, prototype it. You
have to design it, prototype it,
get the silicon back,
which costs a lot of money. Test it with
software
because without the software testing the
chip, you don't know the chip works.
And then you're going to find a bug
probably
because every time you test something
you find bugs,
which means you have to tape it out
again, which is more time, more money.
And so we did the math. There was no
chance anybody was going to survive it.
We didn't have that much time to tape
out a chip, send it to a foundry TSMC,
get the silicon back, test it, send it
back out again. There was no no shot, no
hope.
And so the math, the spreadsheet doesn't
allow us to do that. And so I heard
about this company and this company
built this machine.
And this machine is an emulator.
You could take your design, all of the
software that describes the chip, and
you could put it into this machine. And
this machine will pretend it's our chip.
So I don't have to send it to the fab,
wait until the fab sends it back, test.
I could have this machine pretend it's
our chip and I could put all of the
software on top of this machine called
an emulator and test all of the software
on this pretend chip and I could fix it
all before I send it to the fab.
>> Whoa. And if and and if I could do that
when I send it to the FAB, it should
work.
Nobody knows, but it should work. And so
we came to the conclusion
that let's take half of the money we had
left in the bank. At the time it was
about a million dollars. Take half of
that money and go buy this machine.
So instead of keeping the money to stay
alive, I took half of the money to go
buy this machine. Well, I call this guy
up. This the company's called IOS.
Call this company up and I say, "Hey,
listen. I heard about this machine.
I like to buy one."
And they go, "H,
that's terrific, but we're out of
business." I said, "What? You're out of
business?" He goes, "Yeah, we had no
customers."
[laughter]
I said, "Wait, hang on a sec. So, you
never made the machine?" They [snorts]
can say, "No, no, no. We made the
machine. We have one in inventory if you
want it, but we're out of business." So,
I bought one out of inventory.
Okay. After I bought it, they went out
of business.
>> Wow.
>> I bought it out of inventory.
And on this machine, we put Nvidia's
chip into it and we tested all of the
software on top.
And at this point, we were on fumes.
But we convinced ourselves that chip is
going to be great.
And so I had to call some other
gentleman. So I called TSMC.
And I told TSMC
that listen, TSMC is the world's largest
founder today. At the time they were
just a few hundred million dollars
large,
tiny little company.
And I explained to them what we were
doing. And um I explained to him I told
him I had a lot of customers. I had one,
you know, Diamond Multimedia,
probably one of the companies you bought
the graphics card from back in the old
days. And I I said, you know, we have a
lot of customers, and the demand's
really great, and
we're going to tape out a chip to you,
and I like to go directly to production
because I know it works.
>> [snorts]
>> And they said, "Nobody has ever done
that before.
Nobody has ever taped out a chip that
worked the first time.
And nobody starts out production without
looking at it."
But I knew that if I didn't start the
production, I'd be out of business
anyways. And if I could start the
production, I might have a chance.
And so
TSMC
decided to support me and uh this
gentleman is named Morris Chang. Morris
Chang is the father of the foundry
industry, the founder of TSMC. Really
great man.
He decided to support our company. I
explained to them everything.
he decided to support us frankly
probably because they didn't have that
many other customers anyhow but they
were grateful and I was immensely
grateful and as we were starting the
production
Morris flew to United States and uh
he didn't so many words asked me so but
he asked me a whole lot of questions
that was trying to tease out do I have
any money
but he didn't directly ask me that you
know and so the truth is that we didn't
have all the money but we had a strong
PO from the customer and if it didn't
work some wafers would have been lost
and I'm you know I I'm not exactly sure
what would have happened but we would
have come short it would have been it
would have been rough but they supported
us with all of that risk involved we
launched this chip turns out to
been completely revolutionary.
Knocked the ball out of the park. We
became the fastest growing technology
company in history to go from zero to $1
billion.
>> So wild that you didn't test the chip.
>> I know. We tested afterwards. Yeah, we
tested afterwards.
>> Afterwards, but [laughter]
production already. But by the way, by
the way, that methodology that we
developed to save the company is used
throughout the world today.
>> That's amazing.
>> Yeah, we changed we changed the whole
world's methodology of designing chips.
The whole world's uh rhythm of designing
chips. Uh we changed everything.
>> How well did you sleep those days? It
must have been so much stress,
[laughter]
>> you know. Um,
what is that feeling where where uh the
world just kind of feels like it's
flying? It you you have this what do you
call that feeling? You can't you can't
stop the the feeling that everything's
moving super fast and you know and
you're laying in your laying in bed and
the world just feels like you know it
you and you're you you feel deeply
anxious
uh completely out of control. Um
I've felt that probably a couple of
times [laughter] in my life. It's during
that time.
>> Wow.
>> Yeah. It it was incredible.
>> What an incredible success story.
>> But I I learned I learned a lot. I
learned I learned about I learned
several things. I learned I learned uh
how to develop strategies.
Um I learned how to
uh uh and when I when I you know our
company learned how to develop
strategies. What are winning strategies?
We learned how to create a market. We
created the modern 3D gaming market.
We learned how and and so that exact
same skill is how we created the modern
AI market. It's exactly the same.
>> Wow.
>> Yeah. Exactly the same skill. Exactly
the same blueprint. And
uh we learned how to uh deal with
crisis, how to stay calm, how to think
through things systematically.
We learned how to remove all waste in
the company and work from first
principles and doing only the things
that are essential. Everything else is
waste because we have no money for it
to live on fumes at all times. And the
feeling
no different than the feeling I had this
morning when I woke up that you're going
to be out of business soon. that you're
you know the phrase 30 days from going
out of business I've used for 33 years
because
>> you still feel that.
>> Oh yeah. Oh yeah. Every morning. Every
morning.
>> But but you guys are one of the biggest
companies on planet earth. But the the
feeling doesn't change.
>> Wow.
>> The the sense of vulnerability, the
sense of uncertainty, the sense of
insecurity. Uh
it it doesn't leave you.
>> That's crazy. We were, you know, we had
nothing. We had nothing. We were dealing
with giant.
>> Oh, yeah. Oh, yeah. Every day, every
moment.
>> Do you think that fuels you? Is that
part of the reason why the company's so
successful? That you have that hungry
mentality,
that you never rest, you're never
sitting on your laurels, you're always
on the edge.
I have a greater drive from not wanting
to fail
than the drive of wanting to succeed.
[laughter]
>> Isn't that like sex coaches would tell
you that's completely the wrong
psychology?
>> The world has just heard me say that for
out loud for the first time.
>> But but it's true.
>> Well, that's how fascinating. fear of
failure drives me more than the than the
the greed or whatever it is.
>> Well, ultimately that's probably a more
healthy approach now that I'm thinking
about it because like the fear
>> I'm not ambitious for example,
[laughter] you know, I just want to stay
alive, Joe. I want the company to
thrive, you know, I want us to make an
impact.
>> That's interesting.
>> Yeah.
>> Well, maybe that's why you're so humble.
That's what maybe that's what keeps you
grounded, you know, because with the
kind of spectacular success the
company's achieved, it would be easy to
get a big head.
>> No.
>> Right. But isn't that interesting? It's
like the if you were the guy that your
main focus is just success. You probably
would go, "Well, made it. Nailed it. I'm
the [laughter] man.
>> Drop the mic."
>> Instead, you wake up, you're like, "God,
we can't [ __ ] this up."
>> No. Exactly. Every morning. Every
morning. No. Every moment. Yeah. That's
crazy.
>> Before I go to bed.
>> Well, listen. If I was a major investor
in your company, that's what I'd want
running it. I'd want a guy who's
>> Yeah.
>> That's what I work. That's why I work
seven days a week. Every moment I'm I'm
awake.
>> You work every moment.
>> Every moment I'm awake.
>> Wow.
>> I'm thinking about solving a problem.
I'm thinking about
>> How long can you keep this up?
>> I don't know. But so [laughter]
could be next week. Sounds exhausting.
>> It is exhausting.
>> It sounds completely exhausting.
>> Always in a state of anxiety.
>> Wow.
>> Always in a state of anxiety.
>> Wow. Kudos to you for admitting that. I
think that's important for a lot of
people to hear because, you know,
there's probably some young people out
there that are in a similar position to
where you were when you were starting
out that just feel like, oh, those
people that have made it, they're just
smarter than me and they had more
opportunities than me and it's just like
it was handed to them or they're just in
the right place at the right time. And
>> Joe, I just described to you somebody
who didn't know what was going on,
[laughter]
actually did it wrong.
>> Yeah. Yeah. And the ultimate diving
catch like two or three times.
>> Crazy.
>> Yeah.
>> The ultimate diving catch is the perfect
way to put it.
>> You know, it's just like the edge of
your glove. [laughter]
>> It probably bounced off of somebody's
helmet and landed at the edge.
[laughter]
>> God, that's incredible. That's
incredible. But it's also it's really
cool that you have this perspective that
you look at it that way because you know
a lot of people that have delusions of
grandeur or they have you know
>> and their rewriting of history
often times had them somehow extraord
extraordinarily smart and they were
geniuses and they knew all along and
they were they were spot-on. And the
business plan was exactly what they
thought. And
>> yeah,
>> they destroyed the competition and you
know and they emerged victorious.
[laughter]
>> Meanwhile, you're like, I'm scared every
day.
>> Exactly. [laughter]
Exactly.
>> That's so funny. Oh my god, that's
amazing.
>> It's so true, though.
>> It's amazing.
>> It's so true.
>> It's amazing. Well, but I I think
there's nothing inconsistent
with being a leader and being
vulnerable. You know, I the company
doesn't need me to be a genius right all
along, right?
Absolutely certain about what I'm trying
to do and what I'm doing. The the
company doesn't need that. The company
wants me to succeed. You know, the thing
that and we started out today talking
about President Trump and I was about to
say something and listen, he is my
president. He is our president. We
should all and we're talking about just
because it's President Trump, we all
want him to be wrong. I think that
United States, we all have to realize he
is our president, we want him to succeed
because
>> no matter who's president attitude.
>> That's right.
>> We want him to succeed. We need to help
him succeed because it helps everybody,
all of us succeed.
And
I'm lucky that I work in a company where
I have 40,000 people who wants me to
succeed.
They want me to succeed and I can tell
and they're all every single day to help
me overcome these challenges
trying to realize
realize what I describe to be our
strategy doing their best. And if it's
somehow
wrong or not perfectly right to tell me
so that we could pivot and the more
vulnerable we are as a leader the more
able other people are able to tell you
you know that Jensen that's not exactly
right or
>> right right
>> have you considered this information or
and the more vulnerable we are
the more able we're actually able to
pivot if we put ourselves into this
superhuman capability then it's hard for
us to pivot strategy,
>> right?
>> Because we were supposed to be right all
along.
>> And so if you're always right, how can
you possibly pivot? Because pivoting
requires you to be wrong. And so I've
got no trouble with being wrong. I just
have to make sure that I stay alert,
that I reason about things from first
principles all the time. Always break
things down to first principles.
Understand why it's happening.
Reassess continuously. The reassessing
continuously is kind of partly what
causes continuous anxiety,
>> you know, because you're asking
yourself, were you wrong yesterday? Are
you still right? Is this the same? Has
that changed? Has that condition is that
worse than you thought?
>> But God, that mindset is perfect for
your business, though, because this
business is ever changing
>> all the time. I've got competition
coming from every direction. So much of
it is kind of up in the air
and you have to invent a future where
a 100 variables are included and there's
no way you could be right on all of
them. And so you have to be
>> you have to surf.
>> Wow. That's a good way to put it. You
have to surf. Yeah. You're surfing waves
of technology and innovation.
>> That's right. You can't predict the
waves. You got to deal with the ones you
have.
>> Wow. And but skill matters and I've been
doing this for 30 I'm the longest
running tech CEO in the world.
>> Is that true? Congratulations. That's
amazing.
>> And you know people ask me how is one
don't get fired. [laughter]
That'll stop a short heartbeat.
And then two don't get bored.
>> Yeah.
>> Well, how do you maintain your
enthusiasm?
Well, the honor truth is is not always
enthusiasm. It's, you know, sometimes is
enthusiasm. Sometimes it's just good
oldfashioned fear and then sometimes,
you know, a healthy dose of frustration,
you know, it's whatever keeps you
moving.
>> Yeah. Just all the emotions. I think,
you know,
>> CEOs, we have all the emotions, right?
you know, and so probably probably
jacked up to the maximum because you're
you're kind of feeling it on behalf of
the whole company. I'm feeling it on
behalf of everybody at the same time.
And it kind of, you know, encapsulates
into into somebody. And so I have to be
mindful of the past. I have to be
mindful of the present. I've got to be
mindful of the future. And um you know,
it can't it's not without emotion.
It's not just it's it's not just a job.
Let's just put it that way.
>> It doesn't seem like it at all. I would
imagine one of the more difficult
aspects of your job currently now that
the company is massively successful is
anticipating where technology is headed
and where the applications are going to
be.
>> Yeah.
>> So, how do you try to map that out?
>> Yeah. there there um there there's a
whole bunch of ways and and it takes it
takes um
takes a whole bunch of things but let me
just start
uh you have to be surrounded by amazing
people and Nvidia is now you know if you
look at look at look at um the large
tech companies in the world today
most of them have a business in
advertising or social media or you know
content distribution and at the core of
it is really fundamental computer
science and so the company's business is
not computers the company's business is
not technology technology drives the
company is the only company in the world
that's large whose only business is
technology we only build techn we don't
advertise the only way that we make
money is to create amazing technology
and sell
And so
to be that to be NVIDIA today, you're
the number one thing is you're
surrounded by the finest computer
scientists in the world. And that's my
gift. My gift is that we've created a
company's culture,
a condition by which the world's
greatest computer scientists want to be
part of it because they get to do their
life's work and create the next thing
because that's what they want to do.
because maybe they're not they don't
want to be in service of another
business.
>> They want to be in service of the
technology itself. And we're the largest
form of its kind in the history of the
world.
>> Wow.
>> I know. It's pretty amazing.
>> Wow.
>> And so so one, you know, we have a we we
have got a great condition. We have a
great culture. We have great people. And
then now now now the question is how do
you systematically
um
be able to see the future stay alert of
it
and uh reduce the reduce the the
likelihood of missing something or being
wrong.
And so there's a lot of different ways
you could do that. For example, we have
great partnerships. We we have
fundamental research. We have a great
research lab, one of the largest
industrial research labs in the world
today. And we partner with a whole bunch
of universities and other scientists. We
do a lot of open collaboration
and so I'm constantly working with
researchers outside the company.
We have the benefit of having amazing
customers and so I have the benefit of
working with Elon and you know and
others in the industry and we have the
benefit of being the only pure pure play
technology company that can serve uh
consumer internet
industrial manufacturing
um scientific computing healthcare
financial services all the industries
that we're in. They're all signals to
me. And so they all have mathematicians
and scientists and and so because I I
have the benefit now of a radar system
>> that is the most broad of any company in
the world working across every single
industry from agriculture to energy
to video games.
And so the ability for us to have this
vantage point,
one doing fundamental research ourselves
and then two working with all the great
researchers, working with all the great
industries, the feedback system is
incredible. And then finally,
you just have to have a culture of
staying super alert. There's no easy way
of being alert except for paying
attention.
I haven't found a single way of being
able to stay alert without paying
attention. And so, you know, I probably
read several thousand emails a day.
>> How How do you have a time for that?
>> I wake up early. This morning I was up
at 4:00.
>> How much do you sleep?
>> Uh, six, seven, six, seven hours.
>> Yeah.
>> And then you're up at 4 reading emails
for a few hours before you get going.
>> That's right. Yeah.
>> Wow.
Every day.
>> Every single day. Not one day missed.
[sighs] including
Thanksgiving, Christmas.
>> Do you ever take a vacation?
>> Uh, yeah. But they're um my definition
of a vacation is when I'm with my
family. And so if I'm with my family,
I'm very happy. I don't care where we
are.
>> And you don't work then or do you work a
little?
>> No. No. I work a lot. [laughter]
>> Even like if you go on a trip somewhere,
you're still working.
>> Oh, sure. Oh, sure.
>> Wow. Every day.
>> Every day.
>> But my kids work every You make me tired
just saying this.
>> My kids work every day.
Both of my kids work at Nvidia. They
work every day.
>> Wow.
>> Yeah. I'm very lucky.
>> Wow.
>> Yeah. It's brutal now because, you know,
it's just me working every day. Now we
have three people working every day and
they want to work with me every day and
so it's it's a lot of work.
>> Well, you've obviously imparted that
ethic into them.
>> They work incredibly hard. I mean,
there's no unbelievable.
>> But my parents work incredibly hard.
>> Yeah. I was I was born with the work
gene,
>> the suffering gene. [laughter]
>> Well, listen, man. It has paid off. What
a crazy story. It was just It's really
an amazing origin story.
It really I mean, it has to be kind of
surreal to be in the position that
you're in now when you look back at how
many times that it could have fallen
apart and humble beginnings. But Joe,
this is great. It's a great country. You
know, I'm an immigrant. My parents sent
my older brother and I here first.
We're we're in Thailand.
I was born in Taiwan, but my dad had a
job in Thailand. He was a chemical and
instrumentation engineer, incredible
engineer.
And his job was to go start an oil
refinery. And so we moved to Thailand,
lived in Bangkok.
And um in 19
I guess 1973 1974 time frame,
you know how Thailand every so often
they would just have a coup. You know,
the military would have an uprising and
all of a sudden one day there were tanks
and soldiers in the streets and my
parents thought, you know, it probably
isn't safe for the kids to be here. And
so they contacted my uncle. My uncle
lives in Tacoma, Washington.
and um we had never met him and my
parents sent us to him.
>> How old were you?
>> Uh I was about to turn nine and my older
brother uh almost turned 11 and so the
two of us came to United States and we
stayed in with our uncle for a little
bit while he looked for a school for us
and my parents didn't have very much
money and they never been to United
States. my father was. I'll tell you
that story in a second.
And um
and so my my uncle found a school that
would accept foreign students and
affordable enough for my parents.
And that school turned out to have been
in Onita, Kentucky, Clark County,
Kentucky, the epicenter of the opio
crisis today.
cold country.
Clark County, Kentucky is
was the poorest county in America when I
showed up. It is the poorest county in
America today.
And so we went to the school, it's a
great school, um, Onita Baptist
Institute
in a town of a few hundred. I think it
was 600 at the time that we showed up.
No traffic light.
And um I think it has 600 today. It's
quite an amazing feat actually.
The ability to hold your population for
[laughter]
when it's 600 people. It was quite a
magic quite a magical thing. however
they did it. And and so uh the school
had a mission of being an open school
for any children who would like to come.
And what that basically means is that if
you're a trouble student, if you have a
troubled family,
um if you're,
you know, whatever your background,
you're welcome to come to Onita Baptist
Institute, including kids from
international who would like to stay
there.
>> Did you speak English at the time?
>> Uh, okay. Yeah. Yeah. Okay. Yeah. And so
we showed up
and uh
my first my first thought was gosh there
are a lot of cigarette butts on the
ground. 100% of the kids smoked.
[laughter]
So right away you know this is not a
normal school.
>> Nineyear-olds?
>> No, I was the youngest kid.
>> Okay. 11 year olds.
>> My roommate was 17 years old. Wow.
>> Yeah. He just turned 17. And he was
jacked
and and um
I don't know where he is now. I know his
name, but I don't know where he is now.
But anyways, uh that night we got and
and the second thing I noticed when you
walk into the into your dorm room
is uh there are no drawers and no closet
doors.
just like a prison.
And
there are no locks
so that people could check check up on
you.
And so I go into my room and he's 17 and
uh you know get ready for for bed and he
had all this tape
all over his body and uh turned out he
was in a knife fight and he's been
stabbed all over his body and these were
just fresh wounds.
>> Whoa. And the other kids were hurt much
worse.
And uh so he was my roommate, the
toughest kid in school, and I was the
youngest kid in school. It was a it was
a junior high,
but they took me anyways because if I
walked about a mile across the Kentucky
River, the swing bridge, the other side
is a middle school that I could go to
and then I can go to that school and I
come back and then I stay in the dorm.
And so basically Onita Baptist Institute
was my dorm when I went to this other
other school. My older brother went went
to um went to the junior high. And so we
were there for a couple of years. Um
every kid had every kid had chores.
My older brother's chore was to work in
the tobacco farm, you know. So tobac
they raised tobacco so that they could
raise some extra money for the school.
Kind of like a penitentiary.
>> Wow. And my job was just to clean the
dorm. And so I I was 9 years old. I was
cleaning toilets. And for a dorm of 100
100 boys, I
I clean more bathrooms than anybody. And
I just wish that everybody was a little
bit more careful, you know. [laughter]
But anyways, I was the youngest kid in
school. The my memories of it was really
good. Um, but it was a pretty tough It
was a tough town.
>> Sounds like it.
>> Yeah. Town kids, they all carried
Everybody had knives.
>> Everybody had knives. Everybody smoked.
Everybody had a Zippo lighter. I smoked
for a week.
>> Did you?
>> Oh, yeah. Sure.
>> How old were you?
>> I was nine. Yeah.
>> When you nine? You were nine, you tried
smoking.
>> Yeah. I got myself a pack of cigarettes.
Everybody else did.
>> Did you get sick? No. I I got used to
it, you know, and I learned how to blow
blow smoke rings and, you know, [snorts]
you know, breathe out of my nose, you
know, take it in out of through my nose.
I mean, there was a all the different
things that you learned. Yeah.
>> At nine.
>> Yeah.
>> Wow. You just did it to fit in or it
looked cool.
>> Yeah. [clears throat] Because everybody
else did it,
>> right?
>> Yeah. And and then I did it for a couple
weeks, I guess. And I just rather have I
had a quarter, you know, I had a quarter
a month or something like that.
I just rather buy popsicles and fried
sickles with it. I was nine, you know,
[laughter]
>> right?
>> I chose I chose the the better path.
>> Wow.
>> That was our school. And then my parents
came to United States two years later
and um we met him in Tacoma, Washington.
>> That's wild. It It was a really crazy
experience. What a strange formative
experience.
>> Yeah. Tough kids.
>> Thailand to one of the poorest places in
America or if not the poorest
as a 9-year-old.
>> Yeah. It was my first experience with
your brother.
>> Wow.
>> Yeah. Yeah. No, I I remember and what
breaks my heart probably the only thing
that really breaks my heart of
about that experience was
so
we didn't have enough money to make you
know international phone calls every
week and so my parents gave us this tape
deck this Iowa tape deck and a tape
and so every month we would sit in front
on that tape deck and that my older
brother Jeff and I,
the two of us would just tell them what
we did the whole month.
>> Wow.
>> And we would send that tape by mail
and my parents would take that tape and
record back on top of it and send it
back to us.
>> Wow.
>> Could you imagine if for two years
>> Wow. is that tape still existed
of these two kids just describing their
first experience with United States.
Like I remember telling my parents
that that uh I joined the swim team and
uh
my roommate was really buff and so every
day we spent a lot of time in the in the
gym and so uh uh every night 100
push-ups, 100 sit-ups every day in the
gym. So, I was nine years old. I was
getting I was pretty buff
and I'm pretty fit. And uh
and so I joined the soccer team. I
joined the swim team because if you join
the team, they take you to meets and
then afterwards you get to go to a nice
restaurant. And that nice restaurant was
McDonald's.
>> Wow.
>> And and I recorded this thing. And I
said, "Mom and dad, we went to the most
amazing restaurant today.
This whole place is lit up. It's like
the future."
And [snorts] the food comes in a box
[laughter]
and the food is incredible. The
hamburger is incredible. It was
McDonald's. [snorts] But anyhow, it it
wouldn't it be amazing?
>> Oh my god. Two years recording. Yeah.
Two years. Yeah. What a crazy connection
to your parents, too. Just sending a
tape and them sending you one back and
it's the only way you're communicating
for two years.
>> Yeah. Wow. Yeah. No, I've My parents are
incredible actually. They're just
they're uh they grew up really poor and
um when they came to United States, they
had almost no money. Uh probably one of
the most
impactful memories I have is is uh we
they came and we were we were staying in
a in a in a uh apartment complex
and they had they had just rent back in
the I guess people still do rent rent a
bunch of furniture
and
we were messing around
and uh
we bumped into the coffee table and
crushed it. It's made out of particle
wood and we crushed it.
And I just still remember my the look on
my mom's face, you know, because they
didn't have any money and she didn't
know how she was going to pay it back.
And but anyhow, that's that kind of
tells you how hard it was for them to
come here. They they left everything
behind and all they had was their
suitcase and the money they had in their
in their pocket and they came to United
States.
>> How old were they pursued the American
dream? They were in their 40s.
>> Wow.
>> Yeah. Late late 30s.
>> Pursued the American dream. This is this
is the American dream. I'm the first
generation of the American dream.
>> Wow.
>> Yeah. It's hard not to love this
country.
>> That's
>> it's it's hard not to be romantic about
this country.
>> That is a romantic story. That's an
amazing story.
>> Yeah. And and my dad found his job
literally in the newspaper,
you know, the ads and he calls people.
Got a job.
>> What did he do?
>> Uh he was a consulting engineer and a
and a consulting firm and they helped
people build oil refineries, paper mills
and fabs. And that's what he did. He was
an he he's really good at factory design
instrumentation engineer. And so he's
he's brilliant at that. And so he did
that and my mom uh worked as a maid and
uh they found a way to raise us.
>> Wow.
That's an incredible story, Jensen. It
really is. Every all of it from your
childhood to the perils of Nvidia almost
falling. [laughter]
It's really incredible, man.
>> It's a great story. Yeah. I I've lived a
great life.
>> You really have. And it's a great story
for other people to hear, too. It really
is.
>> You don't You don't have to go to Ivy
League schools to succeed.
This country creates opportunities. Has
opportunities for all of us. You do have
to strive.
You have to claw your way here.
>> Yeah.
>> But if you put in the work, you can
succeed.
Nobody works with
>> a lot of luck and a lot of
>> a lot and
>> good decision- making
>> and the good graces of others.
>> Yes, that's really important.
>> Yeah. You and I spoke about two two
people who are very dear to me. Um but
the list goes on. the people the people
at NVIDIA who have have uh helped me um
uh many friends that are on the board uh
the decisions you know them giving me
the opportunity like when we were
inventing this new computing approach
I tanked our stock price because we
added this thing called CUDA to the chip
we had this big idea we added this thing
called CUDA to the chip but nobody paid
for it but our cost doubled and so we
had this graphics chip company and we
invented GPUs, we invented programmable
shaders, we invented everything modern
computer graphics,
we invented real-time tracing. That's
why it went from GTX to RTX.
We invented all this stuff, but every
time we invented something,
the market doesn't know how to
appreciate it, but the cost went way up.
And in the case of CUDA that enabled AI,
the cost increased a lot. it and but I
really we really believed it you know
and so if you believe in that future and
you don't do anything about it you're
going to regret it for your life
and so we always you know I always tell
the team do you believe what do we
believe this or not and if you believe
it and so grounded on first principle is
not random you know hearsay and we
believe it we've got to we owe it to
ourselves to go pursue it if we're the
right people to go do it if it's really
really hard to do. It's worth doing and
we believe it. Let's go pursue it.
Well, we pursued it. We we launched the
product. Nobody knew. It was exactly
what like when I launched DGX1 and the
entire audience was like
complete silence. When I launched CUDA,
the audience was complete silence. No
customer wanted it. Nobody asked for it.
Nobody understood it. Nvidia was a
public company.
>> What year was this? This is uh
uh let's see 200
2006
20 years ago
2005.
>> Wow.
>> Our stock price just went
our valuation went down to like two or
three billion dollars
>> from
>> from about 12 or something like that.
I crushed it.
>> [laughter]
>> in a very bad way.
>> Yeah.
>> What is it now though?
>> H Yeah, it's higher. [laughter]
>> Very humble of you. [gasps]
>> It's higher. But it changed the world.
>> Yeah,
>> that invention changed the world.
>> It's a It's an incredible story,
Johnson. It really is.
>> Thank you.
>> I like your story. It's incredible. Ah,
>> my story is not as incredible. My story
is more weird,
you know.
It's much more fertuitous and weird.
>> Okay. What are the three milestones that
most important milestones that led to
here?
>> That's a good question. Um,
>> what was step one?
>> I think step one was seeing other people
do it. Step one was in the initial days
of podcasting, like in 2009 when I
started, podcasting had only been around
for a couple of years. Um, the first was
Adam Curry, my good friend, who was the
podfather. He he invented podcasting.
And then, you know, um, I remember Adam
Corolla had a show because he had a
radio show. His radio show got cancelled
and so he decided to just do the same
show but do it on the internet. And that
was pretty revolutionary. Nobody was
doing that. And then there was the
experience that I had had doing
different morning radio shows like Opie
and Anthony in particular because it was
fun and we would just get together with
a bunch of comedians, you know, I'd be
on the show with like three or four
other guys that I knew and it was always
just looked forward to it. It was was
just such a good time and I said, "God,
I miss doing that. It's so fun to do
that. I wish I could do something like
that." And then I saw Tom Green setup.
Tom Green had a setup in his house and
he essentially turned his entire house
into a television studio and he did an
internet show from his living room. He
had servers in his house and cables
everywhere. Had to step over cables. I
was this is like 2007. I'm like Tom this
is nuts. Like this is
>> and I'm like you got to figure out a way
to make money from this. Like this
everybody I wish everybody in the
internet could see your setup. It's
nuts. I just want to let you guys know
that [laughter]
>> it's not just this.
>> Yeah. So that was the the beginning of
it is just seeing other people do it and
then saying all right let's just try it
and then so the beginning days we just
did it on a laptop had a laptop with a
webcam and just messed around had a
bunch of comedians come in we would just
talk and joke around and I did it like
once a week and then I started doing it
twice a week and then all a sudden I was
doing it for a year and then I was doing
it for two years then it was like oh
it's starting to get a lot of viewers a
lot of listeners you know and then I
just kept doing It's all it is. I just
kept doing it because I enjoyed doing
it. Well, was there any setback?
>> No. No, there was never really a setback
really.
>> No,
>> it must have been. Or you kind of
>> You're just You're just resilient.
>> Or you're just tough.
>> No. No. No. No. It wasn't tough or hard.
It was just interesting. So, I just it
the the
>> You were never once punched in the face.
>> No, not in the show. No, not really. Not
Not doing the show.
>> You never did something that that
big blowback. Nope.
Not really. No, it all just kept
growing.
>> It kept growing and the thing stayed the
same from the beginning to now. And the
thing is, I enjoy talking to people.
I've always enjoyed talking to
interesting people.
>> I could even tell just when we walked
in, the way you interacted with
everybody, not just me.
>> Yeah, that's cool.
>> People are cool.
>> Yeah, that's cool. You know, I I it's a
an amazing gift to be able to have so
many conversations with so many
interesting people because it changes
the way you see the world because you
see the world through so many different
people's eyes and you have so many
different people have different
perspectives and different opinions and
different philosophies and different
life stories. And you know, it's an
incredibly enriching and educating
experience having so many conversations
with so many amazing people. And that's
all I started doing. And that's all I do
now. Even now, when I booked the show, I
do it on my phone. And I basically go
through this giant list of emails of all
the people that want to be on the show
or that request to be on the show. And
then I factor in another list that I
have of people that I would like to get
on the show that I'm interested in. And
I just map it out and that's it. And I
go, "Oh, I'd like to talk to him."
>> If it wasn't because of President Trump,
I wouldn't have been bumped up on that
list. [laughter]
>> No, I wanted to talk to you already. I I
just think, you know, what you're doing
is very fascinating. I mean, how would I
not want to talk to you? And then today,
it proved to be absolutely the right
decision.
>> Well, you know, listen, it's it's
strange to be an immigrant one day.
going to Onita Baptist Institute
with with the students that were there
and then here
Nvidia's one of the most consequential
companies in the history of companies.
>> It is a crazy story.
>> It has to be that journey is is a and
it's very humbling and
>> and um I'm very grateful.
>> It's pretty amazing man.
>> Surrounded by amazing people. You're
very fortunate and you've also you seem
very happy and you seem like you're 100%
on the right path in this life. You
know,
>> you know, everybody says you must love
your job. Not every day. [laughter]
>> That's not that's part of the beauty of
everything is that there's ups and
downs. It's never just like this giant
dopamine high.
>> We leave we leave this impression here.
Here's here's an impression I don't
think is healthy. We we um people who
are successful leave the impression
often that that
our job gives us great joy. I think
largely it does
that our jobs were passionate about our
work.
Um and that passion relates to it's just
so much fun. I think it largely is, but
it it it distracts from in fact a lot of
success comes from really really hard
work.
>> Yes,
>> there's long periods of suffering and
loneliness and uncertainty and fear and
embarrassment and humiliation. all of
the feelings that we most not love that
creating something
from the ground up and and Elon will
tell you something similar very
difficult to invent invent something new
>> and people people don't believe you all
the time you're humiliated often
disbelieved most of the time and so so
people forget that part of success and
and I I don't think it's health. I think
it's it's good that we pass that forward
and let people know that that it's just
part of the journey.
>> Yes.
>> Suffering is part of the journey.
>> You will appreciate it so these horrible
feelings that you have when things are
not going so well. You will appreciate
it so much more when they do go well.
>> Deeply grateful.
>> Yeah.
>> Yeah. Deep deep pride. Incredible pride.
In incredible incredible gratefulness
and and and surely incredible memories.
Absolutely. Jensen, thank you so much
for being here. This was really fun. I
really enjoyed it and your story is just
absolutely incredible and very
inspirational and and I you know, I
think it really is the American dream.
It is the American dream.
>> It really is. Thank you so [music] much.
Thank you. All right. Bye, everybody.
[music]
Key Vocabulary
Coming Soon!
We're updating this section. Stay tuned!
Key Grammar Structures
Coming Soon!
We're updating this section. Stay tuned!
Related Songs