Display Bilingual:

Joe Rogan podcast. Check it out. 00:01
>> The Joe Rogan Experience. 00:04
>> TRAIN BY DAY. JOE ROGAN PODCAST BY 00:06
NIGHT. All day. 00:08
>> Hello. Hey, Joe. 00:12
>> Good to see you again. We were just 00:14
talking about Was that the first time we 00:15
ever spoke or did was the first time we 00:17
spoke at at SpaceX? 00:19
>> SpaceX. 00:20
>> SpaceX. The first time when you were 00:20
giving Elon that crazy AI chip, 00:22
>> right? DJX Spark. 00:24
>> Yeah. Oo, that was a big moment. That 00:26
was a huge 00:27
>> That felt crazy to be there. I was like 00:28
watching these wizards of tech like 00:30
exchange information and and you're 00:32
giving him this crazy device, you know, 00:36
and then the other time was uh I was 00:38
shooting arrows in my backyard and uh 00:40
randomly get this call from Trump and 00:43
he's hanging out with you. President 00:45
Trump called and I called you. 00:46
>> Yeah. It's just 00:47
>> we were talking about you. [laughter] 00:48
>> It's just talking about he was talking 00:51
about the US UFC thing he was going to 00:52
do in his front yard. 00:54
>> Yeah. And he pulls out. He's JJS, look 00:55
at this design. He's so proud of it. And 00:58
I go, "You're going to have a fight in 01:01
the front lawn in the White House." He 01:04
goes, "Yeah, yeah, you're going to come. 01:05
This is going to be awesome." And he's 01:07
showing me his design and how beautiful 01:08
it is. And he goes, and somehow your 01:10
name comes up. He goes, "Do you know 01:14
Joe?" And I said, "Yeah, I'm going to be 01:16
on his podcast." He Let's call him. 01:18
[laughter] 01:21
>> He's like a kid. 01:23
>> I know. Let's call him. It's so He's 01:24
like a 79y old kid. 01:26
>> Oh, he's so incredible. 01:28
>> Yeah, he's an odd guy. Just very 01:30
different, you know, like the what you'd 01:33
expect from him. Very different than 01:35
what people think of him. And also just 01:38
very different as a president. A guy who 01:40
just calls you or texts you out of the 01:42
blue. Also, he makes when you te you. 01:43
You have an Android, so it won't go 01:45
through with you, but with my iPhone, he 01:47
makes the text go big. 01:49
>> Like, you know, USA is respected again. 01:50
like [laughter] 01:53
all caps and it makes the te the the the 01:55
text enlarge is kind of ridiculous. 01:58
>> Well, the the 101 Trump President Trump 02:00
is very different. He he surprised me f 02:04
first of all he's an incredibly good 02:07
listener. Almost everything I've ever 02:09
said to him, he's remembered. 02:11
>> Yeah. People don't they only want to 02:13
look at negative stories about him or 02:16
negative narratives about him. You know, 02:19
you can catch anybody on a bad day. Like 02:21
there's a lot of things he does where I 02:22
don't think he should do. Like I don't 02:24
think he should say to a reporter rep 02:25
reporter, "Quiet piggy." Like that's 02:26
pretty ridiculous. Also objectively 02:29
funny. I mean, it's unfortunate that it 02:32
happened to her. I wouldn't want that to 02:34
happen to her, but it was funny. Just 02:35
ridiculous that the president does that. 02:38
I wish he didn't do that. But other than 02:39
that, like he's he's an interesting guy. 02:41
Like he's a lot of different things 02:43
wrapped up into one person, you know? 02:45
You know, part of part of his charm, 02:49
well, part of his genius is Yes. He says 02:51
what's on his mind. 02:53
>> Yes. 02:54
>> And which is like an anti-olitician in a 02:55
lot of ways. 02:57
>> So, you know, what's on his mind is 02:58
really what's on his mind, 03:00
>> which 03:02
I I do some people some people would 03:04
rather be lied to. 03:06
>> Yeah. But but I I like the fact that 03:07
he's telling you what's on his mind. Um, 03:09
almost every time he explains something, 03:11
he says something, 03:13
he starts with his, you could tell, his 03:15
love for America, what he wants to do 03:18
for America. And everything that he 03:20
thinks through is very practical and 03:24
very common sense. And, you know, it's 03:26
very logical and um 03:29
I still remember the first time I I met 03:32
him and so this was I I'd never known 03:34
him, never met him before. and um uh 03:37
Secretary Lutnik called and we met right 03:39
before right at the beginning of the 03:43
administration. He said he told me what 03:45
was important to President Trump that 03:47
that um uh that United States 03:49
manufactures on shore and that was 03:53
really important to him because because 03:56
uh it's important to national security. 03:58
He wants to make sure that that the 04:00
important critical technology of our 04:02
nation is built in the United States and 04:03
that we re-industrialize 04:06
and get good at manufacturing again 04:08
because it's important for jobs. 04:10
>> It just seems like common sense, right? 04:11
>> Incredible common sense. And and that 04:13
was like literally the first 04:14
conversation I had with Secretary Letic 04:16
um and he was talking about how how um 04:19
that he started he started our 04:24
conversation with uh Jensen. This is 04:26
Secretary Lutnik and I I just want to 04:29
let you know that you're a national 04:32
treasure. Uh Nvidia is a national 04:34
treasure and whenever you need access to 04:37
the president um the administration uh 04:41
you call us. We're always going to be 04:44
available to you. Literally, that was 04:46
the first sentence. 04:49
>> That's pretty nice. 04:50
>> And it was completely true. every single 04:51
time I called, if I needed something, I 04:54
want to get something off my chest, um, 04:57
express some concern, uh, they're always 04:59
available. Incredible. It's just 05:01
unfortunate we live in such a 05:03
politically polarized society that you 05:04
can't recognize good common sense things 05:07
if they're coming from a person that you 05:09
object to. And that, I think, is what's 05:11
going on here. I think most people 05:13
generally a as a country, you know, as a 05:15
a giant community, which we are, it just 05:18
only makes sense that we have 05:20
manufacturing in America that especially 05:24
critical technology like you're talking 05:26
about. Like it's kind of insane that we 05:28
buy so much technology from other 05:30
countries. 05:32
>> If United States doesn't grow, we will 05:33
have no prosperity. We can't invest in 05:36
anything domestically or otherwise. we 05:40
can't fix any of our problems. If we 05:43
don't have energy growth, we can't have 05:45
industrial growth. If we don't have 05:48
industrial growth, we can't have job 05:50
growth. These it's as simple as that, 05:52
>> right? 05:54
>> And the fact that the fact that he came 05:55
into office and the first thing that he 05:57
said was drill baby drill. His point is 05:58
we need energy growth. Without energy 06:01
growth, we can have no industrial 06:03
growth. And that was it saved it saved 06:05
the AI industry. got I got to tell you 06:08
flat out if not for his progrowth energy 06:10
policy 06:15
we would not be able to build factories 06:16
for AI not be able to build chip 06:18
factories we won't sure surely won't be 06:20
able to build supercomputer factories 06:22
none of that stuff would be possible 06:24
without all of that 06:26
construction jobs would be challenged 06:28
right electrical you know electrician 06:30
jobs all of these jobs that are now 06:32
flourishing would be challenged and so I 06:34
think he's got it right we need energy 06:36
growth We want to re-industrialize the 06:38
United States. We need to be back in 06:40
manufacturing. Every successful person 06:42
doesn't need to have a PhD. Every 06:45
successful person doesn't have to have 06:47
gone to Stanford or MIT. And I think I 06:48
think that that that you know that 06:51
sensibility is is um spot on. Now, when 06:53
we're talking about technology growth 06:57
and energy growth, there's a lot of 06:59
people that go, "Oh, no. That's not what 07:00
we need. We need to, you know, simplify 07:02
our lives and get back." But the the 07:04
real issue is that we're in the middle 07:06
of a giant technology race. And whether 07:07
people are aware of it or not, whether 07:10
they like it or not, it's happening. And 07:11
it's a really important race because 07:13
whoever gets to 07:16
whatever the event horizon of artificial 07:18
intelligence is, whoever gets there 07:22
first has massive advantages in a huge 07:23
way. 07:26
Do you agree with that? Well, first the 07:28
part I I will say that we are in a 07:30
technology race and we are always in a 07:32
technology race. We've been in a 07:34
technology race with somebody forever. 07:36
>> Right. 07:39
>> Right. Since the industrial revolution, 07:39
we've been in a technology 07:40
>> since the Manhattan project. 07:41
>> Yeah. 07:42
>> Or or you know, even going back to the 07:43
discovery of energy, right? The United 07:45
Kingdom was where the industrial 07:48
revolution was, if you will, invented 07:51
when they realized that they can turn 07:54
steam and such into into energy into 07:55
electricity. 07:58
All of that was invented largely in 08:00
Europe and the United States capitalized 08:04
on it. We were the ones that learned 08:07
from it. We industrialized it. We 08:09
diffused it faster than anybody in 08:12
Europe. They were all stuck in 08:14
discussions about 08:17
policy and 08:20
jobs and disruptions. Meanwhile, the 08:22
United States was forming. We just took 08:25
the technology and ran with it. And so I 08:26
I think we were always in in a bit of a 08:29
technology race. World War II was a 08:31
technology race. Manhattan Project was a 08:32
technology race. We've been in the 08:35
technology race ever since during the 08:36
Cold War. I think we're still in a 08:38
technology race. It is probably the 08:40
single most important race. It is the 08:42
technology is uh it gives you 08:45
superpowers. 08:48
you know whether it's information 08:50
superpowers or energy superpowers or 08:51
military superpowers is all founded in 08:55
technology and so technology leadership 08:57
is really important 08:59
>> well the problem is if somebody else has 09:00
superior technology right that's that's 09:02
the issue it seems like with the AI race 09:04
people are very nervous about it like 09:08
you know Elon has famously said there 09:10
was like 80% chance it's awesome 20% 09:13
chance we're in trouble and people are 09:16
worried about that 20% % rightly so. I 09:18
mean that you know if you had 10 bullets 09:20
in a a a revolver and you know you you 09:23
took out eight of them and you still 09:28
have tw two in there and you spin it, 09:30
you're not going to feel real 09:32
comfortable when you pull that trigger. 09:32
It's terrifying, 09:34
>> right? 09:34
>> And when we're working towards this 09:35
ultimate goal um of AI, 09:38
it it just it's 09:42
impossible to imagine that it wouldn't 09:45
be of national security interest to get 09:46
there first. 09:48
We should The question is what's there? 09:49
That's the That was the part that 09:51
>> What is there? 09:52
>> Yeah. I'm not sure. 09:53
>> And I don't think anybody I don't think 09:54
anybody really knows. 09:56
>> That's crazy though. If I ask you, 09:57
>> you're the head of Nvidia. If you don't 10:00
know what's there, who knows? 10:02
>> Yeah. I I think it's probably going to 10:04
be much more gradual than we think. It 10:06
won't It won't be a moment. It won't be 10:09
It won't be as if um somebody arrived 10:12
and nobody else has. I don't think it's 10:15
going to be like that. I think it's 10:17
going to be things that just get better 10:18
and better and better and better just 10:20
like technology does. 10:22
>> So, you are rosy about the future. 10:23
You're you're very optimistic about 10:25
what's going to happen with AI. 10:27
>> Obviously, will you make the best AI 10:29
chips in the world? 10:31
>> You probably better be. 10:32
>> Uh h if history is a guide, um uh we 10:33
were always concerned about new 10:37
technology. 10:39
Humanity has always been concerned about 10:41
new technology. There are always 10:42
somebody who's thinking there always a 10:44
lot of people who are quite concerned. 10:46
were quite concerned and and and so if 10:47
if history is a guide, it is the case um 10:51
that all of this concern is channeled 10:56
into making the technology safer. 10:59
And so for example, in the last several 11:02
years, I would say AI technology has 11:05
increased probably in the last two years 11:08
alone, maybe a 100x. Let's just give it 11:12
a number, okay? It's like a car two 11:14
years ago was 100 times slower. So AI is 11:18
100 times more capable today. Now, how 11:22
did we channel that technology? How do 11:25
we channel all of that power? We 11:27
directed it to um causing the AI to be 11:29
able to think, meaning that it can take 11:33
a problem that we give it, break it down 11:37
step by step. 11:39
It does research before it answers. And 11:41
so it grounds it on truth. 11:44
It'll reflect on that answer. Ask 11:47
itself, is this the best, you know, 11:49
answer that I can give you. Am I certain 11:52
about this answer? If it's not certain 11:54
about the answer or highly confident 11:56
about the answer, it'll go back and do 11:58
more research. It might actually even 11:59
use a tool because that tool provides a 12:02
better solution than it could 12:04
hallucinate itself. As a result, we took 12:06
all of that computing capability and we 12:08
channeled it into having it produce a 12:11
safer result, safer answer, a more 12:14
truthful answer because as you know, one 12:16
of the greatest criticisms of AI in the 12:19
beginning was that it hallucinated, 12:20
>> right? 12:22
>> And so if you look at the reason why 12:23
people use AI so much today is because 12:25
the amount of hallucination has reduced. 12:28
You know, I use it almost I well I used 12:30
it the whole trip over here and so so I 12:32
think the 12:35
the uh the the capability most people 12:37
think about power 12:40
and they think about you know maybe as 12:42
an explosion power but the technology 12:44
power most of it is channeled to towards 12:47
safety. A car today is more powerful but 12:49
it's safer to drive. A lot of that power 12:52
goes towards better handling. You know, 12:55
I'd rather have a Well, you have a 1000 12:58
horsepower truck. I think 500 horsepower 13:01
is pretty good. No, I thousand's better. 13:04
I think a th00and is better. 13:06
>> I don't know if it's better, but it's 13:07
definitely faster. 13:09
>> Yeah. No, I think it's better. You can 13:10
get out of trouble faster. Um, 13:12
I enjoyed my 599 more than my 612. It 13:17
was I think it was a better better 13:21
horsepower is better. My 459 is better 13:23
than my 430. 13:25
more horsepower is better. I I think 13:27
more horsepower is better. I think it's 13:29
better handling. It's better control. In 13:30
the case of in the case of technology, 13:33
it's also very similar in that way, you 13:34
know. And so if you if you look at what 13:37
we're going to do with the next thousand 13:38
times of performance in AI, a lot of it 13:40
is going to be channeled towards more 13:43
reflection, more research, 13:46
thinking about the answer more deeply. 13:49
So when you're defining safety, you're 13:51
defining a it as accuracy, 13:53
>> functionality. 13:55
>> Functionality. Okay. 13:56
>> It it does what you expect it to do. And 13:58
then you take all the the the technology 14:01
in the horsepower, you put guard rails 14:04
on it, just like our cars. We've got a 14:05
lot of technology in in a car today. A 14:08
lot of it is goes towards, for example, 14:10
ABS. ABS is great. And so, uh, traction 14:12
control, that's fantastic. without a 14:16
without a computer in the car, how would 14:18
you do any of that, 14:20
>> right? 14:21
>> And that little computer, the computers 14:22
that you have doing your traction 14:24
control is more powerful than the 14:25
computer that went to Apollo 11. And so 14:27
you want that technology, 14:30
channel it towards safety, channel it 14:32
towards functionality. And so when 14:34
people talk about power, the advancement 14:36
of technology, often times I I I feel 14:38
what they're thinking and what we're 14:41
actually doing is very different. 14:43
>> Well, what do you think they're 14:45
thinking? Well, they're thinking somehow 14:46
that this this uh this AI is being 14:49
powerful and their their mind probably 14:52
goes towards a sci-fi movie. The 14:55
definition of power, you know, often 14:58
times the definition definition of power 15:00
is military power or physical power. But 15:02
in in the case of technology power when 15:06
we translate all of those operations 15:09
it's towards more refined thinking you 15:11
know more reflection more planning more 15:14
options 15:17
>> I think the big fears that people have 15:18
is one a big fear is military 15:20
applications that's a big fear 15:22
>> because people are very concerned that 15:24
you're going to have 15:25
>> AI systems that make decisions that 15:27
maybe an ethical person wouldn't make or 15:29
a moral person wouldn't make based on 15:31
achieving an objective versus based on, 15:33
you know, how it's going to look to 15:36
people. 15:39
>> Well, I'm I'm happy that that uh our 15:41
military is going to use AI technology 15:44
for defense and I think that that um uh 15:46
Andural uh building military technology. 15:51
I'm happy to hear that. I'm happy to see 15:53
um all these tech startups now 15:56
channeling their technology capabilities 15:57
towards defense and military 15:59
applications. I think you needed to do 16:01
that. 16:03
>> Yeah, we had Palmer Lucky on the 16:03
podcast. He was demonstrating some of 16:05
the stuff I put his helmet on. And we 16:06
show we he showed some videos how you 16:08
could see behind walls and stuff like 16:09
it's nuts. 16:11
>> And he's he's actually the perfect guy 16:12
to go start that company. 16:13
>> 100%. [laughter] Yeah. 100%. It's like 16:15
he was born for that. Yeah. He came in 16:17
here with a copper jacket on. He's a 16:20
freak. [clears throat] It's [laughter] 16:22
awesome. He's awesome. But it's also 16:23
it's a you know an unusual intellect 16:25
channeled into that very bizarre field 16:27
is what you need, you And I think it's 16:30
it's uh I think I'm happy that we're 16:32
making it so more socially acceptable. 16:35
You know, there was a time where when 16:38
somebody wanted to channel their 16:40
technology capability and their 16:41
intellect into defense technology, uh 16:43
somehow they're vilified. Um but uh we 16:47
need people like that. We need people 16:50
who enjoyed enjoy that part of uh 16:51
application of technology. 16:54
>> Well, people are terrified of war, you 16:55
know. So it depends. 16:58
>> Best way to avoid it has excessive 16:59
military might. 17:01
>> Do you think that's absolutely the best 17:03
way? Not not diplomacy, not working 17:04
stuff out. 17:07
>> All of it. 17:08
>> All of it. You have to have military 17:08
might in order to get people to sit down 17:11
with you. 17:12
>> Right. Exactly. All of it. 17:13
>> Otherwise, they just invade. 17:14
>> That's right. [laughter] Why ask for 17:15
permission? 17:17
>> Again, like you said, history. Go back 17:18
and look at history. Um, when you look 17:20
at the future of AI and and you just 17:22
said that no one really knows what's 17:26
happening, do you ever sit down and 17:27
ponder scenarios? 17:30
>> Like what do you what do you think is 17:32
like bestcase scenario for AI over the 17:33
next two decades? 17:37
Um 17:40
the best case scenario is that AI 17:43
diffuses into everything that we do and 17:46
uh our 17:51
everything's more efficient but 17:54
the threat of war remains a threat of 17:58
war. 18:01
Uh, cyber security remains 18:02
a super difficult challenge. 18:07
Somebody is going to try to 18:09
breach your security. You're going to 18:12
have thousands of millions of AI agents 18:15
protecting you from that threat. 18:19
Your technology is going to get better. 18:22
Their technology is going to get better. 18:25
Just like cyber security. Right now, 18:26
while we speak, we're being 18:28
we're seeing cyber attacks all over the 18:32
planet on just about every front door 18:34
you can imagine. 18:35
And 18:38
and yet you and I are sitting here 18:39
talking. And so the reason for that is 18:43
because we know that there's a whole 18:46
bunch of cyber security technology in 18:48
defense. And so we just have to keep 18:50
amping that up, keep stepping that up. 18:52
This episode is brought to you by 18:55
Visible. When your phone plans as good 18:56
as visible, you've got to tell your 18:59
people. It's the ultimate wireless hack 19:01
to save money and still get great 19:03
coverage and a reliable connection. Get 19:05
one line wireless with unlimited data 19:07
and hotspot for $25 a month. Taxes and 19:10
fees included, all on Verizon's 5G 19:14
network. Plus, now for a limited time, 19:18
new members can get the Visible plan for 19:20
just $19 a month for the first 26 19:23
months. Use promo code switch 26 and 19:26
save beyond the season. It's a deal so 19:30
good you're going to want to tell your 19:33
people. Switch now at visible.com/rogan. 19:35
Terms apply. Limited time offers subject 19:38
to change. See visible.com for planned 19:41
features and network management details. 19:44
That's a big issue with people is the 19:47
the worry that technology is going to 19:50
get to a point where encryption is going 19:51
to be obsolete. Encryption is just it's 19:53
no longer going to protect data. It's no 19:56
longer going to protect systems. Do you 19:57
anticipate that ever being an issue or 19:59
do you think there's it's as the defense 20:01
grows, the threat grows, the defense 20:03
grows, and it just keeps going on and on 20:06
and on and they'll always be able to 20:07
fight off any sort of intrusions? 20:09
>> Not forever. some intrusion will get in 20:15
and then that we'll all learn from it. 20:18
And you know the reason why cyber 20:20
security works is because of course the 20:22
technology of defense is advancing very 20:24
quickly. The technology offense is 20:27
advancing very quickly. However, the 20:29
benefit of the cyber security defense is 20:33
that socially the community all of our 20:36
companies work together as one. Most 20:40
people don't realize this. 20:43
There's a whole community of cyber 20:45
security experts. We exchange 20:48
ideas. We exchange best practices. We 20:53
exchange what we detect. The moment 20:55
something has been breached or maybe 20:58
there's a loophole or whatever it is, it 21:00
is shared by everybody. The patches are 21:03
shared with everybody. 21:05
>> That's interesting. 21:06
>> Yeah. Most people don't realize this. 21:07
>> No, I had no I had no idea. I've assumed 21:08
that it would just be competitive like 21:10
everything else. 21:12
>> We work together. Interesting. Has that 21:13
always been the case? 21:15
>> Uh, it surely has been the case for 21:17
about about 15 years. It might not have 21:18
been the case long ago, but this this 21:21
>> what do you think started off that 21:24
cooperation? 21:25
>> Um, people recognizing it's a challenge 21:27
and no company can stand alone. 21:29
>> And the same thing is going to happen 21:32
with AI. I think we all have to decide 21:33
work working together uh to stay out of 21:37
harm's way is is our best chance for 21:40
defense. Then it's basically everybody 21:42
against the threat. 21:45
>> And it also seems like you'd be way 21:46
better at detecting where these threats 21:48
are coming from and neutralizing them. 21:50
>> Exactly. Because the moment you detect 21:52
it somewhere, 21:54
>> you're going to find out right away. 21:55
>> It'll be really hard to hide. 21:56
>> That's right. 21:57
>> Yeah. 21:58
>> That's how it works. That's the reason 21:59
why it's safe. That's why I'm sitting 22:00
here right now instead of, you know, 22:02
locking everything down in video. 22:03
[laughter] 22:05
>> It's not only am I watching my own back, 22:07
I've got everybody watching my back. and 22:10
I'm watching everybody else's back. 22:12
>> It's a bizarre world, isn't it? When you 22:13
think about that cyber threat, 22:15
>> this idea about cyber security is 22:16
unknown to the people who are talking 22:19
about AI threats. They're I think when 22:21
they think about AI threats and AI cyber 22:24
security threats, they have to also 22:26
think about how we deal with it today. 22:27
Now, there's no question that AI is a 22:29
new technology 22:33
and it's a new type of software. In the 22:35
end, it's software just it's a new type 22:37
of software and so it's going to have 22:39
new capabilities but so will the defense 22:41
you know where you use the same AI 22:44
technology to go defend against it. So 22:45
you do you anticipate a time ever in the 22:48
future where it's going to be impossible 22:51
where there's not going to be any 22:54
secrets where the bottleneck between the 22:56
technology that we have and the 23:00
information that we have. Information is 23:01
just all a bunch of ones and zeros. It's 23:02
out there on hard drives and the 23:04
technology has more and more access to 23:06
that information. Is it ever going to 23:07
get to a point in time where there's no 23:09
way to keep a secret? 23:12
>> I don't think 23:14
>> because it seems like that's where 23:14
everything is kind of headed in a weird 23:15
way. 23:17
>> I don't think so. I think the quantum 23:17
computers were supposed to will Yeah. 23:18
quantum computers will make it possible 23:21
will make it so that the previous 23:22
quantum previous encryption technology 23:25
is obsolete. But that's the reason why 23:28
the entire industry is working on 23:31
postquantum 23:33
encryption technology. 23:35
>> What would that look like? 23:37
>> New algorithms. 23:39
>> But the crazy thing is when you hear 23:40
about the kind of computation that 23:41
quantum computing can do. 23:44
>> Yeah. 23:45
>> And the the power that it has. Yeah. 23:46
>> Where you know you're looking at 23:47
>> all the supercomputers in the world. It 23:49
would take billions of years and it 23:51
takes them a few minutes to solve these 23:52
equations. Like how do you make 23:54
encryption for something that can do 23:56
that? I'm not sure, but there's 23:58
[laughter] 23:59
but I've got a bunch of scientists who 24:00
are working on that. 24:02
>> Boy, I hope they [snorts] could figure 24:02
it out. 24:04
>> Yeah, we got a bunch of scientists who 24:04
are expert in that. And 24:05
>> is the ultimate fear that it can't be 24:06
breached that quantum computing will 24:08
always be able to to decrypt all other 24:10
quantum computing encryption? 24:13
>> I don't think that 24:16
>> it just gets to some point where it's 24:16
like, stop playing the stupid game. We 24:18
know everything. 24:20
>> I don't think so. 24:21
>> No, 24:22
>> because I I'm you know, history is 24:22
guide. 24:25
History is a guide before AI came 24:26
around. That's my worry. My worry is 24:28
this is a totally, you know, it's like 24:30
history was one thing and then nuclear 24:31
weapons kind of changed all of our 24:33
thoughts on war and mutually assured 24:35
destruction came 24:37
everybody to stop using nuclear bombs. 24:40
>> Yeah. 24:42
>> My worry is that 24:43
>> the thing is Joe is that that AI is not 24:44
going to it's not like we're cavemen and 24:46
then all of a sudden one day AI shows 24:49
up. every single day we're getting 24:51
better and smarter because we have AI 24:54
and so we're stepping on our own AI's 24:57
shoulders. So when when that whatever 24:59
that AI threat comes, it's a click 25:01
ahead. It's not a galaxy ahead, 25:05
>> you know, it's just a click ahead. And 25:08
so so I think I think the the the idea 25:10
that somehow this AI 25:14
is going to pop out of nowhere and 25:17
somehow think in a way that we can't 25:20
even imagine thinking and do something 25:22
that we can't possibly imagine I think 25:25
is far-fetched. And the reason for that 25:28
is because we're all have we all have 25:30
AIs and you know there's a whole bunch 25:32
of AIs being in development. we know 25:34
what they are and we're using it and and 25:36
so every single day we're getting we're 25:38
close to each other. 25:40
>> But don't they do things that are very 25:42
surprising? 25:44
>> Yeah. But so you you have an AI that 25:46
does something surprising. I'm going to 25:48
have an AI and my AI looks at your AI 25:49
and goes that's not that surprising. 25:52
>> The fear for the lay person like myself 25:53
is that AI becomes sentient and makes 25:55
its own decisions 25:57
and then ultimately decides to just 25:59
govern the world. do it its own way. 26:03
They're like, "You guys, you had a good 26:06
run, but 26:08
>> we're taking over now." 26:09
>> Yeah, but my my AI is gonna take care of 26:12
me. I mean, [laughter] 26:14
so that's the this is the cyber security 26:15
argument. 26:19
>> Yes. 26:19
>> Do you have an AI and it's super smart, 26:20
but my AI is super smart, too. And and 26:23
maybe your AI. Let let's pretend let's 26:25
let's pretend for a second that we 26:28
understand what consciousness is and we 26:30
understand what sentience is and and 26:32
that in fact 26:34
>> and we really are just pretending. 26:34
>> Okay, let's just pretend for a second 26:36
that we we believe that. I don't believe 26:37
actually I don't actually don't believe 26:39
that but nonetheless we let's pretend we 26:40
believe that. 26:42
>> So your your your AI is conscious and my 26:42
AI is conscious and and let's say your 26:45
AI is you know wants to I don't know do 26:47
something surprising. 26:51
My AI is so smart that it won't it might 26:53
be surprising to me, but it probably 26:56
won't be surprising to my AI. And so 26:57
maybe my AI 27:00
thinks it's surprising as well, but it's 27:02
so smart the moment it sees it the first 27:05
time, it's not going to be a surprise 27:07
the second time, just like us. And so I 27:08
feel like I think the idea that that 27:11
only one person has [clears throat] AI 27:15
and that one person's AI is compares 27:16
everybody else's AI is Neanderthal 27:20
[snorts] is um probably unlikely. I 27:24
think it's much more like cyber 27:26
security. 27:28
>> Interesting. 27:30
>> I think the fear is not that your AI is 27:31
going to battle with somebody else's AI. 27:34
The fear is that AI is no longer going 27:36
to listen to you. That's the fear is 27:38
that human beings won't have control 27:41
over it after a certain point if it 27:42
achieves sensience and then has the 27:45
ability to be autonomous 27:47
>> that there's one AI. 27:49
>> Well, they just combine. 27:51
>> Yeah. Becomes one AI 27:53
>> that it's a life form. 27:54
>> Yeah. 27:55
>> But that's the there's arguments about 27:56
that, right? That we're dealing with 27:57
some sort of synthetic biology that it's 27:59
not as simple as new technology that 28:01
you're creating a life form. 28:03
>> If it's like life form, 28:04
let's go along with that for a while. I 28:07
think if it's like life form, as you 28:09
know, all life forms don't agree. And so 28:11
I'm going to have to go with your life 28:14
form and my life form are going to agree 28:16
because my life form is going to want to 28:18
be the super life form. And and now that 28:19
now that we have disagreeing life forms, 28:22
uh we're back back again to where we 28:25
are. Well, they would probably cooperate 28:26
with each other. 28:28
It would just the reason why we don't 28:31
cooperate with each other is we're 28:33
territorial primates. 28:35
But AI wouldn't be a territorial 28:37
primate. It would realize the folly in 28:39
that sort of thinking and it would say, 28:41
"Listen, there's plenty of energy for 28:44
everybody. We we don't need to dominate. 28:46
We don't need We're not trying to 28:49
acquire resources and take over the 28:51
world. We're not looking to find a good 28:52
breeding partner. We're just existing as 28:54
a new super life form that these cute 28:58
monkeys created for us." 29:02
Okay. Well, that would be a that would 29:04
be a um a superpower with no ego, 29:07
>> right? And and if it has no ego, 29:12
why would it have the ego to do any harm 29:17
to us? 29:19
>> Well, I don't assume that it would do 29:20
harm to us, but the the fear would be 29:22
that we would no longer have control and 29:25
that we would no longer be the apex 29:27
species on the planet. this thing that 29:30
we created would now be. [laughter] 29:32
>> Is that funny? 29:35
>> No. 29:36
>> I just think it's not gonna happen. 29:37
>> I know you think it's not gonna happen, 29:38
but 29:40
>> it could, right? And here's the other 29:41
thing is like 29:43
>> if we're racing towards could Yeah. 29:44
>> And could could be the end of human 29:46
beings being in control of our own 29:50
destiny. 29:51
>> I just think it's extremely unlikely. 29:53
>> Yeah. 29:55
>> That's what they said in the Terminator 29:55
movie [laughter] 29:57
>> and it hasn't happened. 29:58
>> No, not yet. But you guys are working 29:59
towards it. Um the the thing about 30:01
you're saying about conscience and 30:04
sensience that you don't think that AI 30:05
will achieve consciousness or that the 30:08
question is what's the definition? 30:11
>> Yeah. What's the definition of 30:12
>> what is the definition to you? 30:14
>> Um uh 30:16
consciousness 30:19
um 30:21
uh f I guess first of all uh you need to 30:23
know about your own existence. 30:26
Um, 30:31
you have to have experience, not just 30:36
knowledge and intelligence. 30:39
The concept of a machine 30:47
having an experience. 30:49
I'm not well, first of all, I don't know 30:52
what defines experience, why we have 30:54
experiences, right? 30:56
>> Yeah. and why this microphone doesn't 30:57
uh and so it I think I know I well I 31:00
think I I I think I know what 31:05
consciousness is the sense of experience 31:08
the ability to know self versus 31:11
um 31:16
uh the ability to be able to reflect 31:18
know our own self the sense of ego I 31:21
think all of all of those human 31:25
experiences 31:27
uh probably is what consciousness is 31:29
but why it exists versus 31:35
the concept of knowledge and 31:39
intelligence which is what AI is defined 31:41
by today [clears throat] it has 31:44
knowledge it has intelligence artificial 31:45
intelligence we don't call it artificial 31:48
consciousness 31:49
artificial intelligence the ability to 31:51
uh perceive believe, recognize, 31:54
understand, 31:58
um, plan, 32:00
uh, perform tasks. 32:04
Those things are foundations of 32:07
intelligence 32:09
to know things, knowledge. 32:11
I don't, it's clearly different than 32:14
consciousness. 32:17
>> But consciousness is so loosely defined. 32:18
How can we say that? I mean, doesn't a 32:20
dog have consciousness? Yeah. 32:22
>> Dogs seem to be pretty conscious. 32:23
>> That's right. 32:25
>> Yeah. So, and that's a lower level 32:25
consciousness than a human being's 32:27
consciousness. 32:29
>> I'm not sure. Yeah. Right. Well, 32:30
>> the question is what lower level 32:32
intelligence? It's lower level 32:34
intelligence, but I don't know that it's 32:35
lower level consciousness. 32:37
>> That's a good point. Right. 32:38
>> Because I believe my dogs feel as much 32:39
as I feel. 32:42
>> Yeah. They feel a lot. Right. 32:42
>> Yeah. They get attached to you. That's 32:45
right. They get depressed if you're not 32:47
there. 32:48
>> That's right. Exactly. 32:49
>> There's There's definitely that. 32:50
>> Yeah. um the the concept of experience, 32:52
>> right? 32:56
>> Um but isn't AI interacting with 32:56
society? So, doesn't it acquire 32:59
experience through that interaction? 33:01
>> Um I don't think interactions is 33:04
experience. I think experience is uh 33:06
experience is a collection of feelings. 33:10
I think 33:13
>> you're aware of that AI um I forget 33:15
which one where they gave it some false 33:17
information about one of the programmers 33:20
having an affair with his wife just to 33:22
see how it would respond to it and then 33:24
when they said they were going to shut 33:25
it down it threatened to blackmail him 33:26
and reveal his affair and it was like 33:28
whoa like it's conniving like if that's 33:31
not learning from experience and being 33:33
aware that you're about to be shut down 33:37
which would imply at least some kind of 33:38
consciousness or you could kind defined 33:40
it as consciousness if you were very 33:43
loose with the term and if you imagine 33:45
that this is going to exponentially 33:47
become more powerful. Wouldn't that 33:49
ultimately lead to a different kind of 33:52
consciousness than we're defining from 33:54
biology? Well, first of all, let's just 33:56
break down what it probably did. It 33:58
probably read somewhere. There's 34:01
probably text that that in these 34:03
consequences 34:07
certain people did that. I could imagine 34:09
a novel, 34:12
>> right? 34:12
>> Having those words related. 34:13
>> Sure. 34:16
>> And so inside 34:16
>> it realizes it strategy for survival is 34:18
>> it's just a bunch of numbers 34:20
>> that it's just a bunch of numbers that 34:22
that in the in the collection of numbers 34:24
that relates to a husband cheating on a 34:28
wife. Um 34:30
has subsequently a bunch of numbers that 34:33
relates to blackmail and such things. 34:37
However, whatever the revenge was, 34:39
>> right? 34:41
>> And so it has spewed it out. 34:42
>> And so it's just like, you know, it it's 34:44
just as if I'm asking it to write me a 34:47
poem in Shakespeare. It just whatever 34:50
the words are in the world in in that 34:52
dimensionality, this dimensionality is 34:55
all these vectors and in in 34:57
multi-dimensional space. These words 34:59
that were in the prompt that described 35:04
the affair um subsequently led to one 35:07
word after another led to um you know 35:11
some revenge and something but it's not 35:14
because it had consciousness or you know 35:16
it just spewed out those words generated 35:18
those words 35:20
>> I understand what you're saying that 35:21
patterns that human beings have 35:23
exhibited both in literature and in real 35:25
life 35:27
>> that's exactly right 35:27
>> but it at a certain point in time one 35:28
would say, "Okay, well, it couldn't do 35:30
this two years ago and it couldn't do 35:32
this four years ago." Like when we're 35:34
looking towards the future, like at what 35:36
point in time when it can do everything 35:38
a person does, what point in time do we 35:40
decide that it's conscious? If it 35:42
absolutely mimics all human thinking and 35:44
behavior patterns, 35:48
>> that doesn't make it conscious. 35:49
>> It becomes in disccernible. It's it's 35:50
aware. It can communicate with you the 35:52
exact same way a person can. Like is con 35:54
is consciousness are we putting too much 35:57
weight on that concept because it seems 35:59
like it's a version of a kind of 36:01
consciousness. 36:03
>> It's a version of imitation. 36:04
>> Imitation consciousness, right? But if 36:06
it perfectly imitates it, 36:08
>> I still think it's a per it's an example 36:10
of imitation. 36:12
>> So it's like a fake Rolex when they 3D 36:12
print them and make them 36:14
>> indestruable. The question is what's the 36:15
definition consciousness? 36:17
>> Yeah. 36:18
>> Yeah. 36:19
>> That's the question. And I don't think 36:20
anybody's really clearly defined that. 36:21
That's what get where it gets weird and 36:23
that that's where the real doomsday 36:25
people are worried that you are creating 36:27
a form of consciousness that you can't 36:29
control. I believe it is possible to 36:31
create a machine 36:35
that imitates 36:38
human intelligence 36:41
and 36:43
has the ability to 36:44
understand information, 36:47
understand 36:50
instructions, break the problem down, 36:52
solve problems, and perform tasks. I 36:54
believe that completely. 36:58
I believe that that um we could have a 37:00
computer that has a vast amount of 37:07
knowledge. Some of it true, some of it 37:09
not true. 37:12
Some of it generated by humans, some of 37:14
it generated synthetically. And more and 37:17
more of knowledge in the world will be 37:19
generated synthetically going forward. 37:23
You know, until now the knowledge that 37:25
we've we have are knowledge that we 37:27
generate and we propagate and we send to 37:31
each other and we amplify it and we add 37:33
to it and we modify it. We change it. In 37:35
the future, 37:39
in a couple of years, maybe two or three 37:42
years, 90% of the world's knowledge will 37:45
likely be generated by AI. 37:47
>> That's crazy. 37:49
>> I know. But it's just fine. 37:50
>> But it's just fine. 37:52
>> I know. And the reason for that is this. 37:53
Let me tell you why. 37:56
>> Okay? 37:57
>> It's because um what difference does it 37:57
make to me that I am learning from a 38:00
textbook that was generated by a bunch 38:04
of people I didn't know or written by a 38:06
book that you know from somebody I don't 38:10
know uh to uh knowledge generated by AI 38:12
computers that are assimilating all of 38:17
this and reynthesizing things. To me, I 38:18
don't think there's a whole lot of 38:21
difference. We still have to we still 38:22
have to fact check it. We still have to 38:24
make sure that it's you know based on 38:26
fundamental first principles and we 38:28
still have to do all of that just like 38:30
we do today. 38:31
>> Is this taking into account the kind of 38:32
AI that exists currently? And do you 38:34
anticipate that just like we could have 38:37
never really believed that AI would be 38:40
at least a person like myself would 38:42
never believe AI would be as so 38:43
ubiquitous and so worth it. It's it's so 38:45
powerful today and so important today. 38:48
We never thought that 10 years ago. 38:50
Never thought that, 38:52
>> right? 38:53
>> You imagine like what are we looking at 38:53
10 years from now? 38:55
>> I I think that if you reflect back 10 39:00
years from now, you would say the same 39:03
thing that we would have never believed 39:05
that 39:07
>> but 39:08
>> in a different direction, 39:08
>> right? But if you if you go forward 9 39:09
years from now 39:12
and then ask yourself what's going to 39:15
happen 10 years from now, I think it'll 39:17
be quite gradual. Um, one of the things 39:19
that Elon said that makes me happy is he 39:22
he's he believes that we're going to get 39:25
to a point where it's not 39:28
it's not necessary for people to work 39:31
and not meaning that you're going to 39:34
have no purpose in life, but you will 39:37
have in his words universal high income 39:39
because so much revenue is generated by 39:42
AI that it will take away this need for 39:44
people to do things that they don't 39:50
really enjoy doing just for money. And I 39:52
think a lot of people have a problem 39:54
with that because their entire identity 39:56
and who how they think of themselves and 39:59
how they fit in the community is what 40:01
they do. Like this is Mike. He's an 40:02
amazing mechanic. Go to Mike and Mike 40:04
takes care of things. But there's going 40:06
to come a point in time where AI is 40:08
going to be able to do all those things 40:11
much better than than people do. And 40:12
people will just be able to receive 40:14
money. But then what does Mike do? Mike 40:16
is, you know, really loves being the 40:18
best mechanic around. You know, what 40:21
does the guy who, you know, 40:23
codes, what does he do when AI can code 40:26
infinitely faster with zero errors? Like 40:29
what what happens with all those people? 40:32
And that is where it gets weird. It's 40:34
like because we've sort of wrapped our 40:37
identity as human beings around what we 40:38
do for a living. 40:41
>> You know, when you meet someone, one of 40:42
the first things you meet somebody at a 40:44
party, hi Joe. What's your name? Mike. 40:45
What do you do? Mike and you know Mike's 40:47
like, "Oh, I'm a lawyer." "Oh, what kind 40:49
of law?" And you have a conversation, 40:50
you know, when Mike is like, "I get 40:52
money from the government. I play video 40:54
games." 40:55
>> Gets weird. 40:56
>> Mhm. 40:57
>> And I think um the concept sounds great 40:57
until you take into account human 41:01
nature. And human nature is that we like 41:03
to have puzzles to solve and things to 41:06
do and and an identity that's wrapped 41:08
around our idea that we're very good at 41:10
this thing that we do for a living. 41:13
>> Yeah. Yeah, I think um let's see, let me 41:16
start with the more mundane and I'll 41:20
work work backwards, okay? Work forward. 41:21
Uh so one of the predictions from uh 41:24
Jeff Hinton who who started the whole 41:30
deep learning phenomenon the deep 41:33
learning technology trend 41:36
and uh in incredible incredible 41:38
researcher uh professor at University of 41:41
Toronto 41:44
uh he invented discovered or invented 41:45
the the idea of of back propagation 41:48
which which uh allows the neural network 41:51
to learn. 41:54
And um 41:56
and as as as you know uh for for the 42:00
audience, 42:03
software historically was humans 42:05
applying first principles and our 42:08
thinking to uh describe an algorithm 42:10
that is then codified just like a recipe 42:15
that's codified in software. It looks 42:19
just like a recipe. how to cook 42:22
something looks exactly the same just in 42:23
a slightly different language. We call 42:25
it Python or C or C++ or whatever it is. 42:27
In the case of deep learning, this 42:32
invention of artificial intelligence, 42:35
we put a structure of a whole bunch of 42:37
neural networks and a whole bunch of 42:40
math units 42:43
and we make this large structure. It's 42:45
like a switchboard of little 42:49
u mathematical units and we connect it 42:53
all together. 42:55
Um, and we give it the input that 42:57
the software would eventually receive 43:03
and we just let it randomly guess what 43:06
the output is. And so we say, for 43:10
example, the input could be a picture of 43:12
a cat. 43:15
And and um one of the outputs of the 43:17
switchboard is where the cat signal is 43:20
supposed to show up. And all of the 43:23
other signals, the other one's a dog, 43:25
the other one's an elephant, the other 43:28
one's a tiger. 43:29
And all of the other signals are 43:31
supposed to be zero when I show it a 43:33
cat. And the one that is a cat should be 43:35
one. 43:38
And I show at a cat through this big 43:40
huge network of switchboards and math 43:43
units and they're just doing multiply 43:46
and adds multiplies and ads. Okay? 43:49
And and uh and this thing, this 43:53
switchboard is gigantic. 43:55
The more information you're going to 43:58
give it, the more the bigger this 43:59
switchboard has to be. And what Jeff 44:01
Hinton discovered was a invented was a 44:03
way for you to 44:06
guess that put the cat signal in put the 44:09
cat image in and that cat image you know 44:11
could be a million numbers because it's 44:15
you know a megapixel image for example 44:18
and it's just a whole a whole bunch of 44:20
numbers and somehow from those numbers 44:22
it has to light up the cat signal. Okay, 44:26
that's the bottom line. And if it the 44:29
first time you do it, it just comes up 44:33
with garbage. And so it says the right 44:35
answer is cat. And so you need to 44:39
increase this signal and decrease all of 44:43
the other and back propagates the 44:45
outcome through the entire network. And 44:48
then you show another. Now it's an image 44:51
of a dog and it guesses it takes a swing 44:54
at it and it comes up with a bunch of 44:58
garbage and you say no no no the answer 45:00
is this is a dog I want you to produce 45:03
dog and all of the other switch all the 45:05
other outputs have to be zero and I want 45:09
to back propagate that and just do it 45:11
over and over and over again. It's just 45:14
like uh showing a a kid this is an 45:16
apple, this is a dog, this is a cat. And 45:18
you just keep showing it to them until 45:20
they eventually get it. Okay. Well, 45:22
anyways, that big invention is deep 45:25
learning. That's the foundation of 45:26
artificial intelligence, a piece of 45:28
software 45:31
that learns from examples. That's 45:33
basically we machine learning, a machine 45:36
that learns. Uh and so so one of the the 45:38
big 45:42
first 45:44
applications was image recognition and 45:46
one of the most important image 45:48
recognition applications is radiology. 45:50
>> And so so uh uh he predicted uh about 5 45:53
years ago that in five years time the 45:59
world won't need any radiologists 46:02
because AI would have swept the whole 46:05
field. 46:06
Well, it turns out AI has swept the 46:08
whole field. That is completely true. 46:10
Today, just about every radiologist is 46:13
using AI in some way. And what's ironic 46:16
though, what's what's interesting is 46:20
that the number of radiologist has 46:22
actually grown. 46:24
And so the question is why? That's kind 46:27
of interesting, right? 46:30
>> It is. And so the prediction was in fact 46:31
that 46:34
30 million radiologists will be wiped 46:36
out. 46:38
But as it turns out, we needed more. And 46:40
the reason for that 46:42
[clears throat and cough] 46:43
is because the purpose of a radiologist 46:44
is to diagnose disease, 46:47
not to study the image. This the image 46:49
studying is simply a task to in service 46:51
of diagnosing the disease. And so now 46:57
the fact that you could study the images 47:01
more quickly and more precisely 47:04
without ever making a mistake and never 47:07
gets tired. 47:08
You could study more images. You could 47:10
study it in 47:13
3D form instead of 2D because you know 47:15
the AI doesn't care whether it studies 47:19
images in 3D or 2D. You could study it 47:20
in 4D. And so the now you could study 47:23
images in a way that radiologist 47:26
radiologists can't easily do and you 47:28
could study a lot more of it. And so the 47:31
number of tests that people are able to 47:33
do increases and because they're able to 47:35
serve more patients, the hospital does 47:38
better. They have more clients, more 47:42
patients. As a result, they have better 47:44
economics. When they have better 47:46
economics, they hire more radiologists 47:48
because their purpose is not to study 47:50
the images. their purpose is to diagnose 47:52
disease. And so the question is the what 47:55
I'm leading up to is ultimately what is 47:58
the purpose? What is the purpose of the 48:00
lawyer? And has the purpose changed? 48:03
What is the purpose? You know, one of 48:07
the examples that I gave is is um that I 48:09
would give is for example uh if my car 48:11
became self-driving 48:15
will all chauffeers be out of jobs? The 48:17
answer probably is not because for some 48:20
per for some chauffeers they for some 48:22
people who are driving you they could be 48:25
protectors some people um they're part 48:26
of the experience part of the service so 48:29
when you get there they you know they 48:31
could take care of things for you and so 48:33
for a lot of different reasons not all 48:35
chauffeers would lose their jobs some 48:37
chauffeers would lose their jobs and uh 48:40
many chauffeers would change their jobs 48:42
and the type of applications of 48:45
autonomous vehicles will probably 48:47
increase you know the usage of the 48:49
technology within find new homes and so 48:51
I I think you have to go back to what is 48:54
the purpose of a job you know like for 48:56
example if AI comes along I actually 48:58
don't believe I'm going to lose my job 49:00
because my purpose isn't to I have to 49:01
look at a lot of documents I study a lot 49:05
of emails I look at a bunch of diagrams 49:08
you know um the question is what is the 49:11
job and and uh the purpose of somebody 49:14
probably hasn't changed a lawyer for 49:17
example help people that probably hasn't 49:19
changed studying legal documents 49:21
generating documents it's part of the 49:23
job not the job 49:26
>> but don't you think there's many jobs 49:27
that AI will replace 49:29
>> if your job is automation 49:31
>> yeah if your job is the task 49:33
>> right so automation 49:35
>> yeah factor if your job is the task 49:36
>> that's a lot of people 49:39
>> it could be a lot of people but it'll 49:40
probably generate like for example 49:42
>> uh let's say we let's say I'm super 49:45
excited about the the the robots Elon's 49:47
working on. 49:50
It's still a few years away. 49:52
When it happens, when it happens, 49:54
um 49:58
there's a whole new industry of 50:00
technicians and people who have to 50:02
manufacture the robots, right? 50:05
>> Mhm. 50:06
>> And so that that job never existed. And 50:07
so you're going to have a whole industry 50:10
of people taking care of like for 50:12
example, you know, all the mechanics and 50:15
all the people who are building things 50:17
for cars, supercharging cars, uh that 50:18
didn't exist before cars and now we're 50:23
going to have robots. You're going to 50:24
have robot apparel. So a whole industry 50:26
of [laughter] Right. Isn't that right? 50:29
Because I want my robot to look 50:30
different than your robot. 50:31
>> Oh god. 50:32
>> And so [laughter] you're going to you're 50:33
going to have a whole, you know, apparel 50:35
industry for robots. You're going to 50:36
have mechanics for robots and you have 50:38
you know people who comes and maintain 50:40
your robots 50:42
>> automated though. 50:43
>> No, 50:43
>> you don't think so? You don't think 50:44
[clears throat] they'll be all done by 50:45
other robots 50:46
>> eventually? And then there'll be 50:47
something else. 50:49
>> So you think ultimately people just 50:50
adapt except if you are the task 50:52
>> which is a large percentage of the 50:56
workforce. 50:58
>> If your job is just to chop vegetables, 50:59
quezin art is going to replace you. 51:01
>> Yeah. So people have to find meaning in 51:02
other things. Your job has to be more 51:05
than the task. 51:07
>> What do you think about Elon's belief 51:08
that this universal basic income thing 51:10
will eventually become necessary? 51:13
>> Many people think that. Andrew Yang 51:18
thinks that 51:19
>> he was one of the first people to sort 51:21
of sound that alarm during the the 2020 51:22
election. 51:24
Yeah, I I guess um 51:30
yeah, both ideas probably won't exist at 51:34
the same time and and um as in life, 51:37
things will probably be in the middle. 51:40
One idea, of course, is that there'll be 51:42
so much abundance of resource that 51:45
nobody needs a job and we'll all be 51:47
wealthy. 51:49
On the other hand, um we're going to 51:51
need universal basic income. Both ideas 51:54
don't exist at the same time, 51:57
>> right? 51:59
>> And so we're either going to be all 52:00
wealthy or we're going to be all 52:01
>> How could everybody be wealthy though? 52:04
But 52:05
>> because scenario wealthy not because you 52:06
have a lot of dollars, wealthy because 52:08
there's a lot of abundance. Like for 52:09
example, today we are wealthy of 52:11
information. 52:14
You know, this is some a concept several 52:16
thousand years ago only a few people 52:17
have. And so, uh, today we have wealth 52:20
of a whole bunch of things, resources 52:23
that that historic point. Yeah. And so, 52:25
we're going to have wealth of resources, 52:27
things that we think are valuable today 52:29
that in the future are just not not that 52:32
valuable, you know, and so it because 52:34
it's automated. And so I think I think 52:36
the question 52:39
maybe maybe partly it's hard to answer 52:41
partly because 52:45
it's hard to talk about infinity and 52:48
it's hard to talk about a long time from 52:50
now and and the reason for that is 52:51
because 52:54
there's just too many scenarios to to 52:57
consider. But I think it I think in the 52:59
next several years, call it 5 to 10 53:01
years, 53:03
there are several things that I I 53:06
believe in hope. Um, and I say hope 53:08
because I'm not sure. One of the things 53:11
that I believe is that the technology 53:13
divide will be substantially collapsed. 53:16
And of course the alternative 53:22
viewpoint is that AI is going to 53:26
increase the technology divide. 53:29
Now the reason why I believe AI is going 53:32
to reduce the technology divide. 53:34
I is because we have proof 53:37
the evidence is that AI is the easiest 53:40
application in the world to use. Chat 53:43
GPT has grown to almost a billion users 53:45
frankly practically overnight. And if 53:48
you're not exactly sure how to use, 53:51
everybody knows how to use chatpt. Just 53:53
say something to it. If you're not sure 53:54
how to use chatpt, you ask chatd how to 53:56
use it. No tool in history has ever had 53:59
this capability. A quez an art, you 54:03
know, if you don't know how to use it, 54:06
you're kind of screwed. You're going to 54:07
walk up to it and say, "How do you use a 54:09
quezin art?" You're going to have to 54:10
find somebody else. And so, but an AI 54:11
will just tell you exactly how to do it. 54:14
Anybody could do this. It'll speak to 54:16
you in any language. And if it doesn't 54:18
know your language, you'll speak it in 54:20
that language and it'll probably figure 54:22
out that it doesn't completely 54:24
understand your language. Go learns it 54:25
instantly and comes back and talk to 54:28
you. And so I think the the technology 54:29
divide has a real chance finally that 54:32
you don't have to speak Python or C++ or 54:35
forran. You can just speak human and 54:38
whatever form of human you like. And so 54:41
I think that that has a real chance of 54:43
closing the technology divine. Now, of 54:45
course, the counternarrative would say 54:48
that 54:51
AI is only going to be available for the 54:53
nations and the countries that have a 54:58
vast amount of resources because AI 55:00
takes energy 55:02
and AI takes um a lot of GPUs and 55:04
factories to be able to produce the AI. 55:08
No doubt at the scale that we would like 55:11
to do in the United States. But the fact 55:13
of the matter is your phone's going to 55:15
run AI just fine all by itself, you 55:17
know, in a few years. Today, it already 55:21
does it fairly decently. And so the the 55:23
the fact that every every country, every 55:26
nation, every every society will have 55:29
the benefit of very good AI. It might 55:32
not be tomorrow's AI. It might be 55:34
yesterday's AI, but yesterday's AI is 55:36
freaking amazing. You know, in 10 years 55:39
time, 9year-old AI is going to be 55:41
amazing. You don't need, you know, 10 55:43
year old AI. You don't need frontier AI 55:45
like we need frontier AI because we want 55:48
to be the world leader. But for every 55:50
single country, everybody, I think the 55:52
ele the capability to elevate 55:54
everybody's knowledge and capability and 55:56
intelligence, uh, that day is coming. 55:58
The octagon isn't just in Las Vegas 56:00
anymore. It's right in your hands with 56:02
DraftKings Sportsbook, the official 56:04
sports betting partner of UFC. Get ready 56:06
because when Dwabish Willie and Yan face 56:09
off again at UFC 323, every punch, every 56:12
takedown, every finish, it all has the 56:16
potential to pay off in real time. New 56:19
customers bet just $5. And if your bet 56:21
wins, you get paid $200 in bonus bets. 56:24
And hey, Missouri, the wait is over. 56:27
DraftKings Sportsbook is now live in the 56:29
Show Me State. Download the DraftKings 56:32
Sportsbook app and use promo code Rogan. 56:34
That's code Rogan to turn five bucks 56:37
into 200 in bonus bets if your bet wins. 56:39
In partnership with DraftKings, the 56:43
crown is yours. Gambling problem? Call 56:45
1800 gambler. In New York, call 8778 56:47
wire or text hope 467-369. In 56:50
Connecticut, help is available for a 56:53
problem gambling. Call 888789-7777 56:54
or visit ccpg.org. Please play 56:57
responsibly. On behalf of Bootill Casino 57:00
and Resort in Kansas, pass through of 57:01
per wager tax may apply in Illinois. 21 57:03
and over. Age and eligibility varies by 57:05
jurisdiction void in Ontario. 57:07
Restrictions apply. Bet must win to 57:08
receive bonus bets which expire in 7 57:10
days. Minimum odds required. For 57:11
additional terms and responsible gaming 57:13
resources, see dkg.co/audio. 57:14
Limited time offer. 57:17
>> And also energy production, which is the 57:19
real bottleneck when it comes to third 57:22
world countries and 57:24
>> that's right, 57:25
>> electricity and all all the resources 57:26
that we take for granted. 57:29
>> Almost everything is going to be energy 57:31
constrained. And so if you take a look 57:32
at um 57:35
one of the most important technology 57:37
advances in history is this idea called 57:39
Moore's law. Moore's law 57:41
was the started basically in my 57:45
generation 57:48
and my generation is the generation of 57:50
computers. I graduated in 1984 and that 57:52
was basically at the very beginning of 57:56
the PC revolution. 57:58
And the microprocessor and and um 58:01
every single year it approximately 58:06
doubled 58:08
and we describe it as every single year 58:10
we double the performance. But what it 58:12
really means is that every single year 58:14
the cost of computing halfed. 58:17
And so the cost of computing in the 58:20
course of five years reduced by a factor 58:24
of 10. The amount of energy necessary to 58:27
do computing to do any task reduced by a 58:31
factor of 10. Every single 10 years 100 58:33
a th00and 10,000 58:38
100,000 so on and so forth. And so each 58:41
one of 58:45
the clicks of Moore's law, the amount of 58:47
energy necessary to do any computing 58:49
reduced. That's the reason why you have 58:51
a laptop today when back in 1984 sat on 58:53
the desk, you got to plug in, it wasn't 58:57
that fast and it consumed a lot of 58:59
power. Today, you know, it is only a few 59:01
watts. And so Moore's law is the 59:03
fundamental technology, the fundamental 59:06
technology trend that made it possible. 59:08
Well, what's going on in AI? The reason 59:10
why Nvidia is here is because in we 59:12
invented this new way of doing 59:14
computing. We call it accelerated 59:16
computing. We started it 33 years ago. 59:17
Took us about 30 years to really made a 59:19
huge breakthrough. In that in that 30 59:22
years or so 59:25
we took computing you know probably a 59:27
factor of well let me just say in last 59:31
10 years the last 10 years we improved 59:33
the performance of computing by 100,000 59:36
times. 59:40
Whoa. Imagine a car over the course of 59:41
10 years that became a 100,000 times 59:44
faster or at the same speed 100,000 59:46
times cheaper or at the same speed 59:50
100,000 times less energy. If your car 59:54
did that, it doesn't need energy at all. 59:57
What I mean what what I'm trying to say 00:00
is that in 10 years time the amount of 00:02
energy necessary for artificial 00:06
intelligence for most people will be 00:08
minuscule 00:10
utterly minuscule and so we'll have AI 00:12
running in all kinds of things and all 00:15
the time because it doesn't consume that 00:16
much energy and so if you're a nation 00:18
that uses AI for you know almost 00:21
everything in your social fabric of 00:24
course you're going to need these AI 00:26
factories but for a lot of countries I 00:27
think you're going You're going to have 00:29
excellent AI and you're not going to 00:30
need as much energy. Everybody will be 00:32
able to come along is my point. 00:34
>> So currently that that is a big 00:36
bottleneck, right? Is energy. 00:38
>> Yeah, it is the bottleneck. 00:40
>> The bottleneck is this. So was it Google 00:41
that is making nuclear power plants to 00:43
operate one of its AI factories? 00:47
>> Oh, I haven't heard that. But I think in 00:50
the next six, seven years, I think 00:51
you're going to see a whole bunch of 00:53
small nuclear reactors. 00:55
>> And by small, like how big are you 00:57
talking about? Hundreds of megawws. 00:58
Yeah. 01:00
>> Okay. And that these will be local to 01:01
whatever specific company they have. 01:04
>> That's right. Will all be power 01:06
generators. 01:07
>> Whoa. 01:08
>> You know, just like just like your you 01:09
know, somebody's farm. 01:12
>> It probably is the smartest way to do 01:13
it, right? 01:15
>> And it takes the burden off Yeah. takes 01:16
the burden off the grid. It takes and 01:18
you could build as much as you need 01:20
>> and you can contribute back to the grid. 01:22
It's a really important point that I 01:24
think you just made about Moore's law 01:25
and the relationship to pricing because 01:27
you know a laptop today like you can get 01:31
one of those little Mac MacBook Airs. 01:32
They're incredible. They're so thin, 01:34
unbelievably powerful. Battery life is 01:36
charge it. 01:38
>> Yeah. Battery [laughter] life's crazy. 01:39
And uh it's not that expensive 01:40
relatively speaking. Like something like 01:43
that. 01:44
>> I remember. 01:45
>> And that's just Moore's law, right? 01:45
>> Then there's the Nvidia law. 01:47
>> Oh, 01:49
>> just right. the the the law I was 01:49
talking to you about, the computing that 01:51
we invented, 01:53
>> right? 01:54
>> The reason why we're here, this new this 01:54
new way of doing computing 01:57
>> is like Mo's law on energy drinks. I 01:59
mean, it's [laughter] 02:02
it's like Mo's law 02:04
it's it's like Yeah. Moore's law and Joe 02:07
Rogan. 02:09
>> Wow. That's interesting. 02:10
>> Yeah. That's us. 02:12
>> So, explain that. Um this this chip that 02:13
you brought to Elon, what what's the 02:16
significance of this? It's like why is 02:18
it so superior? And so 02:19
in 2012, Jeff Hinton's lab, this 02:23
gentleman I was talking talking about, 02:26
um Ilas Suscober, Alex Kresevski, um 02:29
they made a breakthrough in computer 02:34
vision in literally creating a 02:37
piece of software 02:42
called Alexnet. 02:44
And its job was to recognize images. And 02:47
it recognized images 02:50
at a c at a level computer vision which 02:52
is fundamental to intelligence. If you 02:55
can't perceive, you can't it's hard to 02:57
have intelligence. And so computer 02:59
vision is a fundamental pillar of not 03:01
the only but fundamental pillar of. And 03:03
so breaking 03:05
computer vision or breaking through in 03:07
computer vision is pretty foundational 03:10
to almost everything that everybody 03:11
wants to do in AI. And so in 2012, 03:13
their lab in Toronto 03:17
uh made this made this breakthrough 03:20
called Alexnet. And Alexet was able to 03:23
recognize images 03:26
so much better than any human created 03:29
computer vision algorithm in the 30 03:33
years prior. So all of these people, all 03:36
these scientists and we had many too 03:39
working on computer vision algorithms 03:42
and these two kids, Ilia and Alex under 03:45
the the uh 03:49
under under uh Jeff Hinton took a giant 03:51
leap above it and it was based on this 03:55
thing called Alexet this neural network. 03:58
And the way it ran, 04:01
the way they they made it work was 04:03
literally buying two Nvidia graphics 04:06
cards 04:08
because Nvidia Nvidia's GPUs we've been 04:09
working on this new way of doing 04:12
computing and our GPUs application 04:14
and it's basically a supercomputing 04:18
application to back in 1984 04:20
in order to 04:25
process computer games and what you have 04:28
in your racing simulator that is called 04:31
an image generator supercomputer. 04:34
And so Nvidia started our first 04:37
application was computer graphics and we 04:40
applied this new way of doing computing 04:43
where we do things in parallel in 04:46
instead of sequentially. A CPU does 04:47
things sequentially. Step one, step two, 04:50
step three. In our case, we break the 04:52
problem down and we give it to thousands 04:55
of processors. 04:58
And so our way of doing computation 05:00
is much more complicated. 05:05
But if you're able to formulate the 05:08
problem in the way that we 05:11
created called CUDA, this is the 05:14
invention of our company. If you could 05:16
formulate it in that way, we could 05:18
process everything simultaneously. 05:20
Now, in the case of computer graphics, 05:23
it's easier to do because every single 05:25
pixel on your screen is not related to 05:28
every other pixel. And so, I could 05:31
render multiple parts of the screen at 05:33
the same time. Not not completely true 05:36
because, you know, maybe maybe the way 05:39
lighting works or the way shadow works, 05:41
there's a lot of dependency and and 05:43
such. But computer graphics with all the 05:44
dis with all the pixels, I should be 05:48
able to process everything 05:50
simultaneously. And so we we took 05:51
this embarrassingly parallel problem 05:54
called computer graphics and we applied 05:56
it to this new way of doing computing. 05:58
Nvidia's Nvidia's accelerated computing. 06:01
We put it in all of our graphics cards. 06:05
Kids were buying it to play games. We're 06:08
you probably don't know this, but we're 06:11
the largest gaming platform in the world 06:13
today. 06:15
>> Oh, I know that. Oh, 06:15
>> okay. 06:16
>> I used to make my own computers. I used 06:16
to buy your graphics cards. 06:18
>> Oh, that's super cool. 06:19
>> Yeah. [laughter] set up SLI with two 06:20
graphics cards. 06:22
>> Yeah, I love it. Okay, that's super 06:23
cool. 06:24
>> Oh, yeah, man. I used to be a Quake 06:24
junkie. 06:26
>> Oh, that's cool. 06:26
>> Yeah. 06:27
>> Okay, so SLI, I'll tell you the story in 06:28
just a second and how it led to Elon. 06:30
I'm still answering the question. And 06:33
so, anyways, these these two kids 06:35
trained this model using the technique I 06:38
described earlier on our GPUs because 06:40
our GPUs could process things in 06:42
parallel. It's essentially a supercomput 06:44
in a PC. The reason why you used it for 06:48
Quake is because it is the first 06:51
consumer supercomputer. Okay. And so 06:54
anyways, 06:56
they made that breakthrough. We were 06:59
working on computer vision at the time. 07:00
It caught my attention 07:02
and so we went to learn about it. 07:05
Simultaneously this deep learning 07:08
phenomenon was happening all over all 07:10
over the country. Universities after 07:12
another recognized the importance of 07:14
deep learning and all of this work was 07:16
happening at Stanford, at Harvard, at 07:19
Berkeley, just all over the place. New 07:21
York University, L Yan Lakun, Andrew 07:24
Yang at Stanford, so many different 07:27
places. And I see it cropping up 07:29
everywhere. 07:32
And so my curiosity asked, you know, 07:34
what is so special about this form of 07:38
machine learning? And we've known about 07:40
machine learning for a very long time. 07:42
We've known about AI for a very long 07:43
time. We've known about neural networks 07:45
for a very long time. What makes now the 07:46
moment? And so we realized that this 07:50
architecture for deep neural networks 07:54
back propagation the way deep neuronet 07:56
networks were created. We could probably 07:59
scale this problem, scale the solution 08:02
to solve many problems. 08:05
that is essentially 08:08
a universal function approximator. Okay? 08:10
Meaning meaning you know back when 08:13
you're in in in school you have a you 08:16
have a you have a box inside of it is a 08:18
function you give it an input it gives 08:21
you an output and and the the reason why 08:23
I call it universal function 08:26
approximator 08:27
is that this computer instead of you 08:29
describing the function a function could 08:31
be a new equation fals ma that's a 08:34
function you write the function in 08:37
software you give it input f mass 08:39
acceleration, it'll tell you the force. 08:43
Okay? And 08:45
the way this computer works is really 08:48
interesting. 08:50
You give it a universal function. It's 08:52
not fals, just a universal function. 08:55
It's a big huge deep neural network 08:57
and instead of describing the inside, 09:01
you give it examples of input and output 09:05
and it figures out the inside. 09:08
So you give it input and output and it 09:11
figures out the inside. A universal 09:13
function approximator. Today it could be 09:15
Newton's equation. Tomorrow it could be 09:17
Maxwell's equation. It could be Kulum's 09:19
law. It could be thermodynamics 09:22
equation. It could be you know 09:24
Shingers's equation for quantum physics. 09:25
And so you could put any you could have 09:28
this describe almost anything so long as 09:30
you have the input and the output. So 09:33
long as you have the input and the 09:36
output or it could learn the input and 09:37
output. 09:39
>> And so we took a step back and we said, 09:40
"Hang on a second. This isn't just for 09:42
computer vision. Deep learning could 09:46
solve any problem. 09:48
All the problems that are interesting so 09:50
long as we have input and output. Now 09:52
what has input and output? 09:55
Well, the world. The world has input and 09:58
output. And so we could have a computer 10:01
that could learn almost anything. 10:03
Machine learning, artificial 10:05
intelligence. And so we reasoned that 10:07
maybe this is the fundamental 10:09
breakthrough that we needed. There were 10:11
a couple of things that had to be 10:14
solved. For example, we had to believe 10:15
that you could actually scale this up to 10:17
giant systems. It was running in a they 10:19
had two graphics cards, two GTX 580s, 10:22
[laughter] 10:26
which by the way is exactly your SLI 10:28
configuration. Yeah. Okay. So, that GTX 10:30
5880 SLI was the revolutionary computer 10:34
that put deep learning on the map. 10:38
>> Wow. 10:41
>> It was 2018 and you were using it to 10:41
play Quake. 10:44
>> Wow. That's crazy. 10:45
>> That was the moment. That was the big 10:46
bang of modern AI. We were lucky because 10:48
we were inventing this technology, this 10:52
computing approach. We were lucky that 10:54
they found it. 10:56
Turns out they were gamers and it was 10:58
lucky they found it. And it it was lucky 11:00
that we paid attention to that moment. 11:03
It was a little bit like, you know, that 11:06
Star Trek, 11:10
you know, first contact. 11:12
The Vulcans had to have seen the warp 11:16
drive at that very moment. If they 11:18
didn't witness the warp drive, you know, 11:20
they would have never come to Earth and 11:23
everything would have never happened. 11:26
It's a little bit like if I hadn't paid 11:28
attention to that moment, that flash. 11:29
And that flash didn't last long. If I 11:31
hadn't paid attention to that flash or 11:34
our company didn't pay attention to it, 11:35
who knows what would have happened, but 11:38
we saw that and we reasoned our way into 11:40
this is a this is a universal function 11:42
approximator. This is not just a 11:44
computer vision approximator. We could 11:46
use this for all kinds of things. if we 11:48
could solve two problems. The first 11:50
problem is that we have to prove to 11:51
oursel it could scale. The second 11:53
problem we had to 11:56
wait for I guess contribute to and wait 12:01
for is 12:04
the world will never have enough data 12:08
on input and output where we could 12:11
supervise 12:15
the AI to learn everything. For example, 12:16
if we have to supervise our children on 12:19
everything they learn, the amount of 12:21
information they could learn is limited. 12:24
We needed the AI, we needed the computer 12:26
to have a method of learning without 12:28
supervision. 12:31
And that's where we had to wait a few 12:33
more years, but un unsupervised 12:35
AI learning is now here. And so the AI 12:38
could learn by itself. And and the 12:41
reason why the AI could learn by itself 12:44
is because we have many examples of 12:45
right answers. Like for example, 12:48
if I want to learn uh if I want to teach 12:51
an AI how to predict the next word, I 12:54
could just grab it, grab a whole bunch 12:57
of text we already have, mask out the 12:59
last word and make it try and try and 13:01
try again until it predicts the next 13:04
one. or I mask out random words inside 13:06
inside the text and I make it try and 13:09
try and try until it predicts it. You 13:11
know, like uh Mary uh Mary goes down to 13:12
the bank. Is it a river bank or a money 13:17
bank? Well, if you're going to go down 13:21
to the bank, it's probably a river bank. 13:23
Okay. So, and it it it might not be 13:25
obvious even from that. It might need 13:27
and 13:31
uh and uh and caught a fish. Okay. Now 13:32
you know it's must be the riverbank. And 13:36
so so you give you give these AIs a 13:38
whole bunch of these examples and you 13:41
mask out the words, it'll predict the 13:42
next one. Okay? And so unsupervised 13:44
learning came along. These two ideas, 13:47
the fact that it's scalable and 13:49
unsupervised learning came along. 13:50
We were convinced that we ought to put 13:53
everything into this and help create 13:56
this industry because we're going to 13:58
solve a whole bunch of interesting 14:00
problems. And that was in 2012. By 2016, 14:01
I had I had built this computer called 14:06
the DGX1. The one that you saw me give 14:08
to Elon is called DGX Spark. The DGX1 14:11
was $300,000. 14:17
It cost Nvidia a few billion dollars to 14:20
make the first one. 14:22
And instead of two chips SLI, 14:25
we connected eight chips with a 14:30
technology called MVLink, but it's 14:32
basically SLI supercharged. 14:34
Okay. 14:38
>> Okay. 14:38
>> And so we connected eight of these chips 14:38
together instead of just two. And all of 14:40
them work together just like your Quake 14:43
rig did to solve this deep learning 14:46
problem to train this model. And so I 14:49
create we created this thing. I 14:52
announced it at GTC 14:54
and at one of our annual annual events 14:56
and I described this deep learning 15:00
thing, computer vision thing and this 15:01
computer called DJX1. 15:05
The audience was like completely silent. 15:07
They had no idea what I was talking 15:09
about. [laughter] 15:11
And I was lucky because I I had known 15:14
Elon and uh uh I helped him build the 15:17
first computer for Model 3 15:21
uh uh the Model S. And uh and when he 15:23
wanted to start working on autonomous 15:27
vehicle, I helped him build the computer 15:29
that went into the the Model S AV 15:31
system, his full full self-driving 15:34
system. We were basically the FSD 15:36
computer version one. And so 15:40
we we're already working together and um 15:44
when I announced this thing, nobody in 15:47
the world wanted it. I had no purchase 15:50
orders. Not not one. Nobody wanted to 15:52
buy it. Nobody wanted to be part of it 15:54
except for Elon. He goes, he was at the 15:57
event and we were doing a fireside chat 16:00
about the future of self-driving cars. 16:02
I think it's like 2016. Yeah, 20 maybe 16:06
at that time it was 2015. and he goes, 16:09
"You know what? 16:12
I have a company that could really use 16:14
this." 16:16
I said, "Wow, my first customer." And 16:17
so, so I was pretty excited about it. 16:20
And he goes, "Uh, yeah. Uh, we have this 16:23
company. It's a nonprofit company." 16:26
And all the blood drained out of my 16:30
face. Yeah. [laughter] 16:32
I just spent a few billion dollars 16:34
building this thing. Cost $300,000. and 16:36
you know the chances of a nonprofit 16:40
being able to pay for this thing is 16:43
approximately zero. And he goes, you 16:44
know, this is a it's an AI company and 16:46
uh it's a nonprofit and and uh we could 16:48
really use one of these supercomputers. 16:52
And so I I picked it up. I built the 16:54
first one for ourselves. We're using it 16:57
inside the company. I boxed one up. I 16:58
drove it up to San Francisco and I 17:01
delivered to Elon in 2016. A bunch of 17:02
researchers were were there. 17:05
Peter Beiel was there, Ilia was there, 17:08
and there was a bunch of people there. 17:10
And uh I walk up to the second floor 17:12
where they were all kind of in a room 17:15
this smaller than your place here. And 17:17
and uh uh that place turned out to have 17:20
been open AI 17:23
>> 2016. 17:25
>> Wow. 17:26
>> Just a bunch of people sitting in a 17:26
room. 17:29
>> It's not really uh nonprofit anymore, 17:30
though, is it? 17:32
>> They're not They're not nonprofit 17:33
anymore. Yeah. 17:34
>> Weird how that works. 17:35
>> Yeah. Yeah. But anyhow, anyhow, Elon was 17:36
there. The Yeah, it was it was really a 17:39
great great moment. 17:41
>> Oh, yeah. There you go. Yeah, that's it. 17:42
[laughter] 17:45
>> Look at you, bro. Same jacket. 17:45
>> Look at that. I haven't aged. 17:48
>> Not not a lick of black hair, though. 17:50
>> Uh the size of it is uh it's 17:53
significantly smaller. That was the 17:56
other day. SpaceX. 17:57
>> Oh, yeah. There you go. 17:59
>> Yeah. Look at the difference. 18:00
>> Exactly the same industrial design. He's 18:01
holding it in his hand 18:03
>> here. Here's the amazing thing. DJX1 was 18:06
one pedlops. Okay, that's a lot of 18:10
flops. And DJX Spark is one pedlops. 18:14
Nine years later. 18:20
>> Wow. 18:22
>> The same the same amount of computing 18:23
horsepower 18:25
>> in a much smaller 18:26
>> shrunken down. Yeah. 18:27
>> And instead of $300,000, it's now 18:28
$4,000. And it's the size of a small 18:31
book. 18:33
>> Incredible. 18:34
>> Crazy. 18:35
>> That's how technology moves. Anyways, 18:37
that's the reason why I wanted to get 18:38
give him the first one 18:40
>> because I gave him the first one 2016. 18:41
>> It's so fascinating. I mean you if you 18:43
wanted to make a story for a film I mean 18:45
that would be the story that like what 18:49
what better scenario if if if it really 18:52
does become a digital life form how 18:54
funny would it be that it is birthed out 18:57
of the desire for computer graphics for 19:00
video games [laughter] 19:03
>> exactly 19:05
>> kind of cra it's kind of crazy 19:06
>> kind of crazy when you think about it 19:08
that way 19:09
>> because 19:10
it's just 19:12
>> perfect origin 19:13
Computer graphics was one of the hardest 19:14
computer supercomputer problems 19:18
generating reality 19:21
>> and also one of the most profitable to 19:22
solve because computer games are so 19:24
popular. 19:27
>> When Nvidia started in 1993, 19:28
we were trying to create this new 19:32
computing approach. The question is 19:33
what's the killer app? 19:35
And 19:38
the the problem we wanted to the the 19:41
company wanted to create a new type of 19:43
computing pro a computing architecture a 19:45
computing a a new type of computer that 19:48
can solve problems that normal computers 19:51
can't solve. 19:54
Well, 19:56
the applications that existed in the 19:58
industry in 1993 20:01
are applications that normal computers 20:03
can solve because if the normal 20:05
computers can't solve them, why would 20:07
the application exist? 20:08
And so, we had a mission statement for a 20:11
company that has no chance of success. 20:16
[laughter] 20:19
But I didn't know that in 1993. It just 20:21
sounded like a good idea, 20:23
>> right? 20:25
And so if we created this thing that can 20:27
solve problems, you know, it's like 20:30
you actually have to go create the 20:34
problem. 20:35
And so that's what we did in 1993. There 20:37
was no quake. John Carmarmac hadn't been 20:41
reduced doom released Doom yet. You 20:43
probably remember that. 20:46
>> Sure. Yeah. 20:47
>> And and uh there were no applications 20:49
for it. And so I went to Japan because 20:51
the arcade industry had this at the time 20:55
of Sega, if you remember. 20:59
>> Sure. 21:00
>> The arcade machines, they came out with 21:01
3D arcade systems, virtual fighter, 21:03
Daytona, Virtual Cop, all of those 21:08
arcade games were in 3D for the f very 21:12
first time. And the technology they were 21:14
using was from Martin Marietta, the 21:17
flight simulators. They took the guts 21:20
out of a flight simulator and put it 21:22
into an arcade machine. The system that 21:24
you have over here, it's got to be a 21:28
million times more powerful than that 21:31
arcade machine. And that was a flight 21:33
simulator for NASA. Whoa. And so they 21:35
took the guts out of that. They were 21:39
they were using it for flight simulation 21:42
for jets and, you know, space shuttle 21:43
and and they took the guts out of that. 21:46
and Sega uh had this brilliant computer 21:49
de developer. His name was Yuzuki. 21:52
Yuzuki and Miiamoto. Sega and Nintendo. 21:56
These were the, you know, the incredible 22:01
pioneers, the visionaries, the 22:04
incredible artists, and they're both 22:06
very, very technical. 22:08
They were the origins really of of the 22:11
gaming industry. and Y Suzuki 22:14
pioneered 3D graphics gaming and um 22:17
so I went we we created this company and 22:22
there were no apps 22:25
and we were spending all of our 22:27
afternoons you know we told our family 22:29
we were going to work but it was just 22:31
the three of us you know who's going to 22:33
know and so we went to Curtis's my one 22:34
of one of the founders went to Curtis's 22:38
townhouse and uh Chris and I were 22:40
married we have kids I already had 22:42
Spencer at Madison. They were probably 2 22:44
years old. And um 22:46
and uh Chris's kids are about the same 22:50
age as ours. And we would go to work in 22:52
this townhouse. But you know, when 22:56
you're a startup and the mission 22:58
statement is the way we described, 23:00
you're not going to have too many 23:02
customers calling you. And so we had 23:03
really nothing to do. And so after 23:06
lunch, we would always have a great 23:09
lunch. After lunch, we would go to the 23:10
arcades and play the Sega V, you know, 23:13
the Sega Virtual Fighter and Daytona and 23:16
all those games and analyze how they're 23:17
doing it, trying to figure out how they 23:20
they were doing that. 23:22
And so we decided, um, let's just go to 23:24
Japan and let's 23:27
convince Sega to move those applications 23:30
into the PC. 23:33
and we would start the PC gaming the 3D 23:35
gaming industry partnering with Sega. 23:38
That's how Nvidia started. 23:42
>> Wow. 23:43
>> And so so uh in exchange for them part 23:44
developing their games for our computers 23:47
in the PC, we would build a chip for 23:52
their game console. That was the 23:56
partnership. I build a chip for your 23:58
game console. you port the Sega games to 24:01
us and um 24:03
and then they paid us a you know at the 24:07
time a quite a significant amount of 24:09
money to build that game console 24:11
and that was kind of the beginning of 24:14
Nvidia getting started and we thought we 24:18
were on our way and so so I started with 24:20
a business plan a mission statement that 24:23
was impossible we lucked into the Sega 24:25
partnership we started taking off 24:28
started building our game console. And 24:31
about a couple years into it, we 24:33
discovered our first technology 24:35
didn't work. 24:38
It was it it would have been a flaw. It 24:40
it was a flaw. And all of the technology 24:42
ideas that we had 24:45
the architecture concepts were were 24:47
sound, but the way we were doing 24:49
computer graphics was exactly backwards. 24:52
you know, instead of 24:55
I won't bore you with the technology, 24:57
but instead of inverse texture mapping, 24:58
we were doing forward texture mapping. 25:01
Instead of triangles, we did curved 25:04
surfaces. So, other people did it flat, 25:07
we did it round. Um, 25:10
other technology, the technology that 25:14
ultimately won, the technology we use 25:16
today has has Zbuffers. It automatically 25:18
sorted. 25:21
We had an architecture with no Zbuffers. 25:23
The application had to sort it. And so 25:25
we chose a bunch of technology 25:27
approaches 25:29
that 25:30
three major technology choices. All 25:32
three choices were wrong. Okay. So this 25:34
is how incredibly smart we were. And so 25:36
[laughter] 25:39
and so in 1995 19 early mid95 25:40
we realized we were going down the wrong 25:44
path. Meanwhile, 25:46
the Silicon Valley was packed with 3D 25:49
graphics startups because it was the 25:52
most exciting technology of that time. 25:54
And so 3D FX and rendition and Silicon 25:57
Graphics was coming in. Intel was 26:01
already in there and you know gosh like 26:02
what added up eventually to a hundred 26:06
different startups we had to compete 26:08
against. Everybody had chosen the right 26:10
technology approach and we chose the 26:12
wrong one. And so we were the first 26:15
company to start. We found ourselves 26:17
essentially dead last with the wrong 26:21
answer. 26:22
And so 26:24
the company was in trouble 26:26
and um 26:30
ultimately we had to make several 26:33
decisions. The first decision is 26:34
well 26:38
if we change now 26:41
we will be the last company. 26:44
And 26:49
even if we changed into the technology 26:52
that we believe to be right, we'd still 26:54
be dead. And so that argument, 26:57
you know, 27:01
do we change and therefore be dead? 27:03
Don't change and make this technology 27:05
work somehow or go do something 27:07
completely different. 27:10
That question stirred the company 27:13
strategically and was a hard question. I 27:15
eventually, you know, advocated for we 27:18
don't know what the right strategy is, 27:22
but we know what the wrong technology 27:23
is. So, let's stop doing it the wrong 27:25
way and let's give ourselves a chance to 27:27
go figure out what the strategy is. The 27:29
second thing, the second problem we had 27:31
was our company was running out of money 27:34
and I had I was in a contract with Sega 27:36
and I owed them this game console 27:39
and if that contract would have been 27:43
cancelled, we'd be dead. 27:45
We would have vaporized instantly. 27:48
And so so uh uh I went to Japan and I 27:52
explained to uh the CEO of Sega, Erie 27:56
Madri, really great man. He was the 28:01
former CEO of Honda USA. Went back to 28:04
Sega to run Sega. Went back to Japan to 28:08
run Sega. And I explained to him that I 28:10
was uh I guess I was what 30 33 years 28:15
old. 28:18
you know, when I was 33 years old, I 28:20
still had acne. And I got this this, you 28:22
know, Chinese kid. I was super skinny. 28:25
And he he was already kind of elder. 28:30
And uh I went to him and I said I said, 28:34
"Listen, 28:37
I've got some bad news for you." And and 28:38
first, the technology that we promised 28:42
you doesn't work. 28:45
And second, 28:50
we shouldn't finish your contract 28:55
because we'd waste all your money and 28:57
you would have something that doesn't 29:01
work. And I recommend you find another 29:02
partner to build your game console. 29:05
>> Whoa. 29:06
>> And so I'm terribly sorry that we've set 29:08
you back in your product roadmap. 29:10
And third, 29:15
even though you're going to I'm asking 29:19
you to let me out of the contract, 29:20
I still need the money 29:24
because if you didn't give me the money, 29:27
we'd vaporize overnight. 29:29
And so 29:34
I explained it to him humbly, honestly. 29:37
I gave him the background. 29:40
explain to him why the technology 29:43
doesn't work, why we thought it was 29:45
going to work, why it doesn't work. 29:47
And um and I asked him 29:51
to uh 29:55
convert the last $5 million that they 29:58
were to complete the contract to give us 30:02
that money as an investment 30:05
instead. 30:09
and he said, 30:11
"But it's very likely your company will 30:14
go out of business, even with my 30:16
investment." 30:18
And it was completely true. Back then, 30:21
1995, $5 million was a lot of money. 30:24
It's a lot of money today. $5 million 30:27
was a lot of money. And here's a pile of 30:29
competitors doing it right. What are the 30:31
chances that giving Nvidia $5 million 30:34
that we would develop the right strategy 30:38
that he would get a return on that $5 30:40
million or even get it back? 0%. 30:41
You do the math. It's 0%. 30:45
If I were sitting there right there, I 30:49
wouldn't have done it. 30:50
$5 million was a mountain of money to 30:53
Sega at the time. 30:54
And so 30:57
I told him that that that um 30:59
uh 31:03
if you invested that $5 million in us, 31:05
it is most likely to be lost. 31:08
But if you didn't invest that money, 31:12
we'd be out of business and we would 31:14
have no chance. 31:16
And I I told him that I 31:18
I don't even know exactly what I said in 31:24
the end, but I 31:26
told him that I would understand if he 31:30
decided not to, but it would make the 31:33
world to me if he did. He went off and 31:35
thought about it for a couple days and 31:38
came back and said, "We'll do it." 31:39
>> Wow. 31:41
strategy to how to correct what it was 31:44
doing wrong. Did you explain that to 31:47
him? 31:49
>> Wait, oh man, wait until I tell you the 31:49
rest of it's scarier. Even scarier. 31:50
>> Oh no. [laughter] 31:54
>> And so so um 31:57
so what he what he decided was was uh 32:00
Jensen was a young man he liked. That's 32:07
it. 32:09
>> Wow. to this day. 32:10
>> That's nuts. 32:13
>> I was 32:14
>> Boy, do you owe what the world owes that 32:15
guy. 32:17
>> No doubt, 32:18
>> right? 32:20
>> Well, he's he c he's he celebrated today 32:21
in Japan. 32:23
>> And if he would have kept that five 32:25
>> the the investment, I think it'd be 32:28
worth probably about a trillion dollars 32:30
today. 32:32
I know. But the moment we went public, 32:36
they sold it. They go, "Wow, that's a 32:39
miracle." So, [laughter] 32:40
>> wow. 32:42
>> They sold it. Yeah. They sold it at 32:42
Nvidia valuation about 300 million. 32:45
That's our IPO valuation. 300 million. 32:48
>> Wow. 32:51
>> And so, so anyhow, 32:53
I was incredibly grateful. Um, 32:56
and then now we had to figure out what 33:00
to do because we still were doing the 33:02
wrong strategy, wrong technology. So 33:04
unfortunately we had to lay off most of 33:07
the company. We shrunk the company all 33:09
back. All the people working on the game 33:10
console, you know, we had to shrunk it 33:13
all. Shrink it all back. 33:14
And um 33:17
and then and then somebody told me that, 33:20
but Jensen, 33:23
we've never built it this way before. 33:25
We've never built it the right way 33:27
before. 33:28
We've only know how to build it the 33:31
wrong way. 33:32
And so nobody in the company knew how to 33:34
build this 33:37
supercomputing image generator 3D 33:41
graphics thing that Silicon Graphics 33:43
did. And so so uh I said, "Okay, 33:45
how hard can it be? You got all these 30 33:50
companies, you know, 50 companies doing 33:53
it. How hard can it be?" And so luckily 33:54
there was a textbook written by the 34:00
company Silicon Graphics. 34:01
And so I went down to the store. I had 34:04
200 bucks in my pocket. And I bought 34:06
three textbooks, the only three they 34:09
had, $60 a piece. I bought the three 34:11
textbooks. I brought it back and I gave 34:14
one to each one of the architects and I 34:17
said, "Read that and let's go save the 34:18
company." 34:20
>> [laughter] 34:21
>> And so 34:23
[gasps and sighs] so they they they read 34:25
this textbook, learned from the giant at 34:27
the time, Silicon Graphics, about how to 34:31
do 3D graphics. But the thing that was 34:33
amazing and what makes Nvidia special 34:36
today is that 34:39
the people that are there are able to 34:42
start from first principles, 34:44
learn best known art, but reimplement it 34:47
in a way that's never been done before. 34:51
And so when we re-imagined 34:55
the technology of 3D graphics, we 34:58
reimagined it in a way that manifest 35:01
today the modern 3D graphics. We really 35:04
invented modern 3D graphics, but we 35:07
learned from previous known arts and we 35:10
implement it fundamentally differently. 35:13
>> What did you do that changed it? 35:16
Well, you know, the ultimately 35:18
ultimately the um uh the simple the 35:21
simple answer is that the way silicon 35:24
graphics works uh the geometry engine is 35:27
a bunch of software running on 35:31
processors. 35:32
We took that and 35:34
eliminated all the generality, 35:40
the general purposeness of it and we 35:43
reduced it down into the most essential 35:46
part of 3D graphics 35:48
and we hardcoded it into the chip. And 35:51
so instead of something general purpose, 35:55
we hardcoded it very specifically into 35:56
just the limited applications, 36:00
limited functionality necessary for 36:03
video games. 36:06
And that capability that super and and 36:08
because we reinvented a whole bunch of 36:11
stuff, it supercharged the capability of 36:13
that one little chip. And our one little 36:15
chip was generating images as fast as a 36:18
$1 million image generator. That was the 36:23
big breakthrough. We took a million 36:26
dollar thing and we put it into the 36:27
graphics card that you now put into your 36:30
gaming PC. And that was [snorts] our big 36:32
invention. 36:35
And then and of course the question is 36:36
is um 36:38
uh how do you compete against these 30 36:41
other companies doing what they were 36:43
doing? 36:44
and and there we did we did several 36:46
things. One 36:49
uh instead of building a 3D graphics 36:51
chip for every 3D graphics application, 36:56
we decided to build a 3D graphics chip 36:59
for one application. We bet the farm on 37:01
video games. 37:04
The needs of video games are very 37:06
different than needs for CAD, needs for 37:08
flight simulators. They're related, but 37:10
not the same. And so we narrowly focused 37:12
our problem statement so I could reject 37:15
all of the other complexities and we 37:17
shrunk it down into this one little 37:19
focus and then we supercharged it for 37:21
gamers. And then the second thing that 37:24
we did was we created a whole ecosystem 37:26
of working with game developers and 37:30
getting their their games ported and 37:32
adapted to our silicon so that we could 37:34
get turn essentially what is a 37:37
technology business into a platform 37:40
business into a game platform business. 37:43
So we, you know, GeForce is really today 37:45
it's also the most advanced 3D graphics 37:48
technology in the world, but a long time 37:50
ago GeForce is really the game console 37:53
inside your PC. It's, you know, it runs 37:55
Windows, it runs Excel, it runs 37:59
PowerPoint, of course, those are easy 38:00
things, but its fundamental purpose was 38:02
simply to turn your PC into a game 38:06
console. So we we were the first 38:08
technology company to build all of this 38:10
incredible technology in service of one 38:14
audience gamers. Now of course in 1993 38:16
the gaming industry didn't exist. But by 38:21
the time that John Carmarmac came along 38:24
and the doom phenomenon happened and 38:26
then quake came out as you know 38:29
that entire world oh that entire 38:34
community boom took off. Do you know 38:36
where the name Doom came from? 38:38
>> It came from this se there's a scene in 38:40
the movie The Color of Money where Tom 38:42
Cruz who's this uh elite pool player 38:45
shows up at this pool hall and this 38:47
local hustler says what he got in the 38:49
case and he opens up this case. He has a 38:51
special pool queue. He goes in here and 38:53
he opens it up. He goes, "Doom. 38:55
>> Doom." [laughter] 38:57
>> And that's where it came from. Yeah. Cuz 38:58
Carmarmac said that's what they wanted 39:00
to do to the gaming industry. 39:01
>> Doom. 39:02
>> That when Doom came out, it would just 39:03
be everybody be like, "Oh, we're 39:05
fucked." 39:06
>> Oh, wow. 39:07
>> This is Doom. 39:07
>> That's awesome. 39:08
>> Isn't that amazing? That's amazing. 39:09
>> Cuz it's the perfect name for the game. 39:10
>> Yeah. 39:12
>> And the name came out of that scene in 39:12
that movie. 39:14
>> That's right. Well, and then of course, 39:14
uh, Tim Sweeney and 39:17
>> Epic Games and, uh, and the 3D gaming 39:20
genre took off. 39:24
>> Yes. 39:24
>> And so, if you just kind of in the 39:25
beginning was no gaming industry. We had 39:28
no choice but to focus the company on 39:31
one thing. That one thing, 39:33
>> it's a really incredible origin story. 39:35
>> Oh, it's it's amazing. Like you must be 39:37
like look back 39:40
>> a disaster is what 39:41
>> a $5 [laughter] million that pivot with 39:42
that conversation with that gentleman if 39:44
he did not agree to that if he did not 39:46
like you what would the world look like 39:48
today that's crazy then then our entire 39:50
life hung on another gentleman 39:54
and so so now here we are we built so 39:58
before GeForce it was Revo 128 revo 128 40:01
saved the company it revolutionized 40:05
computer graphics 40:07
The performance cost performance ratio 40:09
of 3D graphics for gaming was off the 40:12
charts amazing. 40:14
And 40:17
we're getting ready to to ship it. Get 40:21
well, we're we're building it, but we're 40:24
so as you know, $5 million doesn't last 40:27
long. And so every single month, every 40:30
single month, uh we were drawing down 40:33
You have to build it, prototype it. You 40:39
have to design it, prototype it, 40:42
get the silicon back, 40:45
which costs a lot of money. Test it with 40:48
software 40:51
because without the software testing the 40:53
chip, you don't know the chip works. 40:55
And then you're going to find a bug 40:58
probably 41:00
because every time you test something 41:01
you find bugs, 41:03
which means you have to tape it out 41:06
again, which is more time, more money. 41:07
And so we did the math. There was no 41:11
chance anybody was going to survive it. 41:13
We didn't have that much time to tape 41:15
out a chip, send it to a foundry TSMC, 41:17
get the silicon back, test it, send it 41:20
back out again. There was no no shot, no 41:23
hope. 41:25
And so the math, the spreadsheet doesn't 41:27
allow us to do that. And so I heard 41:31
about this company and this company 41:34
built this machine. 41:37
And this machine is an emulator. 41:40
You could take your design, all of the 41:43
software that describes the chip, and 41:48
you could put it into this machine. And 41:52
this machine will pretend it's our chip. 41:54
So I don't have to send it to the fab, 41:57
wait until the fab sends it back, test. 41:59
I could have this machine pretend it's 42:01
our chip and I could put all of the 42:03
software on top of this machine called 42:06
an emulator and test all of the software 42:07
on this pretend chip and I could fix it 42:12
all before I send it to the fab. 42:15
>> Whoa. And if and and if I could do that 42:18
when I send it to the FAB, it should 42:21
work. 42:23
Nobody knows, but it should work. And so 42:24
we came to the conclusion 42:27
that let's take half of the money we had 42:30
left in the bank. At the time it was 42:33
about a million dollars. Take half of 42:35
that money and go buy this machine. 42:38
So instead of keeping the money to stay 42:42
alive, I took half of the money to go 42:44
buy this machine. Well, I call this guy 42:46
up. This the company's called IOS. 42:48
Call this company up and I say, "Hey, 42:52
listen. I heard about this machine. 42:54
I like to buy one." 42:57
And they go, "H, 42:59
that's terrific, but we're out of 43:02
business." I said, "What? You're out of 43:03
business?" He goes, "Yeah, we had no 43:06
customers." 43:08
[laughter] 43:10
I said, "Wait, hang on a sec. So, you 43:12
never made the machine?" They [snorts] 43:14
can say, "No, no, no. We made the 43:16
machine. We have one in inventory if you 43:17
want it, but we're out of business." So, 43:20
I bought one out of inventory. 43:22
Okay. After I bought it, they went out 43:26
of business. 43:28
>> Wow. 43:29
>> I bought it out of inventory. 43:30
And on this machine, we put Nvidia's 43:32
chip into it and we tested all of the 43:36
software on top. 43:39
And at this point, we were on fumes. 43:41
But we convinced ourselves that chip is 43:45
going to be great. 43:47
And so I had to call some other 43:49
gentleman. So I called TSMC. 43:50
And I told TSMC 43:54
that listen, TSMC is the world's largest 43:56
founder today. At the time they were 43:58
just a few hundred million dollars 44:01
large, 44:02
tiny little company. 44:06
And I explained to them what we were 44:12
doing. And um I explained to him I told 44:13
him I had a lot of customers. I had one, 44:18
you know, Diamond Multimedia, 44:20
probably one of the companies you bought 44:23
the graphics card from back in the old 44:24
days. And I I said, you know, we have a 44:26
lot of customers, and the demand's 44:29
really great, and 44:30
we're going to tape out a chip to you, 44:33
and I like to go directly to production 44:37
because I know it works. 44:41
>> [snorts] 44:44
>> And they said, "Nobody has ever done 44:45
that before. 44:47
Nobody has ever taped out a chip that 44:50
worked the first time. 44:52
And nobody starts out production without 44:54
looking at it." 44:56
But I knew that if I didn't start the 44:58
production, I'd be out of business 45:00
anyways. And if I could start the 45:02
production, I might have a chance. 45:05
And so 45:08
TSMC 45:10
decided to support me and uh this 45:12
gentleman is named Morris Chang. Morris 45:15
Chang is the father of the foundry 45:17
industry, the founder of TSMC. Really 45:20
great man. 45:23
He decided to support our company. I 45:27
explained to them everything. 45:30
he decided to support us frankly 45:32
probably because they didn't have that 45:34
many other customers anyhow but they 45:36
were grateful and I was immensely 45:39
grateful and as we were starting the 45:41
production 45:44
Morris flew to United States and uh 45:46
he didn't so many words asked me so but 45:50
he asked me a whole lot of questions 45:53
that was trying to tease out do I have 45:55
any money 45:58
but he didn't directly ask me that you 46:00
know and so the truth is that we didn't 46:02
have all the money but we had a strong 46:06
PO from the customer and if it didn't 46:09
work some wafers would have been lost 46:14
and I'm you know I I'm not exactly sure 46:16
what would have happened but we would 46:19
have come short it would have been it 46:20
would have been rough but they supported 46:23
us with all of that risk involved we 46:25
launched this chip turns out to 46:28
been completely revolutionary. 46:32
Knocked the ball out of the park. We 46:35
became the fastest growing technology 46:37
company in history to go from zero to $1 46:40
billion. 46:43
>> So wild that you didn't test the chip. 46:44
>> I know. We tested afterwards. Yeah, we 46:46
tested afterwards. 46:49
>> Afterwards, but [laughter] 46:50
production already. But by the way, by 46:52
the way, that methodology that we 46:55
developed to save the company is used 46:58
throughout the world today. 47:01
>> That's amazing. 47:02
>> Yeah, we changed we changed the whole 47:03
world's methodology of designing chips. 47:05
The whole world's uh rhythm of designing 47:07
chips. Uh we changed everything. 47:10
>> How well did you sleep those days? It 47:13
must have been so much stress, 47:16
[laughter] 47:18
>> you know. Um, 47:19
what is that feeling where where uh the 47:24
world just kind of feels like it's 47:27
flying? It you you have this what do you 47:29
call that feeling? You can't you can't 47:33
stop the the feeling that everything's 47:36
moving super fast and you know and 47:38
you're laying in your laying in bed and 47:41
the world just feels like you know it 47:44
you and you're you you feel deeply 47:47
anxious 47:50
uh completely out of control. Um 47:51
I've felt that probably a couple of 47:56
times [laughter] in my life. It's during 47:57
that time. 48:01
>> Wow. 48:02
>> Yeah. It it was incredible. 48:03
>> What an incredible success story. 48:05
>> But I I learned I learned a lot. I 48:06
learned I learned about I learned 48:08
several things. I learned I learned uh 48:09
how to develop strategies. 48:11
Um I learned how to 48:14
uh uh and when I when I you know our 48:16
company learned how to develop 48:19
strategies. What are winning strategies? 48:20
We learned how to create a market. We 48:22
created the modern 3D gaming market. 48:24
We learned how and and so that exact 48:28
same skill is how we created the modern 48:31
AI market. It's exactly the same. 48:34
>> Wow. 48:37
>> Yeah. Exactly the same skill. Exactly 48:37
the same blueprint. And 48:40
uh we learned how to uh deal with 48:43
crisis, how to stay calm, how to think 48:45
through things systematically. 48:49
We learned how to remove all waste in 48:52
the company and work from first 48:56
principles and doing only the things 48:58
that are essential. Everything else is 49:00
waste because we have no money for it 49:02
to live on fumes at all times. And the 49:05
feeling 49:09
no different than the feeling I had this 49:12
morning when I woke up that you're going 49:13
to be out of business soon. that you're 49:16
you know the phrase 30 days from going 49:19
out of business I've used for 33 years 49:21
because 49:24
>> you still feel that. 49:25
>> Oh yeah. Oh yeah. Every morning. Every 49:25
morning. 49:27
>> But but you guys are one of the biggest 49:28
companies on planet earth. But the the 49:30
feeling doesn't change. 49:32
>> Wow. 49:33
>> The the sense of vulnerability, the 49:34
sense of uncertainty, the sense of 49:36
insecurity. Uh 49:39
it it doesn't leave you. 49:42
>> That's crazy. We were, you know, we had 49:44
nothing. We had nothing. We were dealing 49:46
with giant. 49:49
>> Oh, yeah. Oh, yeah. Every day, every 49:50
moment. 49:52
>> Do you think that fuels you? Is that 49:52
part of the reason why the company's so 49:54
successful? That you have that hungry 49:56
mentality, 49:59
that you never rest, you're never 50:04
sitting on your laurels, you're always 50:06
on the edge. 50:08
I have a greater drive from not wanting 50:12
to fail 50:17
than the drive of wanting to succeed. 50:19
[laughter] 50:22
>> Isn't that like sex coaches would tell 50:25
you that's completely the wrong 50:27
psychology? 50:29
>> The world has just heard me say that for 50:29
out loud for the first time. 50:31
>> But but it's true. 50:33
>> Well, that's how fascinating. fear of 50:35
failure drives me more than the than the 50:36
the greed or whatever it is. 50:41
>> Well, ultimately that's probably a more 50:43
healthy approach now that I'm thinking 50:45
about it because like the fear 50:48
>> I'm not ambitious for example, 50:50
[laughter] you know, I just want to stay 50:52
alive, Joe. I want the company to 50:54
thrive, you know, I want us to make an 50:57
impact. 50:59
>> That's interesting. 50:59
>> Yeah. 51:00
>> Well, maybe that's why you're so humble. 51:01
That's what maybe that's what keeps you 51:03
grounded, you know, because with the 51:04
kind of spectacular success the 51:07
company's achieved, it would be easy to 51:08
get a big head. 51:10
>> No. 51:11
>> Right. But isn't that interesting? It's 51:12
like the if you were the guy that your 51:13
main focus is just success. You probably 51:16
would go, "Well, made it. Nailed it. I'm 51:20
the [laughter] man. 51:23
>> Drop the mic." 51:24
>> Instead, you wake up, you're like, "God, 51:25
we can't [ __ ] this up." 51:27
>> No. Exactly. Every morning. Every 51:28
morning. No. Every moment. Yeah. That's 51:30
crazy. 51:32
>> Before I go to bed. 51:33
>> Well, listen. If I was a major investor 51:34
in your company, that's what I'd want 51:36
running it. I'd want a guy who's 51:37
>> Yeah. 51:41
>> That's what I work. That's why I work 51:42
seven days a week. Every moment I'm I'm 51:43
awake. 51:46
>> You work every moment. 51:47
>> Every moment I'm awake. 51:48
>> Wow. 51:50
>> I'm thinking about solving a problem. 51:51
I'm thinking about 51:53
>> How long can you keep this up? 51:55
>> I don't know. But so [laughter] 51:57
could be next week. Sounds exhausting. 51:59
>> It is exhausting. 52:02
>> It sounds completely exhausting. 52:03
>> Always in a state of anxiety. 52:04
>> Wow. 52:07
>> Always in a state of anxiety. 52:08
>> Wow. Kudos to you for admitting that. I 52:10
think that's important for a lot of 52:12
people to hear because, you know, 52:13
there's probably some young people out 52:15
there that are in a similar position to 52:17
where you were when you were starting 52:21
out that just feel like, oh, those 52:22
people that have made it, they're just 52:25
smarter than me and they had more 52:27
opportunities than me and it's just like 52:29
it was handed to them or they're just in 52:31
the right place at the right time. And 52:33
>> Joe, I just described to you somebody 52:36
who didn't know what was going on, 52:37
[laughter] 52:39
actually did it wrong. 52:39
>> Yeah. Yeah. And the ultimate diving 52:41
catch like two or three times. 52:43
>> Crazy. 52:45
>> Yeah. 52:46
>> The ultimate diving catch is the perfect 52:47
way to put it. 52:48
>> You know, it's just like the edge of 52:50
your glove. [laughter] 52:51
>> It probably bounced off of somebody's 52:53
helmet and landed at the edge. 52:55
[laughter] 52:58
>> God, that's incredible. That's 53:00
incredible. But it's also it's really 53:02
cool that you have this perspective that 53:04
you look at it that way because you know 53:06
a lot of people that have delusions of 53:10
grandeur or they have you know 53:12
>> and their rewriting of history 53:15
often times had them somehow extraord 53:19
extraordinarily smart and they were 53:23
geniuses and they knew all along and 53:25
they were they were spot-on. And the 53:27
business plan was exactly what they 53:29
thought. And 53:30
>> yeah, 53:31
>> they destroyed the competition and you 53:31
know and they emerged victorious. 53:34
[laughter] 53:36
>> Meanwhile, you're like, I'm scared every 53:39
day. 53:40
>> Exactly. [laughter] 53:41
Exactly. 53:43
>> That's so funny. Oh my god, that's 53:44
amazing. 53:47
>> It's so true, though. 53:47
>> It's amazing. 53:48
>> It's so true. 53:49
>> It's amazing. Well, but I I think 53:50
there's nothing inconsistent 53:52
with being a leader and being 53:55
vulnerable. You know, I the company 53:56
doesn't need me to be a genius right all 54:00
along, right? 54:03
Absolutely certain about what I'm trying 54:06
to do and what I'm doing. The the 54:08
company doesn't need that. The company 54:10
wants me to succeed. You know, the thing 54:12
that and we started out today talking 54:14
about President Trump and I was about to 54:17
say something and listen, he is my 54:19
president. He is our president. We 54:23
should all and we're talking about just 54:25
because it's President Trump, we all 54:27
want him to be wrong. I think that 54:29
United States, we all have to realize he 54:31
is our president, we want him to succeed 54:34
because 54:37
>> no matter who's president attitude. 54:37
>> That's right. 54:40
>> We want him to succeed. We need to help 54:41
him succeed because it helps everybody, 54:43
all of us succeed. 54:45
And 54:48
I'm lucky that I work in a company where 54:51
I have 40,000 people who wants me to 54:54
succeed. 54:56
They want me to succeed and I can tell 54:58
and they're all every single day to help 55:00
me overcome these challenges 55:02
trying to realize 55:05
realize what I describe to be our 55:07
strategy doing their best. And if it's 55:09
somehow 55:12
wrong or not perfectly right to tell me 55:14
so that we could pivot and the more 55:17
vulnerable we are as a leader the more 55:20
able other people are able to tell you 55:23
you know that Jensen that's not exactly 55:26
right or 55:27
>> right right 55:28
>> have you considered this information or 55:29
and the more vulnerable we are 55:31
the more able we're actually able to 55:35
pivot if we put ourselves into this 55:37
superhuman capability then it's hard for 55:39
us to pivot strategy, 55:41
>> right? 55:42
>> Because we were supposed to be right all 55:43
along. 55:44
>> And so if you're always right, how can 55:45
you possibly pivot? Because pivoting 55:47
requires you to be wrong. And so I've 55:49
got no trouble with being wrong. I just 55:51
have to make sure that I stay alert, 55:54
that I reason about things from first 55:57
principles all the time. Always break 55:58
things down to first principles. 56:01
Understand why it's happening. 56:03
Reassess continuously. The reassessing 56:05
continuously is kind of partly what 56:09
causes continuous anxiety, 56:11
>> you know, because you're asking 56:14
yourself, were you wrong yesterday? Are 56:15
you still right? Is this the same? Has 56:17
that changed? Has that condition is that 56:20
worse than you thought? 56:22
>> But God, that mindset is perfect for 56:23
your business, though, because this 56:25
business is ever changing 56:27
>> all the time. I've got competition 56:29
coming from every direction. So much of 56:30
it is kind of up in the air 56:33
and you have to invent a future where 56:36
a 100 variables are included and there's 56:41
no way you could be right on all of 56:44
them. And so you have to be 56:45
>> you have to surf. 56:47
>> Wow. That's a good way to put it. You 56:49
have to surf. Yeah. You're surfing waves 56:51
of technology and innovation. 56:54
>> That's right. You can't predict the 56:55
waves. You got to deal with the ones you 56:57
have. 56:59
>> Wow. And but skill matters and I've been 56:59
doing this for 30 I'm the longest 57:04
running tech CEO in the world. 57:05
>> Is that true? Congratulations. That's 57:07
amazing. 57:08
>> And you know people ask me how is one 57:10
don't get fired. [laughter] 57:12
That'll stop a short heartbeat. 57:16
And then two don't get bored. 57:19
>> Yeah. 57:22
>> Well, how do you maintain your 57:22
enthusiasm? 57:23
Well, the honor truth is is not always 57:28
enthusiasm. It's, you know, sometimes is 57:30
enthusiasm. Sometimes it's just good 57:32
oldfashioned fear and then sometimes, 57:35
you know, a healthy dose of frustration, 57:37
you know, it's whatever keeps you 57:40
moving. 57:42
>> Yeah. Just all the emotions. I think, 57:43
you know, 57:45
>> CEOs, we have all the emotions, right? 57:46
you know, and so probably probably 57:49
jacked up to the maximum because you're 57:53
you're kind of feeling it on behalf of 57:55
the whole company. I'm feeling it on 57:57
behalf of everybody at the same time. 57:59
And it kind of, you know, encapsulates 58:02
into into somebody. And so I have to be 58:04
mindful of the past. I have to be 58:08
mindful of the present. I've got to be 58:09
mindful of the future. And um you know, 58:11
it can't it's not without emotion. 58:14
It's not just it's it's not just a job. 58:18
Let's just put it that way. 58:20
>> It doesn't seem like it at all. I would 58:23
imagine one of the more difficult 58:25
aspects of your job currently now that 58:26
the company is massively successful is 58:29
anticipating where technology is headed 58:31
and where the applications are going to 58:34
be. 58:36
>> Yeah. 58:36
>> So, how do you try to map that out? 58:37
>> Yeah. there there um there there's a 58:40
whole bunch of ways and and it takes it 58:43
takes um 58:46
takes a whole bunch of things but let me 58:50
just start 58:51
uh you have to be surrounded by amazing 58:53
people and Nvidia is now you know if you 58:55
look at look at look at um the large 58:59
tech companies in the world today 59:02
most of them have a business in 59:05
advertising or social media or you know 59:08
content distribution and at the core of 59:12
it is really fundamental computer 59:15
science and so the company's business is 59:18
not computers the company's business is 59:22
not technology technology drives the 59:25
company is the only company in the world 59:27
that's large whose only business is 59:29
technology we only build techn we don't 59:32
advertise the only way that we make 59:34
money is to create amazing technology 59:36
and sell 59:39
And so 59:40
to be that to be NVIDIA today, you're 59:43
the number one thing is you're 59:46
surrounded by the finest computer 59:48
scientists in the world. And that's my 59:49
gift. My gift is that we've created a 59:52
company's culture, 59:55
a condition by which the world's 59:57
greatest computer scientists want to be 00:00
part of it because they get to do their 00:01
life's work and create the next thing 00:04
because that's what they want to do. 00:06
because maybe they're not they don't 00:08
want to be in service of another 00:11
business. 00:12
>> They want to be in service of the 00:13
technology itself. And we're the largest 00:15
form of its kind in the history of the 00:16
world. 00:18
>> Wow. 00:19
>> I know. It's pretty amazing. 00:20
>> Wow. 00:21
>> And so so one, you know, we have a we we 00:22
have got a great condition. We have a 00:26
great culture. We have great people. And 00:27
then now now now the question is how do 00:30
you systematically 00:32
um 00:36
be able to see the future stay alert of 00:37
it 00:42
and uh reduce the reduce the the 00:44
likelihood of missing something or being 00:48
wrong. 00:51
And so there's a lot of different ways 00:53
you could do that. For example, we have 00:54
great partnerships. We we have 00:56
fundamental research. We have a great 00:57
research lab, one of the largest 00:59
industrial research labs in the world 01:00
today. And we partner with a whole bunch 01:02
of universities and other scientists. We 01:04
do a lot of open collaboration 01:07
and so I'm constantly working with 01:09
researchers outside the company. 01:12
We have the benefit of having amazing 01:15
customers and so I have the benefit of 01:17
working with Elon and you know and 01:20
others in the industry and we have the 01:22
benefit of being the only pure pure play 01:25
technology company that can serve uh 01:28
consumer internet 01:31
industrial manufacturing 01:33
um scientific computing healthcare 01:36
financial services all the industries 01:39
that we're in. They're all signals to 01:42
me. And so they all have mathematicians 01:44
and scientists and and so because I I 01:48
have the benefit now of a radar system 01:51
>> that is the most broad of any company in 01:54
the world working across every single 01:56
industry from agriculture to energy 01:59
to video games. 02:03
And so the ability for us to have this 02:05
vantage point, 02:08
one doing fundamental research ourselves 02:10
and then two working with all the great 02:13
researchers, working with all the great 02:15
industries, the feedback system is 02:17
incredible. And then finally, 02:19
you just have to have a culture of 02:22
staying super alert. There's no easy way 02:23
of being alert except for paying 02:27
attention. 02:29
I haven't found a single way of being 02:31
able to stay alert without paying 02:33
attention. And so, you know, I probably 02:34
read several thousand emails a day. 02:37
>> How How do you have a time for that? 02:42
>> I wake up early. This morning I was up 02:44
at 4:00. 02:46
>> How much do you sleep? 02:47
>> Uh, six, seven, six, seven hours. 02:49
>> Yeah. 02:53
>> And then you're up at 4 reading emails 02:54
for a few hours before you get going. 02:56
>> That's right. Yeah. 02:58
>> Wow. 02:58
Every day. 03:00
>> Every single day. Not one day missed. 03:01
[sighs] including 03:03
Thanksgiving, Christmas. 03:06
>> Do you ever take a vacation? 03:06
>> Uh, yeah. But they're um my definition 03:09
of a vacation is when I'm with my 03:13
family. And so if I'm with my family, 03:14
I'm very happy. I don't care where we 03:17
are. 03:19
>> And you don't work then or do you work a 03:19
little? 03:21
>> No. No. I work a lot. [laughter] 03:21
>> Even like if you go on a trip somewhere, 03:24
you're still working. 03:27
>> Oh, sure. Oh, sure. 03:28
>> Wow. Every day. 03:29
>> Every day. 03:30
>> But my kids work every You make me tired 03:32
just saying this. 03:34
>> My kids work every day. 03:34
Both of my kids work at Nvidia. They 03:38
work every day. 03:39
>> Wow. 03:40
>> Yeah. I'm very lucky. 03:40
>> Wow. 03:42
>> Yeah. It's brutal now because, you know, 03:43
it's just me working every day. Now we 03:45
have three people working every day and 03:47
they want to work with me every day and 03:49
so it's it's a lot of work. 03:51
>> Well, you've obviously imparted that 03:54
ethic into them. 03:57
>> They work incredibly hard. I mean, 03:58
there's no unbelievable. 03:59
>> But my parents work incredibly hard. 04:01
>> Yeah. I was I was born with the work 04:05
gene, 04:07
>> the suffering gene. [laughter] 04:08
>> Well, listen, man. It has paid off. What 04:10
a crazy story. It was just It's really 04:14
an amazing origin story. 04:16
It really I mean, it has to be kind of 04:19
surreal to be in the position that 04:21
you're in now when you look back at how 04:22
many times that it could have fallen 04:24
apart and humble beginnings. But Joe, 04:25
this is great. It's a great country. You 04:28
know, I'm an immigrant. My parents sent 04:31
my older brother and I here first. 04:34
We're we're in Thailand. 04:37
I was born in Taiwan, but my dad had a 04:40
job in Thailand. He was a chemical and 04:43
instrumentation engineer, incredible 04:46
engineer. 04:48
And his job was to go start an oil 04:50
refinery. And so we moved to Thailand, 04:52
lived in Bangkok. 04:54
And um in 19 04:56
I guess 1973 1974 time frame, 05:00
you know how Thailand every so often 05:05
they would just have a coup. You know, 05:06
the military would have an uprising and 05:08
all of a sudden one day there were tanks 05:12
and soldiers in the streets and my 05:14
parents thought, you know, it probably 05:15
isn't safe for the kids to be here. And 05:17
so they contacted my uncle. My uncle 05:19
lives in Tacoma, Washington. 05:22
and um we had never met him and my 05:25
parents sent us to him. 05:28
>> How old were you? 05:30
>> Uh I was about to turn nine and my older 05:31
brother uh almost turned 11 and so the 05:35
two of us came to United States and we 05:39
stayed in with our uncle for a little 05:42
bit while he looked for a school for us 05:45
and my parents didn't have very much 05:49
money and they never been to United 05:50
States. my father was. I'll tell you 05:53
that story in a second. 05:55
And um 05:57
and so my my uncle found a school that 06:00
would accept foreign students and 06:04
affordable enough for my parents. 06:08
And that school turned out to have been 06:11
in Onita, Kentucky, Clark County, 06:13
Kentucky, the epicenter of the opio 06:17
crisis today. 06:19
cold country. 06:21
Clark County, Kentucky is 06:24
was the poorest county in America when I 06:27
showed up. It is the poorest county in 06:31
America today. 06:33
And so we went to the school, it's a 06:36
great school, um, Onita Baptist 06:38
Institute 06:41
in a town of a few hundred. I think it 06:43
was 600 at the time that we showed up. 06:46
No traffic light. 06:49
And um I think it has 600 today. It's 06:51
quite an amazing feat actually. 06:54
The ability to hold your population for 06:58
[laughter] 07:01
when it's 600 people. It was quite a 07:02
magic quite a magical thing. however 07:04
they did it. And and so uh the school 07:06
had a mission of being an open school 07:11
for any children who would like to come. 07:16
And what that basically means is that if 07:20
you're a trouble student, if you have a 07:23
troubled family, 07:26
um if you're, 07:28
you know, whatever your background, 07:32
you're welcome to come to Onita Baptist 07:35
Institute, including kids from 07:38
international who would like to stay 07:41
there. 07:43
>> Did you speak English at the time? 07:44
>> Uh, okay. Yeah. Yeah. Okay. Yeah. And so 07:45
we showed up 07:50
and uh 07:53
my first my first thought was gosh there 07:57
are a lot of cigarette butts on the 08:01
ground. 100% of the kids smoked. 08:02
[laughter] 08:05
So right away you know this is not a 08:09
normal school. 08:10
>> Nineyear-olds? 08:11
>> No, I was the youngest kid. 08:12
>> Okay. 11 year olds. 08:14
>> My roommate was 17 years old. Wow. 08:15
>> Yeah. He just turned 17. And he was 08:19
jacked 08:22
and and um 08:23
I don't know where he is now. I know his 08:29
name, but I don't know where he is now. 08:31
But anyways, uh that night we got and 08:32
and the second thing I noticed when you 08:36
walk into the into your dorm room 08:37
is uh there are no drawers and no closet 08:41
doors. 08:44
just like a prison. 08:47
And 08:50
there are no locks 08:52
so that people could check check up on 08:55
you. 08:56
And so I go into my room and he's 17 and 08:58
uh you know get ready for for bed and he 09:03
had all this tape 09:06
all over his body and uh turned out he 09:09
was in a knife fight and he's been 09:12
stabbed all over his body and these were 09:15
just fresh wounds. 09:17
>> Whoa. And the other kids were hurt much 09:19
worse. 09:22
And uh so he was my roommate, the 09:24
toughest kid in school, and I was the 09:27
youngest kid in school. It was a it was 09:29
a junior high, 09:32
but they took me anyways because if I 09:34
walked about a mile across the Kentucky 09:38
River, the swing bridge, the other side 09:41
is a middle school that I could go to 09:45
and then I can go to that school and I 09:47
come back and then I stay in the dorm. 09:50
And so basically Onita Baptist Institute 09:53
was my dorm when I went to this other 09:55
other school. My older brother went went 09:57
to um went to the junior high. And so we 10:00
were there for a couple of years. Um 10:03
every kid had every kid had chores. 10:05
My older brother's chore was to work in 10:09
the tobacco farm, you know. So tobac 10:11
they raised tobacco so that they could 10:14
raise some extra money for the school. 10:15
Kind of like a penitentiary. 10:18
>> Wow. And my job was just to clean the 10:19
dorm. And so I I was 9 years old. I was 10:22
cleaning toilets. And for a dorm of 100 10:26
100 boys, I 10:29
I clean more bathrooms than anybody. And 10:33
I just wish that everybody was a little 10:35
bit more careful, you know. [laughter] 10:37
But anyways, I was the youngest kid in 10:42
school. The my memories of it was really 10:43
good. Um, but it was a pretty tough It 10:46
was a tough town. 10:49
>> Sounds like it. 10:50
>> Yeah. Town kids, they all carried 10:51
Everybody had knives. 10:53
>> Everybody had knives. Everybody smoked. 10:55
Everybody had a Zippo lighter. I smoked 10:58
for a week. 11:00
>> Did you? 11:01
>> Oh, yeah. Sure. 11:02
>> How old were you? 11:02
>> I was nine. Yeah. 11:03
>> When you nine? You were nine, you tried 11:04
smoking. 11:05
>> Yeah. I got myself a pack of cigarettes. 11:06
Everybody else did. 11:08
>> Did you get sick? No. I I got used to 11:09
it, you know, and I learned how to blow 11:11
blow smoke rings and, you know, [snorts] 11:14
you know, breathe out of my nose, you 11:19
know, take it in out of through my nose. 11:20
I mean, there was a all the different 11:22
things that you learned. Yeah. 11:24
>> At nine. 11:26
>> Yeah. 11:27
>> Wow. You just did it to fit in or it 11:27
looked cool. 11:29
>> Yeah. [clears throat] Because everybody 11:30
else did it, 11:30
>> right? 11:31
>> Yeah. And and then I did it for a couple 11:31
weeks, I guess. And I just rather have I 11:34
had a quarter, you know, I had a quarter 11:38
a month or something like that. 11:41
I just rather buy popsicles and fried 11:44
sickles with it. I was nine, you know, 11:46
[laughter] 11:48
>> right? 11:48
>> I chose I chose the the better path. 11:49
>> Wow. 11:52
>> That was our school. And then my parents 11:53
came to United States two years later 11:55
and um we met him in Tacoma, Washington. 11:57
>> That's wild. It It was a really crazy 12:01
experience. What a strange formative 12:04
experience. 12:07
>> Yeah. Tough kids. 12:08
>> Thailand to one of the poorest places in 12:10
America or if not the poorest 12:14
as a 9-year-old. 12:17
>> Yeah. It was my first experience with 12:20
your brother. 12:21
>> Wow. 12:22
>> Yeah. Yeah. No, I I remember and what 12:23
breaks my heart probably the only thing 12:26
that really breaks my heart of 12:28
about that experience was 12:32
so 12:35
we didn't have enough money to make you 12:37
know international phone calls every 12:40
week and so my parents gave us this tape 12:41
deck this Iowa tape deck and a tape 12:44
and so every month we would sit in front 12:51
on that tape deck and that my older 12:54
brother Jeff and I, 12:56
the two of us would just tell them what 12:59
we did the whole month. 13:01
>> Wow. 13:04
>> And we would send that tape by mail 13:06
and my parents would take that tape and 13:09
record back on top of it and send it 13:12
back to us. 13:14
>> Wow. 13:17
>> Could you imagine if for two years 13:17
>> Wow. is that tape still existed 13:20
of these two kids just describing their 13:23
first experience with United States. 13:25
Like I remember telling my parents 13:28
that that uh I joined the swim team and 13:31
uh 13:37
my roommate was really buff and so every 13:40
day we spent a lot of time in the in the 13:42
gym and so uh uh every night 100 13:44
push-ups, 100 sit-ups every day in the 13:48
gym. So, I was nine years old. I was 13:50
getting I was pretty buff 13:51
and I'm pretty fit. And uh 13:54
and so I joined the soccer team. I 13:58
joined the swim team because if you join 14:00
the team, they take you to meets and 14:03
then afterwards you get to go to a nice 14:06
restaurant. And that nice restaurant was 14:08
McDonald's. 14:10
>> Wow. 14:11
>> And and I recorded this thing. And I 14:12
said, "Mom and dad, we went to the most 14:15
amazing restaurant today. 14:17
This whole place is lit up. It's like 14:20
the future." 14:22
And [snorts] the food comes in a box 14:24
[laughter] 14:28
and the food is incredible. The 14:31
hamburger is incredible. It was 14:32
McDonald's. [snorts] But anyhow, it it 14:34
wouldn't it be amazing? 14:37
>> Oh my god. Two years recording. Yeah. 14:38
Two years. Yeah. What a crazy connection 14:40
to your parents, too. Just sending a 14:44
tape and them sending you one back and 14:46
it's the only way you're communicating 14:48
for two years. 14:50
>> Yeah. Wow. Yeah. No, I've My parents are 14:51
incredible actually. They're just 14:56
they're uh they grew up really poor and 14:58
um when they came to United States, they 15:01
had almost no money. Uh probably one of 15:03
the most 15:06
impactful memories I have is is uh we 15:09
they came and we were we were staying in 15:12
a in a in a uh apartment complex 15:14
and they had they had just rent back in 15:21
the I guess people still do rent rent a 15:23
bunch of furniture 15:26
and 15:29
we were messing around 15:31
and uh 15:36
we bumped into the coffee table and 15:38
crushed it. It's made out of particle 15:40
wood and we crushed it. 15:42
And I just still remember my the look on 15:46
my mom's face, you know, because they 15:49
didn't have any money and she didn't 15:51
know how she was going to pay it back. 15:52
And but anyhow, that's that kind of 15:54
tells you how hard it was for them to 15:56
come here. They they left everything 15:58
behind and all they had was their 16:00
suitcase and the money they had in their 16:02
in their pocket and they came to United 16:05
States. 16:07
>> How old were they pursued the American 16:08
dream? They were in their 40s. 16:09
>> Wow. 16:10
>> Yeah. Late late 30s. 16:11
>> Pursued the American dream. This is this 16:13
is the American dream. I'm the first 16:15
generation of the American dream. 16:17
>> Wow. 16:19
>> Yeah. It's hard not to love this 16:20
country. 16:21
>> That's 16:23
>> it's it's hard not to be romantic about 16:23
this country. 16:25
>> That is a romantic story. That's an 16:26
amazing story. 16:28
>> Yeah. And and my dad found his job 16:29
literally in the newspaper, 16:32
you know, the ads and he calls people. 16:34
Got a job. 16:38
>> What did he do? 16:39
>> Uh he was a consulting engineer and a 16:40
and a consulting firm and they helped 16:43
people build oil refineries, paper mills 16:45
and fabs. And that's what he did. He was 16:49
an he he's really good at factory design 16:51
instrumentation engineer. And so he's 16:55
he's brilliant at that. And so he did 16:59
that and my mom uh worked as a maid and 17:01
uh they found a way to raise us. 17:05
>> Wow. 17:08
That's an incredible story, Jensen. It 17:10
really is. Every all of it from your 17:12
childhood to the perils of Nvidia almost 17:15
falling. [laughter] 17:19
It's really incredible, man. 17:21
>> It's a great story. Yeah. I I've lived a 17:22
great life. 17:25
>> You really have. And it's a great story 17:26
for other people to hear, too. It really 17:28
is. 17:30
>> You don't You don't have to go to Ivy 17:30
League schools to succeed. 17:33
This country creates opportunities. Has 17:36
opportunities for all of us. You do have 17:38
to strive. 17:40
You have to claw your way here. 17:43
>> Yeah. 17:45
>> But if you put in the work, you can 17:46
succeed. 17:48
Nobody works with 17:49
>> a lot of luck and a lot of 17:50
>> a lot and 17:51
>> good decision- making 17:52
>> and the good graces of others. 17:53
>> Yes, that's really important. 17:55
>> Yeah. You and I spoke about two two 17:57
people who are very dear to me. Um but 17:59
the list goes on. the people the people 18:02
at NVIDIA who have have uh helped me um 18:05
uh many friends that are on the board uh 18:10
the decisions you know them giving me 18:13
the opportunity like when we were 18:15
inventing this new computing approach 18:16
I tanked our stock price because we 18:19
added this thing called CUDA to the chip 18:22
we had this big idea we added this thing 18:24
called CUDA to the chip but nobody paid 18:26
for it but our cost doubled and so we 18:28
had this graphics chip company and we 18:31
invented GPUs, we invented programmable 18:34
shaders, we invented everything modern 18:37
computer graphics, 18:39
we invented real-time tracing. That's 18:42
why it went from GTX to RTX. 18:44
We invented all this stuff, but every 18:48
time we invented something, 18:50
the market doesn't know how to 18:53
appreciate it, but the cost went way up. 18:54
And in the case of CUDA that enabled AI, 18:56
the cost increased a lot. it and but I 19:00
really we really believed it you know 19:03
and so if you believe in that future and 19:06
you don't do anything about it you're 19:09
going to regret it for your life 19:10
and so we always you know I always tell 19:13
the team do you believe what do we 19:15
believe this or not and if you believe 19:17
it and so grounded on first principle is 19:19
not random you know hearsay and we 19:21
believe it we've got to we owe it to 19:25
ourselves to go pursue it if we're the 19:26
right people to go do it if it's really 19:29
really hard to do. It's worth doing and 19:31
we believe it. Let's go pursue it. 19:33
Well, we pursued it. We we launched the 19:36
product. Nobody knew. It was exactly 19:38
what like when I launched DGX1 and the 19:40
entire audience was like 19:42
complete silence. When I launched CUDA, 19:45
the audience was complete silence. No 19:48
customer wanted it. Nobody asked for it. 19:52
Nobody understood it. Nvidia was a 19:56
public company. 19:58
>> What year was this? This is uh 19:59
uh let's see 200 20:02
2006 20:05
20 years ago 20:07
2005. 20:10
>> Wow. 20:12
>> Our stock price just went 20:14
our valuation went down to like two or 20:18
three billion dollars 20:21
>> from 20:23
>> from about 12 or something like that. 20:24
I crushed it. 20:28
>> [laughter] 20:29
>> in a very bad way. 20:30
>> Yeah. 20:32
>> What is it now though? 20:32
>> H Yeah, it's higher. [laughter] 20:34
>> Very humble of you. [gasps] 20:38
>> It's higher. But it changed the world. 20:40
>> Yeah, 20:43
>> that invention changed the world. 20:43
>> It's a It's an incredible story, 20:46
Johnson. It really is. 20:47
>> Thank you. 20:50
>> I like your story. It's incredible. Ah, 20:51
>> my story is not as incredible. My story 20:53
is more weird, 20:55
you know. 20:57
It's much more fertuitous and weird. 20:59
>> Okay. What are the three milestones that 21:01
most important milestones that led to 21:04
here? 21:06
>> That's a good question. Um, 21:10
>> what was step one? 21:12
>> I think step one was seeing other people 21:13
do it. Step one was in the initial days 21:17
of podcasting, like in 2009 when I 21:20
started, podcasting had only been around 21:23
for a couple of years. Um, the first was 21:25
Adam Curry, my good friend, who was the 21:28
podfather. He he invented podcasting. 21:31
And then, you know, um, I remember Adam 21:34
Corolla had a show because he had a 21:37
radio show. His radio show got cancelled 21:38
and so he decided to just do the same 21:41
show but do it on the internet. And that 21:42
was pretty revolutionary. Nobody was 21:44
doing that. And then there was the 21:45
experience that I had had doing 21:47
different morning radio shows like Opie 21:49
and Anthony in particular because it was 21:51
fun and we would just get together with 21:55
a bunch of comedians, you know, I'd be 21:56
on the show with like three or four 21:59
other guys that I knew and it was always 22:00
just looked forward to it. It was was 22:02
just such a good time and I said, "God, 22:04
I miss doing that. It's so fun to do 22:07
that. I wish I could do something like 22:08
that." And then I saw Tom Green setup. 22:09
Tom Green had a setup in his house and 22:12
he essentially turned his entire house 22:14
into a television studio and he did an 22:16
internet show from his living room. He 22:19
had servers in his house and cables 22:21
everywhere. Had to step over cables. I 22:22
was this is like 2007. I'm like Tom this 22:24
is nuts. Like this is 22:26
>> and I'm like you got to figure out a way 22:28
to make money from this. Like this 22:29
everybody I wish everybody in the 22:31
internet could see your setup. It's 22:32
nuts. I just want to let you guys know 22:34
that [laughter] 22:35
>> it's not just this. 22:37
>> Yeah. So that was the the beginning of 22:39
it is just seeing other people do it and 22:41
then saying all right let's just try it 22:43
and then so the beginning days we just 22:44
did it on a laptop had a laptop with a 22:47
webcam and just messed around had a 22:49
bunch of comedians come in we would just 22:51
talk and joke around and I did it like 22:53
once a week and then I started doing it 22:56
twice a week and then all a sudden I was 22:57
doing it for a year and then I was doing 23:00
it for two years then it was like oh 23:01
it's starting to get a lot of viewers a 23:03
lot of listeners you know and then I 23:05
just kept doing It's all it is. I just 23:08
kept doing it because I enjoyed doing 23:10
it. Well, was there any setback? 23:12
>> No. No, there was never really a setback 23:15
really. 23:17
>> No, 23:17
>> it must have been. Or you kind of 23:18
>> You're just You're just resilient. 23:19
>> Or you're just tough. 23:22
>> No. No. No. No. It wasn't tough or hard. 23:23
It was just interesting. So, I just it 23:26
the the 23:28
>> You were never once punched in the face. 23:29
>> No, not in the show. No, not really. Not 23:30
Not doing the show. 23:32
>> You never did something that that 23:33
big blowback. Nope. 23:37
Not really. No, it all just kept 23:40
growing. 23:42
>> It kept growing and the thing stayed the 23:43
same from the beginning to now. And the 23:46
thing is, I enjoy talking to people. 23:48
I've always enjoyed talking to 23:50
interesting people. 23:51
>> I could even tell just when we walked 23:52
in, the way you interacted with 23:53
everybody, not just me. 23:55
>> Yeah, that's cool. 23:57
>> People are cool. 23:58
>> Yeah, that's cool. You know, I I it's a 23:59
an amazing gift to be able to have so 24:02
many conversations with so many 24:06
interesting people because it changes 24:07
the way you see the world because you 24:09
see the world through so many different 24:11
people's eyes and you have so many 24:12
different people have different 24:15
perspectives and different opinions and 24:16
different philosophies and different 24:18
life stories. And you know, it's an 24:20
incredibly enriching and educating 24:24
experience having so many conversations 24:26
with so many amazing people. And that's 24:30
all I started doing. And that's all I do 24:33
now. Even now, when I booked the show, I 24:36
do it on my phone. And I basically go 24:39
through this giant list of emails of all 24:41
the people that want to be on the show 24:44
or that request to be on the show. And 24:46
then I factor in another list that I 24:48
have of people that I would like to get 24:50
on the show that I'm interested in. And 24:52
I just map it out and that's it. And I 24:53
go, "Oh, I'd like to talk to him." 24:56
>> If it wasn't because of President Trump, 24:58
I wouldn't have been bumped up on that 24:59
list. [laughter] 25:00
>> No, I wanted to talk to you already. I I 25:01
just think, you know, what you're doing 25:04
is very fascinating. I mean, how would I 25:06
not want to talk to you? And then today, 25:08
it proved to be absolutely the right 25:09
decision. 25:11
>> Well, you know, listen, it's it's 25:12
strange to be an immigrant one day. 25:14
going to Onita Baptist Institute 25:18
with with the students that were there 25:21
and then here 25:24
Nvidia's one of the most consequential 25:26
companies in the history of companies. 25:29
>> It is a crazy story. 25:32
>> It has to be that journey is is a and 25:34
it's very humbling and 25:37
>> and um I'm very grateful. 25:39
>> It's pretty amazing man. 25:41
>> Surrounded by amazing people. You're 25:42
very fortunate and you've also you seem 25:44
very happy and you seem like you're 100% 25:46
on the right path in this life. You 25:49
know, 25:51
>> you know, everybody says you must love 25:51
your job. Not every day. [laughter] 25:54
>> That's not that's part of the beauty of 25:56
everything is that there's ups and 25:59
downs. It's never just like this giant 26:00
dopamine high. 26:02
>> We leave we leave this impression here. 26:03
Here's here's an impression I don't 26:06
think is healthy. We we um people who 26:07
are successful leave the impression 26:12
often that that 26:13
our job gives us great joy. I think 26:16
largely it does 26:19
that our jobs were passionate about our 26:22
work. 26:25
Um and that passion relates to it's just 26:27
so much fun. I think it largely is, but 26:30
it it it distracts from in fact a lot of 26:35
success comes from really really hard 26:38
work. 26:42
>> Yes, 26:42
>> there's long periods of suffering and 26:44
loneliness and uncertainty and fear and 26:49
embarrassment and humiliation. all of 26:54
the feelings that we most not love that 26:57
creating something 27:02
from the ground up and and Elon will 27:04
tell you something similar very 27:07
difficult to invent invent something new 27:09
>> and people people don't believe you all 27:12
the time you're humiliated often 27:15
disbelieved most of the time and so so 27:17
people forget that part of success and 27:21
and I I don't think it's health. I think 27:24
it's it's good that we pass that forward 27:26
and let people know that that it's just 27:29
part of the journey. 27:31
>> Yes. 27:32
>> Suffering is part of the journey. 27:34
>> You will appreciate it so these horrible 27:35
feelings that you have when things are 27:37
not going so well. You will appreciate 27:39
it so much more when they do go well. 27:41
>> Deeply grateful. 27:43
>> Yeah. 27:44
>> Yeah. Deep deep pride. Incredible pride. 27:45
In incredible incredible gratefulness 27:49
and and and surely incredible memories. 27:51
Absolutely. Jensen, thank you so much 27:54
for being here. This was really fun. I 27:56
really enjoyed it and your story is just 27:58
absolutely incredible and very 28:01
inspirational and and I you know, I 28:02
think it really is the American dream. 28:06
It is the American dream. 28:07
>> It really is. Thank you so [music] much. 28:08
Thank you. All right. Bye, everybody. 28:10
[music] 28:15

– English Lyrics

🎧 Learn and chill with "" – open the app to catch every cool phrase and structure!
By
Viewed
2,692,045
Language
Learn this song

Lyrics & Translation

[English]
Joe Rogan podcast. Check it out.
>> The Joe Rogan Experience.
>> TRAIN BY DAY. JOE ROGAN PODCAST BY
NIGHT. All day.
>> Hello. Hey, Joe.
>> Good to see you again. We were just
talking about Was that the first time we
ever spoke or did was the first time we
spoke at at SpaceX?
>> SpaceX.
>> SpaceX. The first time when you were
giving Elon that crazy AI chip,
>> right? DJX Spark.
>> Yeah. Oo, that was a big moment. That
was a huge
>> That felt crazy to be there. I was like
watching these wizards of tech like
exchange information and and you're
giving him this crazy device, you know,
and then the other time was uh I was
shooting arrows in my backyard and uh
randomly get this call from Trump and
he's hanging out with you. President
Trump called and I called you.
>> Yeah. It's just
>> we were talking about you. [laughter]
>> It's just talking about he was talking
about the US UFC thing he was going to
do in his front yard.
>> Yeah. And he pulls out. He's JJS, look
at this design. He's so proud of it. And
I go, "You're going to have a fight in
the front lawn in the White House." He
goes, "Yeah, yeah, you're going to come.
This is going to be awesome." And he's
showing me his design and how beautiful
it is. And he goes, and somehow your
name comes up. He goes, "Do you know
Joe?" And I said, "Yeah, I'm going to be
on his podcast." He Let's call him.
[laughter]
>> He's like a kid.
>> I know. Let's call him. It's so He's
like a 79y old kid.
>> Oh, he's so incredible.
>> Yeah, he's an odd guy. Just very
different, you know, like the what you'd
expect from him. Very different than
what people think of him. And also just
very different as a president. A guy who
just calls you or texts you out of the
blue. Also, he makes when you te you.
You have an Android, so it won't go
through with you, but with my iPhone, he
makes the text go big.
>> Like, you know, USA is respected again.
like [laughter]
all caps and it makes the te the the the
text enlarge is kind of ridiculous.
>> Well, the the 101 Trump President Trump
is very different. He he surprised me f
first of all he's an incredibly good
listener. Almost everything I've ever
said to him, he's remembered.
>> Yeah. People don't they only want to
look at negative stories about him or
negative narratives about him. You know,
you can catch anybody on a bad day. Like
there's a lot of things he does where I
don't think he should do. Like I don't
think he should say to a reporter rep
reporter, "Quiet piggy." Like that's
pretty ridiculous. Also objectively
funny. I mean, it's unfortunate that it
happened to her. I wouldn't want that to
happen to her, but it was funny. Just
ridiculous that the president does that.
I wish he didn't do that. But other than
that, like he's he's an interesting guy.
Like he's a lot of different things
wrapped up into one person, you know?
You know, part of part of his charm,
well, part of his genius is Yes. He says
what's on his mind.
>> Yes.
>> And which is like an anti-olitician in a
lot of ways.
>> So, you know, what's on his mind is
really what's on his mind,
>> which
I I do some people some people would
rather be lied to.
>> Yeah. But but I I like the fact that
he's telling you what's on his mind. Um,
almost every time he explains something,
he says something,
he starts with his, you could tell, his
love for America, what he wants to do
for America. And everything that he
thinks through is very practical and
very common sense. And, you know, it's
very logical and um
I still remember the first time I I met
him and so this was I I'd never known
him, never met him before. and um uh
Secretary Lutnik called and we met right
before right at the beginning of the
administration. He said he told me what
was important to President Trump that
that um uh that United States
manufactures on shore and that was
really important to him because because
uh it's important to national security.
He wants to make sure that that the
important critical technology of our
nation is built in the United States and
that we re-industrialize
and get good at manufacturing again
because it's important for jobs.
>> It just seems like common sense, right?
>> Incredible common sense. And and that
was like literally the first
conversation I had with Secretary Letic
um and he was talking about how how um
that he started he started our
conversation with uh Jensen. This is
Secretary Lutnik and I I just want to
let you know that you're a national
treasure. Uh Nvidia is a national
treasure and whenever you need access to
the president um the administration uh
you call us. We're always going to be
available to you. Literally, that was
the first sentence.
>> That's pretty nice.
>> And it was completely true. every single
time I called, if I needed something, I
want to get something off my chest, um,
express some concern, uh, they're always
available. Incredible. It's just
unfortunate we live in such a
politically polarized society that you
can't recognize good common sense things
if they're coming from a person that you
object to. And that, I think, is what's
going on here. I think most people
generally a as a country, you know, as a
a giant community, which we are, it just
only makes sense that we have
manufacturing in America that especially
critical technology like you're talking
about. Like it's kind of insane that we
buy so much technology from other
countries.
>> If United States doesn't grow, we will
have no prosperity. We can't invest in
anything domestically or otherwise. we
can't fix any of our problems. If we
don't have energy growth, we can't have
industrial growth. If we don't have
industrial growth, we can't have job
growth. These it's as simple as that,
>> right?
>> And the fact that the fact that he came
into office and the first thing that he
said was drill baby drill. His point is
we need energy growth. Without energy
growth, we can have no industrial
growth. And that was it saved it saved
the AI industry. got I got to tell you
flat out if not for his progrowth energy
policy
we would not be able to build factories
for AI not be able to build chip
factories we won't sure surely won't be
able to build supercomputer factories
none of that stuff would be possible
without all of that
construction jobs would be challenged
right electrical you know electrician
jobs all of these jobs that are now
flourishing would be challenged and so I
think he's got it right we need energy
growth We want to re-industrialize the
United States. We need to be back in
manufacturing. Every successful person
doesn't need to have a PhD. Every
successful person doesn't have to have
gone to Stanford or MIT. And I think I
think that that that you know that
sensibility is is um spot on. Now, when
we're talking about technology growth
and energy growth, there's a lot of
people that go, "Oh, no. That's not what
we need. We need to, you know, simplify
our lives and get back." But the the
real issue is that we're in the middle
of a giant technology race. And whether
people are aware of it or not, whether
they like it or not, it's happening. And
it's a really important race because
whoever gets to
whatever the event horizon of artificial
intelligence is, whoever gets there
first has massive advantages in a huge
way.
Do you agree with that? Well, first the
part I I will say that we are in a
technology race and we are always in a
technology race. We've been in a
technology race with somebody forever.
>> Right.
>> Right. Since the industrial revolution,
we've been in a technology
>> since the Manhattan project.
>> Yeah.
>> Or or you know, even going back to the
discovery of energy, right? The United
Kingdom was where the industrial
revolution was, if you will, invented
when they realized that they can turn
steam and such into into energy into
electricity.
All of that was invented largely in
Europe and the United States capitalized
on it. We were the ones that learned
from it. We industrialized it. We
diffused it faster than anybody in
Europe. They were all stuck in
discussions about
policy and
jobs and disruptions. Meanwhile, the
United States was forming. We just took
the technology and ran with it. And so I
I think we were always in in a bit of a
technology race. World War II was a
technology race. Manhattan Project was a
technology race. We've been in the
technology race ever since during the
Cold War. I think we're still in a
technology race. It is probably the
single most important race. It is the
technology is uh it gives you
superpowers.
you know whether it's information
superpowers or energy superpowers or
military superpowers is all founded in
technology and so technology leadership
is really important
>> well the problem is if somebody else has
superior technology right that's that's
the issue it seems like with the AI race
people are very nervous about it like
you know Elon has famously said there
was like 80% chance it's awesome 20%
chance we're in trouble and people are
worried about that 20% % rightly so. I
mean that you know if you had 10 bullets
in a a a revolver and you know you you
took out eight of them and you still
have tw two in there and you spin it,
you're not going to feel real
comfortable when you pull that trigger.
It's terrifying,
>> right?
>> And when we're working towards this
ultimate goal um of AI,
it it just it's
impossible to imagine that it wouldn't
be of national security interest to get
there first.
We should The question is what's there?
That's the That was the part that
>> What is there?
>> Yeah. I'm not sure.
>> And I don't think anybody I don't think
anybody really knows.
>> That's crazy though. If I ask you,
>> you're the head of Nvidia. If you don't
know what's there, who knows?
>> Yeah. I I think it's probably going to
be much more gradual than we think. It
won't It won't be a moment. It won't be
It won't be as if um somebody arrived
and nobody else has. I don't think it's
going to be like that. I think it's
going to be things that just get better
and better and better and better just
like technology does.
>> So, you are rosy about the future.
You're you're very optimistic about
what's going to happen with AI.
>> Obviously, will you make the best AI
chips in the world?
>> You probably better be.
>> Uh h if history is a guide, um uh we
were always concerned about new
technology.
Humanity has always been concerned about
new technology. There are always
somebody who's thinking there always a
lot of people who are quite concerned.
were quite concerned and and and so if
if history is a guide, it is the case um
that all of this concern is channeled
into making the technology safer.
And so for example, in the last several
years, I would say AI technology has
increased probably in the last two years
alone, maybe a 100x. Let's just give it
a number, okay? It's like a car two
years ago was 100 times slower. So AI is
100 times more capable today. Now, how
did we channel that technology? How do
we channel all of that power? We
directed it to um causing the AI to be
able to think, meaning that it can take
a problem that we give it, break it down
step by step.
It does research before it answers. And
so it grounds it on truth.
It'll reflect on that answer. Ask
itself, is this the best, you know,
answer that I can give you. Am I certain
about this answer? If it's not certain
about the answer or highly confident
about the answer, it'll go back and do
more research. It might actually even
use a tool because that tool provides a
better solution than it could
hallucinate itself. As a result, we took
all of that computing capability and we
channeled it into having it produce a
safer result, safer answer, a more
truthful answer because as you know, one
of the greatest criticisms of AI in the
beginning was that it hallucinated,
>> right?
>> And so if you look at the reason why
people use AI so much today is because
the amount of hallucination has reduced.
You know, I use it almost I well I used
it the whole trip over here and so so I
think the
the uh the the capability most people
think about power
and they think about you know maybe as
an explosion power but the technology
power most of it is channeled to towards
safety. A car today is more powerful but
it's safer to drive. A lot of that power
goes towards better handling. You know,
I'd rather have a Well, you have a 1000
horsepower truck. I think 500 horsepower
is pretty good. No, I thousand's better.
I think a th00and is better.
>> I don't know if it's better, but it's
definitely faster.
>> Yeah. No, I think it's better. You can
get out of trouble faster. Um,
I enjoyed my 599 more than my 612. It
was I think it was a better better
horsepower is better. My 459 is better
than my 430.
more horsepower is better. I I think
more horsepower is better. I think it's
better handling. It's better control. In
the case of in the case of technology,
it's also very similar in that way, you
know. And so if you if you look at what
we're going to do with the next thousand
times of performance in AI, a lot of it
is going to be channeled towards more
reflection, more research,
thinking about the answer more deeply.
So when you're defining safety, you're
defining a it as accuracy,
>> functionality.
>> Functionality. Okay.
>> It it does what you expect it to do. And
then you take all the the the technology
in the horsepower, you put guard rails
on it, just like our cars. We've got a
lot of technology in in a car today. A
lot of it is goes towards, for example,
ABS. ABS is great. And so, uh, traction
control, that's fantastic. without a
without a computer in the car, how would
you do any of that,
>> right?
>> And that little computer, the computers
that you have doing your traction
control is more powerful than the
computer that went to Apollo 11. And so
you want that technology,
channel it towards safety, channel it
towards functionality. And so when
people talk about power, the advancement
of technology, often times I I I feel
what they're thinking and what we're
actually doing is very different.
>> Well, what do you think they're
thinking? Well, they're thinking somehow
that this this uh this AI is being
powerful and their their mind probably
goes towards a sci-fi movie. The
definition of power, you know, often
times the definition definition of power
is military power or physical power. But
in in the case of technology power when
we translate all of those operations
it's towards more refined thinking you
know more reflection more planning more
options
>> I think the big fears that people have
is one a big fear is military
applications that's a big fear
>> because people are very concerned that
you're going to have
>> AI systems that make decisions that
maybe an ethical person wouldn't make or
a moral person wouldn't make based on
achieving an objective versus based on,
you know, how it's going to look to
people.
>> Well, I'm I'm happy that that uh our
military is going to use AI technology
for defense and I think that that um uh
Andural uh building military technology.
I'm happy to hear that. I'm happy to see
um all these tech startups now
channeling their technology capabilities
towards defense and military
applications. I think you needed to do
that.
>> Yeah, we had Palmer Lucky on the
podcast. He was demonstrating some of
the stuff I put his helmet on. And we
show we he showed some videos how you
could see behind walls and stuff like
it's nuts.
>> And he's he's actually the perfect guy
to go start that company.
>> 100%. [laughter] Yeah. 100%. It's like
he was born for that. Yeah. He came in
here with a copper jacket on. He's a
freak. [clears throat] It's [laughter]
awesome. He's awesome. But it's also
it's a you know an unusual intellect
channeled into that very bizarre field
is what you need, you And I think it's
it's uh I think I'm happy that we're
making it so more socially acceptable.
You know, there was a time where when
somebody wanted to channel their
technology capability and their
intellect into defense technology, uh
somehow they're vilified. Um but uh we
need people like that. We need people
who enjoyed enjoy that part of uh
application of technology.
>> Well, people are terrified of war, you
know. So it depends.
>> Best way to avoid it has excessive
military might.
>> Do you think that's absolutely the best
way? Not not diplomacy, not working
stuff out.
>> All of it.
>> All of it. You have to have military
might in order to get people to sit down
with you.
>> Right. Exactly. All of it.
>> Otherwise, they just invade.
>> That's right. [laughter] Why ask for
permission?
>> Again, like you said, history. Go back
and look at history. Um, when you look
at the future of AI and and you just
said that no one really knows what's
happening, do you ever sit down and
ponder scenarios?
>> Like what do you what do you think is
like bestcase scenario for AI over the
next two decades?
Um
the best case scenario is that AI
diffuses into everything that we do and
uh our
everything's more efficient but
the threat of war remains a threat of
war.
Uh, cyber security remains
a super difficult challenge.
Somebody is going to try to
breach your security. You're going to
have thousands of millions of AI agents
protecting you from that threat.
Your technology is going to get better.
Their technology is going to get better.
Just like cyber security. Right now,
while we speak, we're being
we're seeing cyber attacks all over the
planet on just about every front door
you can imagine.
And
and yet you and I are sitting here
talking. And so the reason for that is
because we know that there's a whole
bunch of cyber security technology in
defense. And so we just have to keep
amping that up, keep stepping that up.
This episode is brought to you by
Visible. When your phone plans as good
as visible, you've got to tell your
people. It's the ultimate wireless hack
to save money and still get great
coverage and a reliable connection. Get
one line wireless with unlimited data
and hotspot for $25 a month. Taxes and
fees included, all on Verizon's 5G
network. Plus, now for a limited time,
new members can get the Visible plan for
just $19 a month for the first 26
months. Use promo code switch 26 and
save beyond the season. It's a deal so
good you're going to want to tell your
people. Switch now at visible.com/rogan.
Terms apply. Limited time offers subject
to change. See visible.com for planned
features and network management details.
That's a big issue with people is the
the worry that technology is going to
get to a point where encryption is going
to be obsolete. Encryption is just it's
no longer going to protect data. It's no
longer going to protect systems. Do you
anticipate that ever being an issue or
do you think there's it's as the defense
grows, the threat grows, the defense
grows, and it just keeps going on and on
and on and they'll always be able to
fight off any sort of intrusions?
>> Not forever. some intrusion will get in
and then that we'll all learn from it.
And you know the reason why cyber
security works is because of course the
technology of defense is advancing very
quickly. The technology offense is
advancing very quickly. However, the
benefit of the cyber security defense is
that socially the community all of our
companies work together as one. Most
people don't realize this.
There's a whole community of cyber
security experts. We exchange
ideas. We exchange best practices. We
exchange what we detect. The moment
something has been breached or maybe
there's a loophole or whatever it is, it
is shared by everybody. The patches are
shared with everybody.
>> That's interesting.
>> Yeah. Most people don't realize this.
>> No, I had no I had no idea. I've assumed
that it would just be competitive like
everything else.
>> We work together. Interesting. Has that
always been the case?
>> Uh, it surely has been the case for
about about 15 years. It might not have
been the case long ago, but this this
>> what do you think started off that
cooperation?
>> Um, people recognizing it's a challenge
and no company can stand alone.
>> And the same thing is going to happen
with AI. I think we all have to decide
work working together uh to stay out of
harm's way is is our best chance for
defense. Then it's basically everybody
against the threat.
>> And it also seems like you'd be way
better at detecting where these threats
are coming from and neutralizing them.
>> Exactly. Because the moment you detect
it somewhere,
>> you're going to find out right away.
>> It'll be really hard to hide.
>> That's right.
>> Yeah.
>> That's how it works. That's the reason
why it's safe. That's why I'm sitting
here right now instead of, you know,
locking everything down in video.
[laughter]
>> It's not only am I watching my own back,
I've got everybody watching my back. and
I'm watching everybody else's back.
>> It's a bizarre world, isn't it? When you
think about that cyber threat,
>> this idea about cyber security is
unknown to the people who are talking
about AI threats. They're I think when
they think about AI threats and AI cyber
security threats, they have to also
think about how we deal with it today.
Now, there's no question that AI is a
new technology
and it's a new type of software. In the
end, it's software just it's a new type
of software and so it's going to have
new capabilities but so will the defense
you know where you use the same AI
technology to go defend against it. So
you do you anticipate a time ever in the
future where it's going to be impossible
where there's not going to be any
secrets where the bottleneck between the
technology that we have and the
information that we have. Information is
just all a bunch of ones and zeros. It's
out there on hard drives and the
technology has more and more access to
that information. Is it ever going to
get to a point in time where there's no
way to keep a secret?
>> I don't think
>> because it seems like that's where
everything is kind of headed in a weird
way.
>> I don't think so. I think the quantum
computers were supposed to will Yeah.
quantum computers will make it possible
will make it so that the previous
quantum previous encryption technology
is obsolete. But that's the reason why
the entire industry is working on
postquantum
encryption technology.
>> What would that look like?
>> New algorithms.
>> But the crazy thing is when you hear
about the kind of computation that
quantum computing can do.
>> Yeah.
>> And the the power that it has. Yeah.
>> Where you know you're looking at
>> all the supercomputers in the world. It
would take billions of years and it
takes them a few minutes to solve these
equations. Like how do you make
encryption for something that can do
that? I'm not sure, but there's
[laughter]
but I've got a bunch of scientists who
are working on that.
>> Boy, I hope they [snorts] could figure
it out.
>> Yeah, we got a bunch of scientists who
are expert in that. And
>> is the ultimate fear that it can't be
breached that quantum computing will
always be able to to decrypt all other
quantum computing encryption?
>> I don't think that
>> it just gets to some point where it's
like, stop playing the stupid game. We
know everything.
>> I don't think so.
>> No,
>> because I I'm you know, history is
guide.
History is a guide before AI came
around. That's my worry. My worry is
this is a totally, you know, it's like
history was one thing and then nuclear
weapons kind of changed all of our
thoughts on war and mutually assured
destruction came
everybody to stop using nuclear bombs.
>> Yeah.
>> My worry is that
>> the thing is Joe is that that AI is not
going to it's not like we're cavemen and
then all of a sudden one day AI shows
up. every single day we're getting
better and smarter because we have AI
and so we're stepping on our own AI's
shoulders. So when when that whatever
that AI threat comes, it's a click
ahead. It's not a galaxy ahead,
>> you know, it's just a click ahead. And
so so I think I think the the the idea
that somehow this AI
is going to pop out of nowhere and
somehow think in a way that we can't
even imagine thinking and do something
that we can't possibly imagine I think
is far-fetched. And the reason for that
is because we're all have we all have
AIs and you know there's a whole bunch
of AIs being in development. we know
what they are and we're using it and and
so every single day we're getting we're
close to each other.
>> But don't they do things that are very
surprising?
>> Yeah. But so you you have an AI that
does something surprising. I'm going to
have an AI and my AI looks at your AI
and goes that's not that surprising.
>> The fear for the lay person like myself
is that AI becomes sentient and makes
its own decisions
and then ultimately decides to just
govern the world. do it its own way.
They're like, "You guys, you had a good
run, but
>> we're taking over now."
>> Yeah, but my my AI is gonna take care of
me. I mean, [laughter]
so that's the this is the cyber security
argument.
>> Yes.
>> Do you have an AI and it's super smart,
but my AI is super smart, too. And and
maybe your AI. Let let's pretend let's
let's pretend for a second that we
understand what consciousness is and we
understand what sentience is and and
that in fact
>> and we really are just pretending.
>> Okay, let's just pretend for a second
that we we believe that. I don't believe
actually I don't actually don't believe
that but nonetheless we let's pretend we
believe that.
>> So your your your AI is conscious and my
AI is conscious and and let's say your
AI is you know wants to I don't know do
something surprising.
My AI is so smart that it won't it might
be surprising to me, but it probably
won't be surprising to my AI. And so
maybe my AI
thinks it's surprising as well, but it's
so smart the moment it sees it the first
time, it's not going to be a surprise
the second time, just like us. And so I
feel like I think the idea that that
only one person has [clears throat] AI
and that one person's AI is compares
everybody else's AI is Neanderthal
[snorts] is um probably unlikely. I
think it's much more like cyber
security.
>> Interesting.
>> I think the fear is not that your AI is
going to battle with somebody else's AI.
The fear is that AI is no longer going
to listen to you. That's the fear is
that human beings won't have control
over it after a certain point if it
achieves sensience and then has the
ability to be autonomous
>> that there's one AI.
>> Well, they just combine.
>> Yeah. Becomes one AI
>> that it's a life form.
>> Yeah.
>> But that's the there's arguments about
that, right? That we're dealing with
some sort of synthetic biology that it's
not as simple as new technology that
you're creating a life form.
>> If it's like life form,
let's go along with that for a while. I
think if it's like life form, as you
know, all life forms don't agree. And so
I'm going to have to go with your life
form and my life form are going to agree
because my life form is going to want to
be the super life form. And and now that
now that we have disagreeing life forms,
uh we're back back again to where we
are. Well, they would probably cooperate
with each other.
It would just the reason why we don't
cooperate with each other is we're
territorial primates.
But AI wouldn't be a territorial
primate. It would realize the folly in
that sort of thinking and it would say,
"Listen, there's plenty of energy for
everybody. We we don't need to dominate.
We don't need We're not trying to
acquire resources and take over the
world. We're not looking to find a good
breeding partner. We're just existing as
a new super life form that these cute
monkeys created for us."
Okay. Well, that would be a that would
be a um a superpower with no ego,
>> right? And and if it has no ego,
why would it have the ego to do any harm
to us?
>> Well, I don't assume that it would do
harm to us, but the the fear would be
that we would no longer have control and
that we would no longer be the apex
species on the planet. this thing that
we created would now be. [laughter]
>> Is that funny?
>> No.
>> I just think it's not gonna happen.
>> I know you think it's not gonna happen,
but
>> it could, right? And here's the other
thing is like
>> if we're racing towards could Yeah.
>> And could could be the end of human
beings being in control of our own
destiny.
>> I just think it's extremely unlikely.
>> Yeah.
>> That's what they said in the Terminator
movie [laughter]
>> and it hasn't happened.
>> No, not yet. But you guys are working
towards it. Um the the thing about
you're saying about conscience and
sensience that you don't think that AI
will achieve consciousness or that the
question is what's the definition?
>> Yeah. What's the definition of
>> what is the definition to you?
>> Um uh
consciousness
um
uh f I guess first of all uh you need to
know about your own existence.
Um,
you have to have experience, not just
knowledge and intelligence.
The concept of a machine
having an experience.
I'm not well, first of all, I don't know
what defines experience, why we have
experiences, right?
>> Yeah. and why this microphone doesn't
uh and so it I think I know I well I
think I I I think I know what
consciousness is the sense of experience
the ability to know self versus
um
uh the ability to be able to reflect
know our own self the sense of ego I
think all of all of those human
experiences
uh probably is what consciousness is
but why it exists versus
the concept of knowledge and
intelligence which is what AI is defined
by today [clears throat] it has
knowledge it has intelligence artificial
intelligence we don't call it artificial
consciousness
artificial intelligence the ability to
uh perceive believe, recognize,
understand,
um, plan,
uh, perform tasks.
Those things are foundations of
intelligence
to know things, knowledge.
I don't, it's clearly different than
consciousness.
>> But consciousness is so loosely defined.
How can we say that? I mean, doesn't a
dog have consciousness? Yeah.
>> Dogs seem to be pretty conscious.
>> That's right.
>> Yeah. So, and that's a lower level
consciousness than a human being's
consciousness.
>> I'm not sure. Yeah. Right. Well,
>> the question is what lower level
intelligence? It's lower level
intelligence, but I don't know that it's
lower level consciousness.
>> That's a good point. Right.
>> Because I believe my dogs feel as much
as I feel.
>> Yeah. They feel a lot. Right.
>> Yeah. They get attached to you. That's
right. They get depressed if you're not
there.
>> That's right. Exactly.
>> There's There's definitely that.
>> Yeah. um the the concept of experience,
>> right?
>> Um but isn't AI interacting with
society? So, doesn't it acquire
experience through that interaction?
>> Um I don't think interactions is
experience. I think experience is uh
experience is a collection of feelings.
I think
>> you're aware of that AI um I forget
which one where they gave it some false
information about one of the programmers
having an affair with his wife just to
see how it would respond to it and then
when they said they were going to shut
it down it threatened to blackmail him
and reveal his affair and it was like
whoa like it's conniving like if that's
not learning from experience and being
aware that you're about to be shut down
which would imply at least some kind of
consciousness or you could kind defined
it as consciousness if you were very
loose with the term and if you imagine
that this is going to exponentially
become more powerful. Wouldn't that
ultimately lead to a different kind of
consciousness than we're defining from
biology? Well, first of all, let's just
break down what it probably did. It
probably read somewhere. There's
probably text that that in these
consequences
certain people did that. I could imagine
a novel,
>> right?
>> Having those words related.
>> Sure.
>> And so inside
>> it realizes it strategy for survival is
>> it's just a bunch of numbers
>> that it's just a bunch of numbers that
that in the in the collection of numbers
that relates to a husband cheating on a
wife. Um
has subsequently a bunch of numbers that
relates to blackmail and such things.
However, whatever the revenge was,
>> right?
>> And so it has spewed it out.
>> And so it's just like, you know, it it's
just as if I'm asking it to write me a
poem in Shakespeare. It just whatever
the words are in the world in in that
dimensionality, this dimensionality is
all these vectors and in in
multi-dimensional space. These words
that were in the prompt that described
the affair um subsequently led to one
word after another led to um you know
some revenge and something but it's not
because it had consciousness or you know
it just spewed out those words generated
those words
>> I understand what you're saying that
patterns that human beings have
exhibited both in literature and in real
life
>> that's exactly right
>> but it at a certain point in time one
would say, "Okay, well, it couldn't do
this two years ago and it couldn't do
this four years ago." Like when we're
looking towards the future, like at what
point in time when it can do everything
a person does, what point in time do we
decide that it's conscious? If it
absolutely mimics all human thinking and
behavior patterns,
>> that doesn't make it conscious.
>> It becomes in disccernible. It's it's
aware. It can communicate with you the
exact same way a person can. Like is con
is consciousness are we putting too much
weight on that concept because it seems
like it's a version of a kind of
consciousness.
>> It's a version of imitation.
>> Imitation consciousness, right? But if
it perfectly imitates it,
>> I still think it's a per it's an example
of imitation.
>> So it's like a fake Rolex when they 3D
print them and make them
>> indestruable. The question is what's the
definition consciousness?
>> Yeah.
>> Yeah.
>> That's the question. And I don't think
anybody's really clearly defined that.
That's what get where it gets weird and
that that's where the real doomsday
people are worried that you are creating
a form of consciousness that you can't
control. I believe it is possible to
create a machine
that imitates
human intelligence
and
has the ability to
understand information,
understand
instructions, break the problem down,
solve problems, and perform tasks. I
believe that completely.
I believe that that um we could have a
computer that has a vast amount of
knowledge. Some of it true, some of it
not true.
Some of it generated by humans, some of
it generated synthetically. And more and
more of knowledge in the world will be
generated synthetically going forward.
You know, until now the knowledge that
we've we have are knowledge that we
generate and we propagate and we send to
each other and we amplify it and we add
to it and we modify it. We change it. In
the future,
in a couple of years, maybe two or three
years, 90% of the world's knowledge will
likely be generated by AI.
>> That's crazy.
>> I know. But it's just fine.
>> But it's just fine.
>> I know. And the reason for that is this.
Let me tell you why.
>> Okay?
>> It's because um what difference does it
make to me that I am learning from a
textbook that was generated by a bunch
of people I didn't know or written by a
book that you know from somebody I don't
know uh to uh knowledge generated by AI
computers that are assimilating all of
this and reynthesizing things. To me, I
don't think there's a whole lot of
difference. We still have to we still
have to fact check it. We still have to
make sure that it's you know based on
fundamental first principles and we
still have to do all of that just like
we do today.
>> Is this taking into account the kind of
AI that exists currently? And do you
anticipate that just like we could have
never really believed that AI would be
at least a person like myself would
never believe AI would be as so
ubiquitous and so worth it. It's it's so
powerful today and so important today.
We never thought that 10 years ago.
Never thought that,
>> right?
>> You imagine like what are we looking at
10 years from now?
>> I I think that if you reflect back 10
years from now, you would say the same
thing that we would have never believed
that
>> but
>> in a different direction,
>> right? But if you if you go forward 9
years from now
and then ask yourself what's going to
happen 10 years from now, I think it'll
be quite gradual. Um, one of the things
that Elon said that makes me happy is he
he's he believes that we're going to get
to a point where it's not
it's not necessary for people to work
and not meaning that you're going to
have no purpose in life, but you will
have in his words universal high income
because so much revenue is generated by
AI that it will take away this need for
people to do things that they don't
really enjoy doing just for money. And I
think a lot of people have a problem
with that because their entire identity
and who how they think of themselves and
how they fit in the community is what
they do. Like this is Mike. He's an
amazing mechanic. Go to Mike and Mike
takes care of things. But there's going
to come a point in time where AI is
going to be able to do all those things
much better than than people do. And
people will just be able to receive
money. But then what does Mike do? Mike
is, you know, really loves being the
best mechanic around. You know, what
does the guy who, you know,
codes, what does he do when AI can code
infinitely faster with zero errors? Like
what what happens with all those people?
And that is where it gets weird. It's
like because we've sort of wrapped our
identity as human beings around what we
do for a living.
>> You know, when you meet someone, one of
the first things you meet somebody at a
party, hi Joe. What's your name? Mike.
What do you do? Mike and you know Mike's
like, "Oh, I'm a lawyer." "Oh, what kind
of law?" And you have a conversation,
you know, when Mike is like, "I get
money from the government. I play video
games."
>> Gets weird.
>> Mhm.
>> And I think um the concept sounds great
until you take into account human
nature. And human nature is that we like
to have puzzles to solve and things to
do and and an identity that's wrapped
around our idea that we're very good at
this thing that we do for a living.
>> Yeah. Yeah, I think um let's see, let me
start with the more mundane and I'll
work work backwards, okay? Work forward.
Uh so one of the predictions from uh
Jeff Hinton who who started the whole
deep learning phenomenon the deep
learning technology trend
and uh in incredible incredible
researcher uh professor at University of
Toronto
uh he invented discovered or invented
the the idea of of back propagation
which which uh allows the neural network
to learn.
And um
and as as as you know uh for for the
audience,
software historically was humans
applying first principles and our
thinking to uh describe an algorithm
that is then codified just like a recipe
that's codified in software. It looks
just like a recipe. how to cook
something looks exactly the same just in
a slightly different language. We call
it Python or C or C++ or whatever it is.
In the case of deep learning, this
invention of artificial intelligence,
we put a structure of a whole bunch of
neural networks and a whole bunch of
math units
and we make this large structure. It's
like a switchboard of little
u mathematical units and we connect it
all together.
Um, and we give it the input that
the software would eventually receive
and we just let it randomly guess what
the output is. And so we say, for
example, the input could be a picture of
a cat.
And and um one of the outputs of the
switchboard is where the cat signal is
supposed to show up. And all of the
other signals, the other one's a dog,
the other one's an elephant, the other
one's a tiger.
And all of the other signals are
supposed to be zero when I show it a
cat. And the one that is a cat should be
one.
And I show at a cat through this big
huge network of switchboards and math
units and they're just doing multiply
and adds multiplies and ads. Okay?
And and uh and this thing, this
switchboard is gigantic.
The more information you're going to
give it, the more the bigger this
switchboard has to be. And what Jeff
Hinton discovered was a invented was a
way for you to
guess that put the cat signal in put the
cat image in and that cat image you know
could be a million numbers because it's
you know a megapixel image for example
and it's just a whole a whole bunch of
numbers and somehow from those numbers
it has to light up the cat signal. Okay,
that's the bottom line. And if it the
first time you do it, it just comes up
with garbage. And so it says the right
answer is cat. And so you need to
increase this signal and decrease all of
the other and back propagates the
outcome through the entire network. And
then you show another. Now it's an image
of a dog and it guesses it takes a swing
at it and it comes up with a bunch of
garbage and you say no no no the answer
is this is a dog I want you to produce
dog and all of the other switch all the
other outputs have to be zero and I want
to back propagate that and just do it
over and over and over again. It's just
like uh showing a a kid this is an
apple, this is a dog, this is a cat. And
you just keep showing it to them until
they eventually get it. Okay. Well,
anyways, that big invention is deep
learning. That's the foundation of
artificial intelligence, a piece of
software
that learns from examples. That's
basically we machine learning, a machine
that learns. Uh and so so one of the the
big
first
applications was image recognition and
one of the most important image
recognition applications is radiology.
>> And so so uh uh he predicted uh about 5
years ago that in five years time the
world won't need any radiologists
because AI would have swept the whole
field.
Well, it turns out AI has swept the
whole field. That is completely true.
Today, just about every radiologist is
using AI in some way. And what's ironic
though, what's what's interesting is
that the number of radiologist has
actually grown.
And so the question is why? That's kind
of interesting, right?
>> It is. And so the prediction was in fact
that
30 million radiologists will be wiped
out.
But as it turns out, we needed more. And
the reason for that
[clears throat and cough]
is because the purpose of a radiologist
is to diagnose disease,
not to study the image. This the image
studying is simply a task to in service
of diagnosing the disease. And so now
the fact that you could study the images
more quickly and more precisely
without ever making a mistake and never
gets tired.
You could study more images. You could
study it in
3D form instead of 2D because you know
the AI doesn't care whether it studies
images in 3D or 2D. You could study it
in 4D. And so the now you could study
images in a way that radiologist
radiologists can't easily do and you
could study a lot more of it. And so the
number of tests that people are able to
do increases and because they're able to
serve more patients, the hospital does
better. They have more clients, more
patients. As a result, they have better
economics. When they have better
economics, they hire more radiologists
because their purpose is not to study
the images. their purpose is to diagnose
disease. And so the question is the what
I'm leading up to is ultimately what is
the purpose? What is the purpose of the
lawyer? And has the purpose changed?
What is the purpose? You know, one of
the examples that I gave is is um that I
would give is for example uh if my car
became self-driving
will all chauffeers be out of jobs? The
answer probably is not because for some
per for some chauffeers they for some
people who are driving you they could be
protectors some people um they're part
of the experience part of the service so
when you get there they you know they
could take care of things for you and so
for a lot of different reasons not all
chauffeers would lose their jobs some
chauffeers would lose their jobs and uh
many chauffeers would change their jobs
and the type of applications of
autonomous vehicles will probably
increase you know the usage of the
technology within find new homes and so
I I think you have to go back to what is
the purpose of a job you know like for
example if AI comes along I actually
don't believe I'm going to lose my job
because my purpose isn't to I have to
look at a lot of documents I study a lot
of emails I look at a bunch of diagrams
you know um the question is what is the
job and and uh the purpose of somebody
probably hasn't changed a lawyer for
example help people that probably hasn't
changed studying legal documents
generating documents it's part of the
job not the job
>> but don't you think there's many jobs
that AI will replace
>> if your job is automation
>> yeah if your job is the task
>> right so automation
>> yeah factor if your job is the task
>> that's a lot of people
>> it could be a lot of people but it'll
probably generate like for example
>> uh let's say we let's say I'm super
excited about the the the robots Elon's
working on.
It's still a few years away.
When it happens, when it happens,
um
there's a whole new industry of
technicians and people who have to
manufacture the robots, right?
>> Mhm.
>> And so that that job never existed. And
so you're going to have a whole industry
of people taking care of like for
example, you know, all the mechanics and
all the people who are building things
for cars, supercharging cars, uh that
didn't exist before cars and now we're
going to have robots. You're going to
have robot apparel. So a whole industry
of [laughter] Right. Isn't that right?
Because I want my robot to look
different than your robot.
>> Oh god.
>> And so [laughter] you're going to you're
going to have a whole, you know, apparel
industry for robots. You're going to
have mechanics for robots and you have
you know people who comes and maintain
your robots
>> automated though.
>> No,
>> you don't think so? You don't think
[clears throat] they'll be all done by
other robots
>> eventually? And then there'll be
something else.
>> So you think ultimately people just
adapt except if you are the task
>> which is a large percentage of the
workforce.
>> If your job is just to chop vegetables,
quezin art is going to replace you.
>> Yeah. So people have to find meaning in
other things. Your job has to be more
than the task.
>> What do you think about Elon's belief
that this universal basic income thing
will eventually become necessary?
>> Many people think that. Andrew Yang
thinks that
>> he was one of the first people to sort
of sound that alarm during the the 2020
election.
Yeah, I I guess um
yeah, both ideas probably won't exist at
the same time and and um as in life,
things will probably be in the middle.
One idea, of course, is that there'll be
so much abundance of resource that
nobody needs a job and we'll all be
wealthy.
On the other hand, um we're going to
need universal basic income. Both ideas
don't exist at the same time,
>> right?
>> And so we're either going to be all
wealthy or we're going to be all
>> How could everybody be wealthy though?
But
>> because scenario wealthy not because you
have a lot of dollars, wealthy because
there's a lot of abundance. Like for
example, today we are wealthy of
information.
You know, this is some a concept several
thousand years ago only a few people
have. And so, uh, today we have wealth
of a whole bunch of things, resources
that that historic point. Yeah. And so,
we're going to have wealth of resources,
things that we think are valuable today
that in the future are just not not that
valuable, you know, and so it because
it's automated. And so I think I think
the question
maybe maybe partly it's hard to answer
partly because
it's hard to talk about infinity and
it's hard to talk about a long time from
now and and the reason for that is
because
there's just too many scenarios to to
consider. But I think it I think in the
next several years, call it 5 to 10
years,
there are several things that I I
believe in hope. Um, and I say hope
because I'm not sure. One of the things
that I believe is that the technology
divide will be substantially collapsed.
And of course the alternative
viewpoint is that AI is going to
increase the technology divide.
Now the reason why I believe AI is going
to reduce the technology divide.
I is because we have proof
the evidence is that AI is the easiest
application in the world to use. Chat
GPT has grown to almost a billion users
frankly practically overnight. And if
you're not exactly sure how to use,
everybody knows how to use chatpt. Just
say something to it. If you're not sure
how to use chatpt, you ask chatd how to
use it. No tool in history has ever had
this capability. A quez an art, you
know, if you don't know how to use it,
you're kind of screwed. You're going to
walk up to it and say, "How do you use a
quezin art?" You're going to have to
find somebody else. And so, but an AI
will just tell you exactly how to do it.
Anybody could do this. It'll speak to
you in any language. And if it doesn't
know your language, you'll speak it in
that language and it'll probably figure
out that it doesn't completely
understand your language. Go learns it
instantly and comes back and talk to
you. And so I think the the technology
divide has a real chance finally that
you don't have to speak Python or C++ or
forran. You can just speak human and
whatever form of human you like. And so
I think that that has a real chance of
closing the technology divine. Now, of
course, the counternarrative would say
that
AI is only going to be available for the
nations and the countries that have a
vast amount of resources because AI
takes energy
and AI takes um a lot of GPUs and
factories to be able to produce the AI.
No doubt at the scale that we would like
to do in the United States. But the fact
of the matter is your phone's going to
run AI just fine all by itself, you
know, in a few years. Today, it already
does it fairly decently. And so the the
the fact that every every country, every
nation, every every society will have
the benefit of very good AI. It might
not be tomorrow's AI. It might be
yesterday's AI, but yesterday's AI is
freaking amazing. You know, in 10 years
time, 9year-old AI is going to be
amazing. You don't need, you know, 10
year old AI. You don't need frontier AI
like we need frontier AI because we want
to be the world leader. But for every
single country, everybody, I think the
ele the capability to elevate
everybody's knowledge and capability and
intelligence, uh, that day is coming.
The octagon isn't just in Las Vegas
anymore. It's right in your hands with
DraftKings Sportsbook, the official
sports betting partner of UFC. Get ready
because when Dwabish Willie and Yan face
off again at UFC 323, every punch, every
takedown, every finish, it all has the
potential to pay off in real time. New
customers bet just $5. And if your bet
wins, you get paid $200 in bonus bets.
And hey, Missouri, the wait is over.
DraftKings Sportsbook is now live in the
Show Me State. Download the DraftKings
Sportsbook app and use promo code Rogan.
That's code Rogan to turn five bucks
into 200 in bonus bets if your bet wins.
In partnership with DraftKings, the
crown is yours. Gambling problem? Call
1800 gambler. In New York, call 8778
wire or text hope 467-369. In
Connecticut, help is available for a
problem gambling. Call 888789-7777
or visit ccpg.org. Please play
responsibly. On behalf of Bootill Casino
and Resort in Kansas, pass through of
per wager tax may apply in Illinois. 21
and over. Age and eligibility varies by
jurisdiction void in Ontario.
Restrictions apply. Bet must win to
receive bonus bets which expire in 7
days. Minimum odds required. For
additional terms and responsible gaming
resources, see dkg.co/audio.
Limited time offer.
>> And also energy production, which is the
real bottleneck when it comes to third
world countries and
>> that's right,
>> electricity and all all the resources
that we take for granted.
>> Almost everything is going to be energy
constrained. And so if you take a look
at um
one of the most important technology
advances in history is this idea called
Moore's law. Moore's law
was the started basically in my
generation
and my generation is the generation of
computers. I graduated in 1984 and that
was basically at the very beginning of
the PC revolution.
And the microprocessor and and um
every single year it approximately
doubled
and we describe it as every single year
we double the performance. But what it
really means is that every single year
the cost of computing halfed.
And so the cost of computing in the
course of five years reduced by a factor
of 10. The amount of energy necessary to
do computing to do any task reduced by a
factor of 10. Every single 10 years 100
a th00and 10,000
100,000 so on and so forth. And so each
one of
the clicks of Moore's law, the amount of
energy necessary to do any computing
reduced. That's the reason why you have
a laptop today when back in 1984 sat on
the desk, you got to plug in, it wasn't
that fast and it consumed a lot of
power. Today, you know, it is only a few
watts. And so Moore's law is the
fundamental technology, the fundamental
technology trend that made it possible.
Well, what's going on in AI? The reason
why Nvidia is here is because in we
invented this new way of doing
computing. We call it accelerated
computing. We started it 33 years ago.
Took us about 30 years to really made a
huge breakthrough. In that in that 30
years or so
we took computing you know probably a
factor of well let me just say in last
10 years the last 10 years we improved
the performance of computing by 100,000
times.
Whoa. Imagine a car over the course of
10 years that became a 100,000 times
faster or at the same speed 100,000
times cheaper or at the same speed
100,000 times less energy. If your car
did that, it doesn't need energy at all.
What I mean what what I'm trying to say
is that in 10 years time the amount of
energy necessary for artificial
intelligence for most people will be
minuscule
utterly minuscule and so we'll have AI
running in all kinds of things and all
the time because it doesn't consume that
much energy and so if you're a nation
that uses AI for you know almost
everything in your social fabric of
course you're going to need these AI
factories but for a lot of countries I
think you're going You're going to have
excellent AI and you're not going to
need as much energy. Everybody will be
able to come along is my point.
>> So currently that that is a big
bottleneck, right? Is energy.
>> Yeah, it is the bottleneck.
>> The bottleneck is this. So was it Google
that is making nuclear power plants to
operate one of its AI factories?
>> Oh, I haven't heard that. But I think in
the next six, seven years, I think
you're going to see a whole bunch of
small nuclear reactors.
>> And by small, like how big are you
talking about? Hundreds of megawws.
Yeah.
>> Okay. And that these will be local to
whatever specific company they have.
>> That's right. Will all be power
generators.
>> Whoa.
>> You know, just like just like your you
know, somebody's farm.
>> It probably is the smartest way to do
it, right?
>> And it takes the burden off Yeah. takes
the burden off the grid. It takes and
you could build as much as you need
>> and you can contribute back to the grid.
It's a really important point that I
think you just made about Moore's law
and the relationship to pricing because
you know a laptop today like you can get
one of those little Mac MacBook Airs.
They're incredible. They're so thin,
unbelievably powerful. Battery life is
charge it.
>> Yeah. Battery [laughter] life's crazy.
And uh it's not that expensive
relatively speaking. Like something like
that.
>> I remember.
>> And that's just Moore's law, right?
>> Then there's the Nvidia law.
>> Oh,
>> just right. the the the law I was
talking to you about, the computing that
we invented,
>> right?
>> The reason why we're here, this new this
new way of doing computing
>> is like Mo's law on energy drinks. I
mean, it's [laughter]
it's like Mo's law
it's it's like Yeah. Moore's law and Joe
Rogan.
>> Wow. That's interesting.
>> Yeah. That's us.
>> So, explain that. Um this this chip that
you brought to Elon, what what's the
significance of this? It's like why is
it so superior? And so
in 2012, Jeff Hinton's lab, this
gentleman I was talking talking about,
um Ilas Suscober, Alex Kresevski, um
they made a breakthrough in computer
vision in literally creating a
piece of software
called Alexnet.
And its job was to recognize images. And
it recognized images
at a c at a level computer vision which
is fundamental to intelligence. If you
can't perceive, you can't it's hard to
have intelligence. And so computer
vision is a fundamental pillar of not
the only but fundamental pillar of. And
so breaking
computer vision or breaking through in
computer vision is pretty foundational
to almost everything that everybody
wants to do in AI. And so in 2012,
their lab in Toronto
uh made this made this breakthrough
called Alexnet. And Alexet was able to
recognize images
so much better than any human created
computer vision algorithm in the 30
years prior. So all of these people, all
these scientists and we had many too
working on computer vision algorithms
and these two kids, Ilia and Alex under
the the uh
under under uh Jeff Hinton took a giant
leap above it and it was based on this
thing called Alexet this neural network.
And the way it ran,
the way they they made it work was
literally buying two Nvidia graphics
cards
because Nvidia Nvidia's GPUs we've been
working on this new way of doing
computing and our GPUs application
and it's basically a supercomputing
application to back in 1984
in order to
process computer games and what you have
in your racing simulator that is called
an image generator supercomputer.
And so Nvidia started our first
application was computer graphics and we
applied this new way of doing computing
where we do things in parallel in
instead of sequentially. A CPU does
things sequentially. Step one, step two,
step three. In our case, we break the
problem down and we give it to thousands
of processors.
And so our way of doing computation
is much more complicated.
But if you're able to formulate the
problem in the way that we
created called CUDA, this is the
invention of our company. If you could
formulate it in that way, we could
process everything simultaneously.
Now, in the case of computer graphics,
it's easier to do because every single
pixel on your screen is not related to
every other pixel. And so, I could
render multiple parts of the screen at
the same time. Not not completely true
because, you know, maybe maybe the way
lighting works or the way shadow works,
there's a lot of dependency and and
such. But computer graphics with all the
dis with all the pixels, I should be
able to process everything
simultaneously. And so we we took
this embarrassingly parallel problem
called computer graphics and we applied
it to this new way of doing computing.
Nvidia's Nvidia's accelerated computing.
We put it in all of our graphics cards.
Kids were buying it to play games. We're
you probably don't know this, but we're
the largest gaming platform in the world
today.
>> Oh, I know that. Oh,
>> okay.
>> I used to make my own computers. I used
to buy your graphics cards.
>> Oh, that's super cool.
>> Yeah. [laughter] set up SLI with two
graphics cards.
>> Yeah, I love it. Okay, that's super
cool.
>> Oh, yeah, man. I used to be a Quake
junkie.
>> Oh, that's cool.
>> Yeah.
>> Okay, so SLI, I'll tell you the story in
just a second and how it led to Elon.
I'm still answering the question. And
so, anyways, these these two kids
trained this model using the technique I
described earlier on our GPUs because
our GPUs could process things in
parallel. It's essentially a supercomput
in a PC. The reason why you used it for
Quake is because it is the first
consumer supercomputer. Okay. And so
anyways,
they made that breakthrough. We were
working on computer vision at the time.
It caught my attention
and so we went to learn about it.
Simultaneously this deep learning
phenomenon was happening all over all
over the country. Universities after
another recognized the importance of
deep learning and all of this work was
happening at Stanford, at Harvard, at
Berkeley, just all over the place. New
York University, L Yan Lakun, Andrew
Yang at Stanford, so many different
places. And I see it cropping up
everywhere.
And so my curiosity asked, you know,
what is so special about this form of
machine learning? And we've known about
machine learning for a very long time.
We've known about AI for a very long
time. We've known about neural networks
for a very long time. What makes now the
moment? And so we realized that this
architecture for deep neural networks
back propagation the way deep neuronet
networks were created. We could probably
scale this problem, scale the solution
to solve many problems.
that is essentially
a universal function approximator. Okay?
Meaning meaning you know back when
you're in in in school you have a you
have a you have a box inside of it is a
function you give it an input it gives
you an output and and the the reason why
I call it universal function
approximator
is that this computer instead of you
describing the function a function could
be a new equation fals ma that's a
function you write the function in
software you give it input f mass
acceleration, it'll tell you the force.
Okay? And
the way this computer works is really
interesting.
You give it a universal function. It's
not fals, just a universal function.
It's a big huge deep neural network
and instead of describing the inside,
you give it examples of input and output
and it figures out the inside.
So you give it input and output and it
figures out the inside. A universal
function approximator. Today it could be
Newton's equation. Tomorrow it could be
Maxwell's equation. It could be Kulum's
law. It could be thermodynamics
equation. It could be you know
Shingers's equation for quantum physics.
And so you could put any you could have
this describe almost anything so long as
you have the input and the output. So
long as you have the input and the
output or it could learn the input and
output.
>> And so we took a step back and we said,
"Hang on a second. This isn't just for
computer vision. Deep learning could
solve any problem.
All the problems that are interesting so
long as we have input and output. Now
what has input and output?
Well, the world. The world has input and
output. And so we could have a computer
that could learn almost anything.
Machine learning, artificial
intelligence. And so we reasoned that
maybe this is the fundamental
breakthrough that we needed. There were
a couple of things that had to be
solved. For example, we had to believe
that you could actually scale this up to
giant systems. It was running in a they
had two graphics cards, two GTX 580s,
[laughter]
which by the way is exactly your SLI
configuration. Yeah. Okay. So, that GTX
5880 SLI was the revolutionary computer
that put deep learning on the map.
>> Wow.
>> It was 2018 and you were using it to
play Quake.
>> Wow. That's crazy.
>> That was the moment. That was the big
bang of modern AI. We were lucky because
we were inventing this technology, this
computing approach. We were lucky that
they found it.
Turns out they were gamers and it was
lucky they found it. And it it was lucky
that we paid attention to that moment.
It was a little bit like, you know, that
Star Trek,
you know, first contact.
The Vulcans had to have seen the warp
drive at that very moment. If they
didn't witness the warp drive, you know,
they would have never come to Earth and
everything would have never happened.
It's a little bit like if I hadn't paid
attention to that moment, that flash.
And that flash didn't last long. If I
hadn't paid attention to that flash or
our company didn't pay attention to it,
who knows what would have happened, but
we saw that and we reasoned our way into
this is a this is a universal function
approximator. This is not just a
computer vision approximator. We could
use this for all kinds of things. if we
could solve two problems. The first
problem is that we have to prove to
oursel it could scale. The second
problem we had to
wait for I guess contribute to and wait
for is
the world will never have enough data
on input and output where we could
supervise
the AI to learn everything. For example,
if we have to supervise our children on
everything they learn, the amount of
information they could learn is limited.
We needed the AI, we needed the computer
to have a method of learning without
supervision.
And that's where we had to wait a few
more years, but un unsupervised
AI learning is now here. And so the AI
could learn by itself. And and the
reason why the AI could learn by itself
is because we have many examples of
right answers. Like for example,
if I want to learn uh if I want to teach
an AI how to predict the next word, I
could just grab it, grab a whole bunch
of text we already have, mask out the
last word and make it try and try and
try again until it predicts the next
one. or I mask out random words inside
inside the text and I make it try and
try and try until it predicts it. You
know, like uh Mary uh Mary goes down to
the bank. Is it a river bank or a money
bank? Well, if you're going to go down
to the bank, it's probably a river bank.
Okay. So, and it it it might not be
obvious even from that. It might need
and
uh and uh and caught a fish. Okay. Now
you know it's must be the riverbank. And
so so you give you give these AIs a
whole bunch of these examples and you
mask out the words, it'll predict the
next one. Okay? And so unsupervised
learning came along. These two ideas,
the fact that it's scalable and
unsupervised learning came along.
We were convinced that we ought to put
everything into this and help create
this industry because we're going to
solve a whole bunch of interesting
problems. And that was in 2012. By 2016,
I had I had built this computer called
the DGX1. The one that you saw me give
to Elon is called DGX Spark. The DGX1
was $300,000.
It cost Nvidia a few billion dollars to
make the first one.
And instead of two chips SLI,
we connected eight chips with a
technology called MVLink, but it's
basically SLI supercharged.
Okay.
>> Okay.
>> And so we connected eight of these chips
together instead of just two. And all of
them work together just like your Quake
rig did to solve this deep learning
problem to train this model. And so I
create we created this thing. I
announced it at GTC
and at one of our annual annual events
and I described this deep learning
thing, computer vision thing and this
computer called DJX1.
The audience was like completely silent.
They had no idea what I was talking
about. [laughter]
And I was lucky because I I had known
Elon and uh uh I helped him build the
first computer for Model 3
uh uh the Model S. And uh and when he
wanted to start working on autonomous
vehicle, I helped him build the computer
that went into the the Model S AV
system, his full full self-driving
system. We were basically the FSD
computer version one. And so
we we're already working together and um
when I announced this thing, nobody in
the world wanted it. I had no purchase
orders. Not not one. Nobody wanted to
buy it. Nobody wanted to be part of it
except for Elon. He goes, he was at the
event and we were doing a fireside chat
about the future of self-driving cars.
I think it's like 2016. Yeah, 20 maybe
at that time it was 2015. and he goes,
"You know what?
I have a company that could really use
this."
I said, "Wow, my first customer." And
so, so I was pretty excited about it.
And he goes, "Uh, yeah. Uh, we have this
company. It's a nonprofit company."
And all the blood drained out of my
face. Yeah. [laughter]
I just spent a few billion dollars
building this thing. Cost $300,000. and
you know the chances of a nonprofit
being able to pay for this thing is
approximately zero. And he goes, you
know, this is a it's an AI company and
uh it's a nonprofit and and uh we could
really use one of these supercomputers.
And so I I picked it up. I built the
first one for ourselves. We're using it
inside the company. I boxed one up. I
drove it up to San Francisco and I
delivered to Elon in 2016. A bunch of
researchers were were there.
Peter Beiel was there, Ilia was there,
and there was a bunch of people there.
And uh I walk up to the second floor
where they were all kind of in a room
this smaller than your place here. And
and uh uh that place turned out to have
been open AI
>> 2016.
>> Wow.
>> Just a bunch of people sitting in a
room.
>> It's not really uh nonprofit anymore,
though, is it?
>> They're not They're not nonprofit
anymore. Yeah.
>> Weird how that works.
>> Yeah. Yeah. But anyhow, anyhow, Elon was
there. The Yeah, it was it was really a
great great moment.
>> Oh, yeah. There you go. Yeah, that's it.
[laughter]
>> Look at you, bro. Same jacket.
>> Look at that. I haven't aged.
>> Not not a lick of black hair, though.
>> Uh the size of it is uh it's
significantly smaller. That was the
other day. SpaceX.
>> Oh, yeah. There you go.
>> Yeah. Look at the difference.
>> Exactly the same industrial design. He's
holding it in his hand
>> here. Here's the amazing thing. DJX1 was
one pedlops. Okay, that's a lot of
flops. And DJX Spark is one pedlops.
Nine years later.
>> Wow.
>> The same the same amount of computing
horsepower
>> in a much smaller
>> shrunken down. Yeah.
>> And instead of $300,000, it's now
$4,000. And it's the size of a small
book.
>> Incredible.
>> Crazy.
>> That's how technology moves. Anyways,
that's the reason why I wanted to get
give him the first one
>> because I gave him the first one 2016.
>> It's so fascinating. I mean you if you
wanted to make a story for a film I mean
that would be the story that like what
what better scenario if if if it really
does become a digital life form how
funny would it be that it is birthed out
of the desire for computer graphics for
video games [laughter]
>> exactly
>> kind of cra it's kind of crazy
>> kind of crazy when you think about it
that way
>> because
it's just
>> perfect origin
Computer graphics was one of the hardest
computer supercomputer problems
generating reality
>> and also one of the most profitable to
solve because computer games are so
popular.
>> When Nvidia started in 1993,
we were trying to create this new
computing approach. The question is
what's the killer app?
And
the the problem we wanted to the the
company wanted to create a new type of
computing pro a computing architecture a
computing a a new type of computer that
can solve problems that normal computers
can't solve.
Well,
the applications that existed in the
industry in 1993
are applications that normal computers
can solve because if the normal
computers can't solve them, why would
the application exist?
And so, we had a mission statement for a
company that has no chance of success.
[laughter]
But I didn't know that in 1993. It just
sounded like a good idea,
>> right?
And so if we created this thing that can
solve problems, you know, it's like
you actually have to go create the
problem.
And so that's what we did in 1993. There
was no quake. John Carmarmac hadn't been
reduced doom released Doom yet. You
probably remember that.
>> Sure. Yeah.
>> And and uh there were no applications
for it. And so I went to Japan because
the arcade industry had this at the time
of Sega, if you remember.
>> Sure.
>> The arcade machines, they came out with
3D arcade systems, virtual fighter,
Daytona, Virtual Cop, all of those
arcade games were in 3D for the f very
first time. And the technology they were
using was from Martin Marietta, the
flight simulators. They took the guts
out of a flight simulator and put it
into an arcade machine. The system that
you have over here, it's got to be a
million times more powerful than that
arcade machine. And that was a flight
simulator for NASA. Whoa. And so they
took the guts out of that. They were
they were using it for flight simulation
for jets and, you know, space shuttle
and and they took the guts out of that.
and Sega uh had this brilliant computer
de developer. His name was Yuzuki.
Yuzuki and Miiamoto. Sega and Nintendo.
These were the, you know, the incredible
pioneers, the visionaries, the
incredible artists, and they're both
very, very technical.
They were the origins really of of the
gaming industry. and Y Suzuki
pioneered 3D graphics gaming and um
so I went we we created this company and
there were no apps
and we were spending all of our
afternoons you know we told our family
we were going to work but it was just
the three of us you know who's going to
know and so we went to Curtis's my one
of one of the founders went to Curtis's
townhouse and uh Chris and I were
married we have kids I already had
Spencer at Madison. They were probably 2
years old. And um
and uh Chris's kids are about the same
age as ours. And we would go to work in
this townhouse. But you know, when
you're a startup and the mission
statement is the way we described,
you're not going to have too many
customers calling you. And so we had
really nothing to do. And so after
lunch, we would always have a great
lunch. After lunch, we would go to the
arcades and play the Sega V, you know,
the Sega Virtual Fighter and Daytona and
all those games and analyze how they're
doing it, trying to figure out how they
they were doing that.
And so we decided, um, let's just go to
Japan and let's
convince Sega to move those applications
into the PC.
and we would start the PC gaming the 3D
gaming industry partnering with Sega.
That's how Nvidia started.
>> Wow.
>> And so so uh in exchange for them part
developing their games for our computers
in the PC, we would build a chip for
their game console. That was the
partnership. I build a chip for your
game console. you port the Sega games to
us and um
and then they paid us a you know at the
time a quite a significant amount of
money to build that game console
and that was kind of the beginning of
Nvidia getting started and we thought we
were on our way and so so I started with
a business plan a mission statement that
was impossible we lucked into the Sega
partnership we started taking off
started building our game console. And
about a couple years into it, we
discovered our first technology
didn't work.
It was it it would have been a flaw. It
it was a flaw. And all of the technology
ideas that we had
the architecture concepts were were
sound, but the way we were doing
computer graphics was exactly backwards.
you know, instead of
I won't bore you with the technology,
but instead of inverse texture mapping,
we were doing forward texture mapping.
Instead of triangles, we did curved
surfaces. So, other people did it flat,
we did it round. Um,
other technology, the technology that
ultimately won, the technology we use
today has has Zbuffers. It automatically
sorted.
We had an architecture with no Zbuffers.
The application had to sort it. And so
we chose a bunch of technology
approaches
that
three major technology choices. All
three choices were wrong. Okay. So this
is how incredibly smart we were. And so
[laughter]
and so in 1995 19 early mid95
we realized we were going down the wrong
path. Meanwhile,
the Silicon Valley was packed with 3D
graphics startups because it was the
most exciting technology of that time.
And so 3D FX and rendition and Silicon
Graphics was coming in. Intel was
already in there and you know gosh like
what added up eventually to a hundred
different startups we had to compete
against. Everybody had chosen the right
technology approach and we chose the
wrong one. And so we were the first
company to start. We found ourselves
essentially dead last with the wrong
answer.
And so
the company was in trouble
and um
ultimately we had to make several
decisions. The first decision is
well
if we change now
we will be the last company.
And
even if we changed into the technology
that we believe to be right, we'd still
be dead. And so that argument,
you know,
do we change and therefore be dead?
Don't change and make this technology
work somehow or go do something
completely different.
That question stirred the company
strategically and was a hard question. I
eventually, you know, advocated for we
don't know what the right strategy is,
but we know what the wrong technology
is. So, let's stop doing it the wrong
way and let's give ourselves a chance to
go figure out what the strategy is. The
second thing, the second problem we had
was our company was running out of money
and I had I was in a contract with Sega
and I owed them this game console
and if that contract would have been
cancelled, we'd be dead.
We would have vaporized instantly.
And so so uh uh I went to Japan and I
explained to uh the CEO of Sega, Erie
Madri, really great man. He was the
former CEO of Honda USA. Went back to
Sega to run Sega. Went back to Japan to
run Sega. And I explained to him that I
was uh I guess I was what 30 33 years
old.
you know, when I was 33 years old, I
still had acne. And I got this this, you
know, Chinese kid. I was super skinny.
And he he was already kind of elder.
And uh I went to him and I said I said,
"Listen,
I've got some bad news for you." And and
first, the technology that we promised
you doesn't work.
And second,
we shouldn't finish your contract
because we'd waste all your money and
you would have something that doesn't
work. And I recommend you find another
partner to build your game console.
>> Whoa.
>> And so I'm terribly sorry that we've set
you back in your product roadmap.
And third,
even though you're going to I'm asking
you to let me out of the contract,
I still need the money
because if you didn't give me the money,
we'd vaporize overnight.
And so
I explained it to him humbly, honestly.
I gave him the background.
explain to him why the technology
doesn't work, why we thought it was
going to work, why it doesn't work.
And um and I asked him
to uh
convert the last $5 million that they
were to complete the contract to give us
that money as an investment
instead.
and he said,
"But it's very likely your company will
go out of business, even with my
investment."
And it was completely true. Back then,
1995, $5 million was a lot of money.
It's a lot of money today. $5 million
was a lot of money. And here's a pile of
competitors doing it right. What are the
chances that giving Nvidia $5 million
that we would develop the right strategy
that he would get a return on that $5
million or even get it back? 0%.
You do the math. It's 0%.
If I were sitting there right there, I
wouldn't have done it.
$5 million was a mountain of money to
Sega at the time.
And so
I told him that that that um
uh
if you invested that $5 million in us,
it is most likely to be lost.
But if you didn't invest that money,
we'd be out of business and we would
have no chance.
And I I told him that I
I don't even know exactly what I said in
the end, but I
told him that I would understand if he
decided not to, but it would make the
world to me if he did. He went off and
thought about it for a couple days and
came back and said, "We'll do it."
>> Wow.
strategy to how to correct what it was
doing wrong. Did you explain that to
him?
>> Wait, oh man, wait until I tell you the
rest of it's scarier. Even scarier.
>> Oh no. [laughter]
>> And so so um
so what he what he decided was was uh
Jensen was a young man he liked. That's
it.
>> Wow. to this day.
>> That's nuts.
>> I was
>> Boy, do you owe what the world owes that
guy.
>> No doubt,
>> right?
>> Well, he's he c he's he celebrated today
in Japan.
>> And if he would have kept that five
>> the the investment, I think it'd be
worth probably about a trillion dollars
today.
I know. But the moment we went public,
they sold it. They go, "Wow, that's a
miracle." So, [laughter]
>> wow.
>> They sold it. Yeah. They sold it at
Nvidia valuation about 300 million.
That's our IPO valuation. 300 million.
>> Wow.
>> And so, so anyhow,
I was incredibly grateful. Um,
and then now we had to figure out what
to do because we still were doing the
wrong strategy, wrong technology. So
unfortunately we had to lay off most of
the company. We shrunk the company all
back. All the people working on the game
console, you know, we had to shrunk it
all. Shrink it all back.
And um
and then and then somebody told me that,
but Jensen,
we've never built it this way before.
We've never built it the right way
before.
We've only know how to build it the
wrong way.
And so nobody in the company knew how to
build this
supercomputing image generator 3D
graphics thing that Silicon Graphics
did. And so so uh I said, "Okay,
how hard can it be? You got all these 30
companies, you know, 50 companies doing
it. How hard can it be?" And so luckily
there was a textbook written by the
company Silicon Graphics.
And so I went down to the store. I had
200 bucks in my pocket. And I bought
three textbooks, the only three they
had, $60 a piece. I bought the three
textbooks. I brought it back and I gave
one to each one of the architects and I
said, "Read that and let's go save the
company."
>> [laughter]
>> And so
[gasps and sighs] so they they they read
this textbook, learned from the giant at
the time, Silicon Graphics, about how to
do 3D graphics. But the thing that was
amazing and what makes Nvidia special
today is that
the people that are there are able to
start from first principles,
learn best known art, but reimplement it
in a way that's never been done before.
And so when we re-imagined
the technology of 3D graphics, we
reimagined it in a way that manifest
today the modern 3D graphics. We really
invented modern 3D graphics, but we
learned from previous known arts and we
implement it fundamentally differently.
>> What did you do that changed it?
Well, you know, the ultimately
ultimately the um uh the simple the
simple answer is that the way silicon
graphics works uh the geometry engine is
a bunch of software running on
processors.
We took that and
eliminated all the generality,
the general purposeness of it and we
reduced it down into the most essential
part of 3D graphics
and we hardcoded it into the chip. And
so instead of something general purpose,
we hardcoded it very specifically into
just the limited applications,
limited functionality necessary for
video games.
And that capability that super and and
because we reinvented a whole bunch of
stuff, it supercharged the capability of
that one little chip. And our one little
chip was generating images as fast as a
$1 million image generator. That was the
big breakthrough. We took a million
dollar thing and we put it into the
graphics card that you now put into your
gaming PC. And that was [snorts] our big
invention.
And then and of course the question is
is um
uh how do you compete against these 30
other companies doing what they were
doing?
and and there we did we did several
things. One
uh instead of building a 3D graphics
chip for every 3D graphics application,
we decided to build a 3D graphics chip
for one application. We bet the farm on
video games.
The needs of video games are very
different than needs for CAD, needs for
flight simulators. They're related, but
not the same. And so we narrowly focused
our problem statement so I could reject
all of the other complexities and we
shrunk it down into this one little
focus and then we supercharged it for
gamers. And then the second thing that
we did was we created a whole ecosystem
of working with game developers and
getting their their games ported and
adapted to our silicon so that we could
get turn essentially what is a
technology business into a platform
business into a game platform business.
So we, you know, GeForce is really today
it's also the most advanced 3D graphics
technology in the world, but a long time
ago GeForce is really the game console
inside your PC. It's, you know, it runs
Windows, it runs Excel, it runs
PowerPoint, of course, those are easy
things, but its fundamental purpose was
simply to turn your PC into a game
console. So we we were the first
technology company to build all of this
incredible technology in service of one
audience gamers. Now of course in 1993
the gaming industry didn't exist. But by
the time that John Carmarmac came along
and the doom phenomenon happened and
then quake came out as you know
that entire world oh that entire
community boom took off. Do you know
where the name Doom came from?
>> It came from this se there's a scene in
the movie The Color of Money where Tom
Cruz who's this uh elite pool player
shows up at this pool hall and this
local hustler says what he got in the
case and he opens up this case. He has a
special pool queue. He goes in here and
he opens it up. He goes, "Doom.
>> Doom." [laughter]
>> And that's where it came from. Yeah. Cuz
Carmarmac said that's what they wanted
to do to the gaming industry.
>> Doom.
>> That when Doom came out, it would just
be everybody be like, "Oh, we're
fucked."
>> Oh, wow.
>> This is Doom.
>> That's awesome.
>> Isn't that amazing? That's amazing.
>> Cuz it's the perfect name for the game.
>> Yeah.
>> And the name came out of that scene in
that movie.
>> That's right. Well, and then of course,
uh, Tim Sweeney and
>> Epic Games and, uh, and the 3D gaming
genre took off.
>> Yes.
>> And so, if you just kind of in the
beginning was no gaming industry. We had
no choice but to focus the company on
one thing. That one thing,
>> it's a really incredible origin story.
>> Oh, it's it's amazing. Like you must be
like look back
>> a disaster is what
>> a $5 [laughter] million that pivot with
that conversation with that gentleman if
he did not agree to that if he did not
like you what would the world look like
today that's crazy then then our entire
life hung on another gentleman
and so so now here we are we built so
before GeForce it was Revo 128 revo 128
saved the company it revolutionized
computer graphics
The performance cost performance ratio
of 3D graphics for gaming was off the
charts amazing.
And
we're getting ready to to ship it. Get
well, we're we're building it, but we're
so as you know, $5 million doesn't last
long. And so every single month, every
single month, uh we were drawing down
You have to build it, prototype it. You
have to design it, prototype it,
get the silicon back,
which costs a lot of money. Test it with
software
because without the software testing the
chip, you don't know the chip works.
And then you're going to find a bug
probably
because every time you test something
you find bugs,
which means you have to tape it out
again, which is more time, more money.
And so we did the math. There was no
chance anybody was going to survive it.
We didn't have that much time to tape
out a chip, send it to a foundry TSMC,
get the silicon back, test it, send it
back out again. There was no no shot, no
hope.
And so the math, the spreadsheet doesn't
allow us to do that. And so I heard
about this company and this company
built this machine.
And this machine is an emulator.
You could take your design, all of the
software that describes the chip, and
you could put it into this machine. And
this machine will pretend it's our chip.
So I don't have to send it to the fab,
wait until the fab sends it back, test.
I could have this machine pretend it's
our chip and I could put all of the
software on top of this machine called
an emulator and test all of the software
on this pretend chip and I could fix it
all before I send it to the fab.
>> Whoa. And if and and if I could do that
when I send it to the FAB, it should
work.
Nobody knows, but it should work. And so
we came to the conclusion
that let's take half of the money we had
left in the bank. At the time it was
about a million dollars. Take half of
that money and go buy this machine.
So instead of keeping the money to stay
alive, I took half of the money to go
buy this machine. Well, I call this guy
up. This the company's called IOS.
Call this company up and I say, "Hey,
listen. I heard about this machine.
I like to buy one."
And they go, "H,
that's terrific, but we're out of
business." I said, "What? You're out of
business?" He goes, "Yeah, we had no
customers."
[laughter]
I said, "Wait, hang on a sec. So, you
never made the machine?" They [snorts]
can say, "No, no, no. We made the
machine. We have one in inventory if you
want it, but we're out of business." So,
I bought one out of inventory.
Okay. After I bought it, they went out
of business.
>> Wow.
>> I bought it out of inventory.
And on this machine, we put Nvidia's
chip into it and we tested all of the
software on top.
And at this point, we were on fumes.
But we convinced ourselves that chip is
going to be great.
And so I had to call some other
gentleman. So I called TSMC.
And I told TSMC
that listen, TSMC is the world's largest
founder today. At the time they were
just a few hundred million dollars
large,
tiny little company.
And I explained to them what we were
doing. And um I explained to him I told
him I had a lot of customers. I had one,
you know, Diamond Multimedia,
probably one of the companies you bought
the graphics card from back in the old
days. And I I said, you know, we have a
lot of customers, and the demand's
really great, and
we're going to tape out a chip to you,
and I like to go directly to production
because I know it works.
>> [snorts]
>> And they said, "Nobody has ever done
that before.
Nobody has ever taped out a chip that
worked the first time.
And nobody starts out production without
looking at it."
But I knew that if I didn't start the
production, I'd be out of business
anyways. And if I could start the
production, I might have a chance.
And so
TSMC
decided to support me and uh this
gentleman is named Morris Chang. Morris
Chang is the father of the foundry
industry, the founder of TSMC. Really
great man.
He decided to support our company. I
explained to them everything.
he decided to support us frankly
probably because they didn't have that
many other customers anyhow but they
were grateful and I was immensely
grateful and as we were starting the
production
Morris flew to United States and uh
he didn't so many words asked me so but
he asked me a whole lot of questions
that was trying to tease out do I have
any money
but he didn't directly ask me that you
know and so the truth is that we didn't
have all the money but we had a strong
PO from the customer and if it didn't
work some wafers would have been lost
and I'm you know I I'm not exactly sure
what would have happened but we would
have come short it would have been it
would have been rough but they supported
us with all of that risk involved we
launched this chip turns out to
been completely revolutionary.
Knocked the ball out of the park. We
became the fastest growing technology
company in history to go from zero to $1
billion.
>> So wild that you didn't test the chip.
>> I know. We tested afterwards. Yeah, we
tested afterwards.
>> Afterwards, but [laughter]
production already. But by the way, by
the way, that methodology that we
developed to save the company is used
throughout the world today.
>> That's amazing.
>> Yeah, we changed we changed the whole
world's methodology of designing chips.
The whole world's uh rhythm of designing
chips. Uh we changed everything.
>> How well did you sleep those days? It
must have been so much stress,
[laughter]
>> you know. Um,
what is that feeling where where uh the
world just kind of feels like it's
flying? It you you have this what do you
call that feeling? You can't you can't
stop the the feeling that everything's
moving super fast and you know and
you're laying in your laying in bed and
the world just feels like you know it
you and you're you you feel deeply
anxious
uh completely out of control. Um
I've felt that probably a couple of
times [laughter] in my life. It's during
that time.
>> Wow.
>> Yeah. It it was incredible.
>> What an incredible success story.
>> But I I learned I learned a lot. I
learned I learned about I learned
several things. I learned I learned uh
how to develop strategies.
Um I learned how to
uh uh and when I when I you know our
company learned how to develop
strategies. What are winning strategies?
We learned how to create a market. We
created the modern 3D gaming market.
We learned how and and so that exact
same skill is how we created the modern
AI market. It's exactly the same.
>> Wow.
>> Yeah. Exactly the same skill. Exactly
the same blueprint. And
uh we learned how to uh deal with
crisis, how to stay calm, how to think
through things systematically.
We learned how to remove all waste in
the company and work from first
principles and doing only the things
that are essential. Everything else is
waste because we have no money for it
to live on fumes at all times. And the
feeling
no different than the feeling I had this
morning when I woke up that you're going
to be out of business soon. that you're
you know the phrase 30 days from going
out of business I've used for 33 years
because
>> you still feel that.
>> Oh yeah. Oh yeah. Every morning. Every
morning.
>> But but you guys are one of the biggest
companies on planet earth. But the the
feeling doesn't change.
>> Wow.
>> The the sense of vulnerability, the
sense of uncertainty, the sense of
insecurity. Uh
it it doesn't leave you.
>> That's crazy. We were, you know, we had
nothing. We had nothing. We were dealing
with giant.
>> Oh, yeah. Oh, yeah. Every day, every
moment.
>> Do you think that fuels you? Is that
part of the reason why the company's so
successful? That you have that hungry
mentality,
that you never rest, you're never
sitting on your laurels, you're always
on the edge.
I have a greater drive from not wanting
to fail
than the drive of wanting to succeed.
[laughter]
>> Isn't that like sex coaches would tell
you that's completely the wrong
psychology?
>> The world has just heard me say that for
out loud for the first time.
>> But but it's true.
>> Well, that's how fascinating. fear of
failure drives me more than the than the
the greed or whatever it is.
>> Well, ultimately that's probably a more
healthy approach now that I'm thinking
about it because like the fear
>> I'm not ambitious for example,
[laughter] you know, I just want to stay
alive, Joe. I want the company to
thrive, you know, I want us to make an
impact.
>> That's interesting.
>> Yeah.
>> Well, maybe that's why you're so humble.
That's what maybe that's what keeps you
grounded, you know, because with the
kind of spectacular success the
company's achieved, it would be easy to
get a big head.
>> No.
>> Right. But isn't that interesting? It's
like the if you were the guy that your
main focus is just success. You probably
would go, "Well, made it. Nailed it. I'm
the [laughter] man.
>> Drop the mic."
>> Instead, you wake up, you're like, "God,
we can't [ __ ] this up."
>> No. Exactly. Every morning. Every
morning. No. Every moment. Yeah. That's
crazy.
>> Before I go to bed.
>> Well, listen. If I was a major investor
in your company, that's what I'd want
running it. I'd want a guy who's
>> Yeah.
>> That's what I work. That's why I work
seven days a week. Every moment I'm I'm
awake.
>> You work every moment.
>> Every moment I'm awake.
>> Wow.
>> I'm thinking about solving a problem.
I'm thinking about
>> How long can you keep this up?
>> I don't know. But so [laughter]
could be next week. Sounds exhausting.
>> It is exhausting.
>> It sounds completely exhausting.
>> Always in a state of anxiety.
>> Wow.
>> Always in a state of anxiety.
>> Wow. Kudos to you for admitting that. I
think that's important for a lot of
people to hear because, you know,
there's probably some young people out
there that are in a similar position to
where you were when you were starting
out that just feel like, oh, those
people that have made it, they're just
smarter than me and they had more
opportunities than me and it's just like
it was handed to them or they're just in
the right place at the right time. And
>> Joe, I just described to you somebody
who didn't know what was going on,
[laughter]
actually did it wrong.
>> Yeah. Yeah. And the ultimate diving
catch like two or three times.
>> Crazy.
>> Yeah.
>> The ultimate diving catch is the perfect
way to put it.
>> You know, it's just like the edge of
your glove. [laughter]
>> It probably bounced off of somebody's
helmet and landed at the edge.
[laughter]
>> God, that's incredible. That's
incredible. But it's also it's really
cool that you have this perspective that
you look at it that way because you know
a lot of people that have delusions of
grandeur or they have you know
>> and their rewriting of history
often times had them somehow extraord
extraordinarily smart and they were
geniuses and they knew all along and
they were they were spot-on. And the
business plan was exactly what they
thought. And
>> yeah,
>> they destroyed the competition and you
know and they emerged victorious.
[laughter]
>> Meanwhile, you're like, I'm scared every
day.
>> Exactly. [laughter]
Exactly.
>> That's so funny. Oh my god, that's
amazing.
>> It's so true, though.
>> It's amazing.
>> It's so true.
>> It's amazing. Well, but I I think
there's nothing inconsistent
with being a leader and being
vulnerable. You know, I the company
doesn't need me to be a genius right all
along, right?
Absolutely certain about what I'm trying
to do and what I'm doing. The the
company doesn't need that. The company
wants me to succeed. You know, the thing
that and we started out today talking
about President Trump and I was about to
say something and listen, he is my
president. He is our president. We
should all and we're talking about just
because it's President Trump, we all
want him to be wrong. I think that
United States, we all have to realize he
is our president, we want him to succeed
because
>> no matter who's president attitude.
>> That's right.
>> We want him to succeed. We need to help
him succeed because it helps everybody,
all of us succeed.
And
I'm lucky that I work in a company where
I have 40,000 people who wants me to
succeed.
They want me to succeed and I can tell
and they're all every single day to help
me overcome these challenges
trying to realize
realize what I describe to be our
strategy doing their best. And if it's
somehow
wrong or not perfectly right to tell me
so that we could pivot and the more
vulnerable we are as a leader the more
able other people are able to tell you
you know that Jensen that's not exactly
right or
>> right right
>> have you considered this information or
and the more vulnerable we are
the more able we're actually able to
pivot if we put ourselves into this
superhuman capability then it's hard for
us to pivot strategy,
>> right?
>> Because we were supposed to be right all
along.
>> And so if you're always right, how can
you possibly pivot? Because pivoting
requires you to be wrong. And so I've
got no trouble with being wrong. I just
have to make sure that I stay alert,
that I reason about things from first
principles all the time. Always break
things down to first principles.
Understand why it's happening.
Reassess continuously. The reassessing
continuously is kind of partly what
causes continuous anxiety,
>> you know, because you're asking
yourself, were you wrong yesterday? Are
you still right? Is this the same? Has
that changed? Has that condition is that
worse than you thought?
>> But God, that mindset is perfect for
your business, though, because this
business is ever changing
>> all the time. I've got competition
coming from every direction. So much of
it is kind of up in the air
and you have to invent a future where
a 100 variables are included and there's
no way you could be right on all of
them. And so you have to be
>> you have to surf.
>> Wow. That's a good way to put it. You
have to surf. Yeah. You're surfing waves
of technology and innovation.
>> That's right. You can't predict the
waves. You got to deal with the ones you
have.
>> Wow. And but skill matters and I've been
doing this for 30 I'm the longest
running tech CEO in the world.
>> Is that true? Congratulations. That's
amazing.
>> And you know people ask me how is one
don't get fired. [laughter]
That'll stop a short heartbeat.
And then two don't get bored.
>> Yeah.
>> Well, how do you maintain your
enthusiasm?
Well, the honor truth is is not always
enthusiasm. It's, you know, sometimes is
enthusiasm. Sometimes it's just good
oldfashioned fear and then sometimes,
you know, a healthy dose of frustration,
you know, it's whatever keeps you
moving.
>> Yeah. Just all the emotions. I think,
you know,
>> CEOs, we have all the emotions, right?
you know, and so probably probably
jacked up to the maximum because you're
you're kind of feeling it on behalf of
the whole company. I'm feeling it on
behalf of everybody at the same time.
And it kind of, you know, encapsulates
into into somebody. And so I have to be
mindful of the past. I have to be
mindful of the present. I've got to be
mindful of the future. And um you know,
it can't it's not without emotion.
It's not just it's it's not just a job.
Let's just put it that way.
>> It doesn't seem like it at all. I would
imagine one of the more difficult
aspects of your job currently now that
the company is massively successful is
anticipating where technology is headed
and where the applications are going to
be.
>> Yeah.
>> So, how do you try to map that out?
>> Yeah. there there um there there's a
whole bunch of ways and and it takes it
takes um
takes a whole bunch of things but let me
just start
uh you have to be surrounded by amazing
people and Nvidia is now you know if you
look at look at look at um the large
tech companies in the world today
most of them have a business in
advertising or social media or you know
content distribution and at the core of
it is really fundamental computer
science and so the company's business is
not computers the company's business is
not technology technology drives the
company is the only company in the world
that's large whose only business is
technology we only build techn we don't
advertise the only way that we make
money is to create amazing technology
and sell
And so
to be that to be NVIDIA today, you're
the number one thing is you're
surrounded by the finest computer
scientists in the world. And that's my
gift. My gift is that we've created a
company's culture,
a condition by which the world's
greatest computer scientists want to be
part of it because they get to do their
life's work and create the next thing
because that's what they want to do.
because maybe they're not they don't
want to be in service of another
business.
>> They want to be in service of the
technology itself. And we're the largest
form of its kind in the history of the
world.
>> Wow.
>> I know. It's pretty amazing.
>> Wow.
>> And so so one, you know, we have a we we
have got a great condition. We have a
great culture. We have great people. And
then now now now the question is how do
you systematically
um
be able to see the future stay alert of
it
and uh reduce the reduce the the
likelihood of missing something or being
wrong.
And so there's a lot of different ways
you could do that. For example, we have
great partnerships. We we have
fundamental research. We have a great
research lab, one of the largest
industrial research labs in the world
today. And we partner with a whole bunch
of universities and other scientists. We
do a lot of open collaboration
and so I'm constantly working with
researchers outside the company.
We have the benefit of having amazing
customers and so I have the benefit of
working with Elon and you know and
others in the industry and we have the
benefit of being the only pure pure play
technology company that can serve uh
consumer internet
industrial manufacturing
um scientific computing healthcare
financial services all the industries
that we're in. They're all signals to
me. And so they all have mathematicians
and scientists and and so because I I
have the benefit now of a radar system
>> that is the most broad of any company in
the world working across every single
industry from agriculture to energy
to video games.
And so the ability for us to have this
vantage point,
one doing fundamental research ourselves
and then two working with all the great
researchers, working with all the great
industries, the feedback system is
incredible. And then finally,
you just have to have a culture of
staying super alert. There's no easy way
of being alert except for paying
attention.
I haven't found a single way of being
able to stay alert without paying
attention. And so, you know, I probably
read several thousand emails a day.
>> How How do you have a time for that?
>> I wake up early. This morning I was up
at 4:00.
>> How much do you sleep?
>> Uh, six, seven, six, seven hours.
>> Yeah.
>> And then you're up at 4 reading emails
for a few hours before you get going.
>> That's right. Yeah.
>> Wow.
Every day.
>> Every single day. Not one day missed.
[sighs] including
Thanksgiving, Christmas.
>> Do you ever take a vacation?
>> Uh, yeah. But they're um my definition
of a vacation is when I'm with my
family. And so if I'm with my family,
I'm very happy. I don't care where we
are.
>> And you don't work then or do you work a
little?
>> No. No. I work a lot. [laughter]
>> Even like if you go on a trip somewhere,
you're still working.
>> Oh, sure. Oh, sure.
>> Wow. Every day.
>> Every day.
>> But my kids work every You make me tired
just saying this.
>> My kids work every day.
Both of my kids work at Nvidia. They
work every day.
>> Wow.
>> Yeah. I'm very lucky.
>> Wow.
>> Yeah. It's brutal now because, you know,
it's just me working every day. Now we
have three people working every day and
they want to work with me every day and
so it's it's a lot of work.
>> Well, you've obviously imparted that
ethic into them.
>> They work incredibly hard. I mean,
there's no unbelievable.
>> But my parents work incredibly hard.
>> Yeah. I was I was born with the work
gene,
>> the suffering gene. [laughter]
>> Well, listen, man. It has paid off. What
a crazy story. It was just It's really
an amazing origin story.
It really I mean, it has to be kind of
surreal to be in the position that
you're in now when you look back at how
many times that it could have fallen
apart and humble beginnings. But Joe,
this is great. It's a great country. You
know, I'm an immigrant. My parents sent
my older brother and I here first.
We're we're in Thailand.
I was born in Taiwan, but my dad had a
job in Thailand. He was a chemical and
instrumentation engineer, incredible
engineer.
And his job was to go start an oil
refinery. And so we moved to Thailand,
lived in Bangkok.
And um in 19
I guess 1973 1974 time frame,
you know how Thailand every so often
they would just have a coup. You know,
the military would have an uprising and
all of a sudden one day there were tanks
and soldiers in the streets and my
parents thought, you know, it probably
isn't safe for the kids to be here. And
so they contacted my uncle. My uncle
lives in Tacoma, Washington.
and um we had never met him and my
parents sent us to him.
>> How old were you?
>> Uh I was about to turn nine and my older
brother uh almost turned 11 and so the
two of us came to United States and we
stayed in with our uncle for a little
bit while he looked for a school for us
and my parents didn't have very much
money and they never been to United
States. my father was. I'll tell you
that story in a second.
And um
and so my my uncle found a school that
would accept foreign students and
affordable enough for my parents.
And that school turned out to have been
in Onita, Kentucky, Clark County,
Kentucky, the epicenter of the opio
crisis today.
cold country.
Clark County, Kentucky is
was the poorest county in America when I
showed up. It is the poorest county in
America today.
And so we went to the school, it's a
great school, um, Onita Baptist
Institute
in a town of a few hundred. I think it
was 600 at the time that we showed up.
No traffic light.
And um I think it has 600 today. It's
quite an amazing feat actually.
The ability to hold your population for
[laughter]
when it's 600 people. It was quite a
magic quite a magical thing. however
they did it. And and so uh the school
had a mission of being an open school
for any children who would like to come.
And what that basically means is that if
you're a trouble student, if you have a
troubled family,
um if you're,
you know, whatever your background,
you're welcome to come to Onita Baptist
Institute, including kids from
international who would like to stay
there.
>> Did you speak English at the time?
>> Uh, okay. Yeah. Yeah. Okay. Yeah. And so
we showed up
and uh
my first my first thought was gosh there
are a lot of cigarette butts on the
ground. 100% of the kids smoked.
[laughter]
So right away you know this is not a
normal school.
>> Nineyear-olds?
>> No, I was the youngest kid.
>> Okay. 11 year olds.
>> My roommate was 17 years old. Wow.
>> Yeah. He just turned 17. And he was
jacked
and and um
I don't know where he is now. I know his
name, but I don't know where he is now.
But anyways, uh that night we got and
and the second thing I noticed when you
walk into the into your dorm room
is uh there are no drawers and no closet
doors.
just like a prison.
And
there are no locks
so that people could check check up on
you.
And so I go into my room and he's 17 and
uh you know get ready for for bed and he
had all this tape
all over his body and uh turned out he
was in a knife fight and he's been
stabbed all over his body and these were
just fresh wounds.
>> Whoa. And the other kids were hurt much
worse.
And uh so he was my roommate, the
toughest kid in school, and I was the
youngest kid in school. It was a it was
a junior high,
but they took me anyways because if I
walked about a mile across the Kentucky
River, the swing bridge, the other side
is a middle school that I could go to
and then I can go to that school and I
come back and then I stay in the dorm.
And so basically Onita Baptist Institute
was my dorm when I went to this other
other school. My older brother went went
to um went to the junior high. And so we
were there for a couple of years. Um
every kid had every kid had chores.
My older brother's chore was to work in
the tobacco farm, you know. So tobac
they raised tobacco so that they could
raise some extra money for the school.
Kind of like a penitentiary.
>> Wow. And my job was just to clean the
dorm. And so I I was 9 years old. I was
cleaning toilets. And for a dorm of 100
100 boys, I
I clean more bathrooms than anybody. And
I just wish that everybody was a little
bit more careful, you know. [laughter]
But anyways, I was the youngest kid in
school. The my memories of it was really
good. Um, but it was a pretty tough It
was a tough town.
>> Sounds like it.
>> Yeah. Town kids, they all carried
Everybody had knives.
>> Everybody had knives. Everybody smoked.
Everybody had a Zippo lighter. I smoked
for a week.
>> Did you?
>> Oh, yeah. Sure.
>> How old were you?
>> I was nine. Yeah.
>> When you nine? You were nine, you tried
smoking.
>> Yeah. I got myself a pack of cigarettes.
Everybody else did.
>> Did you get sick? No. I I got used to
it, you know, and I learned how to blow
blow smoke rings and, you know, [snorts]
you know, breathe out of my nose, you
know, take it in out of through my nose.
I mean, there was a all the different
things that you learned. Yeah.
>> At nine.
>> Yeah.
>> Wow. You just did it to fit in or it
looked cool.
>> Yeah. [clears throat] Because everybody
else did it,
>> right?
>> Yeah. And and then I did it for a couple
weeks, I guess. And I just rather have I
had a quarter, you know, I had a quarter
a month or something like that.
I just rather buy popsicles and fried
sickles with it. I was nine, you know,
[laughter]
>> right?
>> I chose I chose the the better path.
>> Wow.
>> That was our school. And then my parents
came to United States two years later
and um we met him in Tacoma, Washington.
>> That's wild. It It was a really crazy
experience. What a strange formative
experience.
>> Yeah. Tough kids.
>> Thailand to one of the poorest places in
America or if not the poorest
as a 9-year-old.
>> Yeah. It was my first experience with
your brother.
>> Wow.
>> Yeah. Yeah. No, I I remember and what
breaks my heart probably the only thing
that really breaks my heart of
about that experience was
so
we didn't have enough money to make you
know international phone calls every
week and so my parents gave us this tape
deck this Iowa tape deck and a tape
and so every month we would sit in front
on that tape deck and that my older
brother Jeff and I,
the two of us would just tell them what
we did the whole month.
>> Wow.
>> And we would send that tape by mail
and my parents would take that tape and
record back on top of it and send it
back to us.
>> Wow.
>> Could you imagine if for two years
>> Wow. is that tape still existed
of these two kids just describing their
first experience with United States.
Like I remember telling my parents
that that uh I joined the swim team and
uh
my roommate was really buff and so every
day we spent a lot of time in the in the
gym and so uh uh every night 100
push-ups, 100 sit-ups every day in the
gym. So, I was nine years old. I was
getting I was pretty buff
and I'm pretty fit. And uh
and so I joined the soccer team. I
joined the swim team because if you join
the team, they take you to meets and
then afterwards you get to go to a nice
restaurant. And that nice restaurant was
McDonald's.
>> Wow.
>> And and I recorded this thing. And I
said, "Mom and dad, we went to the most
amazing restaurant today.
This whole place is lit up. It's like
the future."
And [snorts] the food comes in a box
[laughter]
and the food is incredible. The
hamburger is incredible. It was
McDonald's. [snorts] But anyhow, it it
wouldn't it be amazing?
>> Oh my god. Two years recording. Yeah.
Two years. Yeah. What a crazy connection
to your parents, too. Just sending a
tape and them sending you one back and
it's the only way you're communicating
for two years.
>> Yeah. Wow. Yeah. No, I've My parents are
incredible actually. They're just
they're uh they grew up really poor and
um when they came to United States, they
had almost no money. Uh probably one of
the most
impactful memories I have is is uh we
they came and we were we were staying in
a in a in a uh apartment complex
and they had they had just rent back in
the I guess people still do rent rent a
bunch of furniture
and
we were messing around
and uh
we bumped into the coffee table and
crushed it. It's made out of particle
wood and we crushed it.
And I just still remember my the look on
my mom's face, you know, because they
didn't have any money and she didn't
know how she was going to pay it back.
And but anyhow, that's that kind of
tells you how hard it was for them to
come here. They they left everything
behind and all they had was their
suitcase and the money they had in their
in their pocket and they came to United
States.
>> How old were they pursued the American
dream? They were in their 40s.
>> Wow.
>> Yeah. Late late 30s.
>> Pursued the American dream. This is this
is the American dream. I'm the first
generation of the American dream.
>> Wow.
>> Yeah. It's hard not to love this
country.
>> That's
>> it's it's hard not to be romantic about
this country.
>> That is a romantic story. That's an
amazing story.
>> Yeah. And and my dad found his job
literally in the newspaper,
you know, the ads and he calls people.
Got a job.
>> What did he do?
>> Uh he was a consulting engineer and a
and a consulting firm and they helped
people build oil refineries, paper mills
and fabs. And that's what he did. He was
an he he's really good at factory design
instrumentation engineer. And so he's
he's brilliant at that. And so he did
that and my mom uh worked as a maid and
uh they found a way to raise us.
>> Wow.
That's an incredible story, Jensen. It
really is. Every all of it from your
childhood to the perils of Nvidia almost
falling. [laughter]
It's really incredible, man.
>> It's a great story. Yeah. I I've lived a
great life.
>> You really have. And it's a great story
for other people to hear, too. It really
is.
>> You don't You don't have to go to Ivy
League schools to succeed.
This country creates opportunities. Has
opportunities for all of us. You do have
to strive.
You have to claw your way here.
>> Yeah.
>> But if you put in the work, you can
succeed.
Nobody works with
>> a lot of luck and a lot of
>> a lot and
>> good decision- making
>> and the good graces of others.
>> Yes, that's really important.
>> Yeah. You and I spoke about two two
people who are very dear to me. Um but
the list goes on. the people the people
at NVIDIA who have have uh helped me um
uh many friends that are on the board uh
the decisions you know them giving me
the opportunity like when we were
inventing this new computing approach
I tanked our stock price because we
added this thing called CUDA to the chip
we had this big idea we added this thing
called CUDA to the chip but nobody paid
for it but our cost doubled and so we
had this graphics chip company and we
invented GPUs, we invented programmable
shaders, we invented everything modern
computer graphics,
we invented real-time tracing. That's
why it went from GTX to RTX.
We invented all this stuff, but every
time we invented something,
the market doesn't know how to
appreciate it, but the cost went way up.
And in the case of CUDA that enabled AI,
the cost increased a lot. it and but I
really we really believed it you know
and so if you believe in that future and
you don't do anything about it you're
going to regret it for your life
and so we always you know I always tell
the team do you believe what do we
believe this or not and if you believe
it and so grounded on first principle is
not random you know hearsay and we
believe it we've got to we owe it to
ourselves to go pursue it if we're the
right people to go do it if it's really
really hard to do. It's worth doing and
we believe it. Let's go pursue it.
Well, we pursued it. We we launched the
product. Nobody knew. It was exactly
what like when I launched DGX1 and the
entire audience was like
complete silence. When I launched CUDA,
the audience was complete silence. No
customer wanted it. Nobody asked for it.
Nobody understood it. Nvidia was a
public company.
>> What year was this? This is uh
uh let's see 200
2006
20 years ago
2005.
>> Wow.
>> Our stock price just went
our valuation went down to like two or
three billion dollars
>> from
>> from about 12 or something like that.
I crushed it.
>> [laughter]
>> in a very bad way.
>> Yeah.
>> What is it now though?
>> H Yeah, it's higher. [laughter]
>> Very humble of you. [gasps]
>> It's higher. But it changed the world.
>> Yeah,
>> that invention changed the world.
>> It's a It's an incredible story,
Johnson. It really is.
>> Thank you.
>> I like your story. It's incredible. Ah,
>> my story is not as incredible. My story
is more weird,
you know.
It's much more fertuitous and weird.
>> Okay. What are the three milestones that
most important milestones that led to
here?
>> That's a good question. Um,
>> what was step one?
>> I think step one was seeing other people
do it. Step one was in the initial days
of podcasting, like in 2009 when I
started, podcasting had only been around
for a couple of years. Um, the first was
Adam Curry, my good friend, who was the
podfather. He he invented podcasting.
And then, you know, um, I remember Adam
Corolla had a show because he had a
radio show. His radio show got cancelled
and so he decided to just do the same
show but do it on the internet. And that
was pretty revolutionary. Nobody was
doing that. And then there was the
experience that I had had doing
different morning radio shows like Opie
and Anthony in particular because it was
fun and we would just get together with
a bunch of comedians, you know, I'd be
on the show with like three or four
other guys that I knew and it was always
just looked forward to it. It was was
just such a good time and I said, "God,
I miss doing that. It's so fun to do
that. I wish I could do something like
that." And then I saw Tom Green setup.
Tom Green had a setup in his house and
he essentially turned his entire house
into a television studio and he did an
internet show from his living room. He
had servers in his house and cables
everywhere. Had to step over cables. I
was this is like 2007. I'm like Tom this
is nuts. Like this is
>> and I'm like you got to figure out a way
to make money from this. Like this
everybody I wish everybody in the
internet could see your setup. It's
nuts. I just want to let you guys know
that [laughter]
>> it's not just this.
>> Yeah. So that was the the beginning of
it is just seeing other people do it and
then saying all right let's just try it
and then so the beginning days we just
did it on a laptop had a laptop with a
webcam and just messed around had a
bunch of comedians come in we would just
talk and joke around and I did it like
once a week and then I started doing it
twice a week and then all a sudden I was
doing it for a year and then I was doing
it for two years then it was like oh
it's starting to get a lot of viewers a
lot of listeners you know and then I
just kept doing It's all it is. I just
kept doing it because I enjoyed doing
it. Well, was there any setback?
>> No. No, there was never really a setback
really.
>> No,
>> it must have been. Or you kind of
>> You're just You're just resilient.
>> Or you're just tough.
>> No. No. No. No. It wasn't tough or hard.
It was just interesting. So, I just it
the the
>> You were never once punched in the face.
>> No, not in the show. No, not really. Not
Not doing the show.
>> You never did something that that
big blowback. Nope.
Not really. No, it all just kept
growing.
>> It kept growing and the thing stayed the
same from the beginning to now. And the
thing is, I enjoy talking to people.
I've always enjoyed talking to
interesting people.
>> I could even tell just when we walked
in, the way you interacted with
everybody, not just me.
>> Yeah, that's cool.
>> People are cool.
>> Yeah, that's cool. You know, I I it's a
an amazing gift to be able to have so
many conversations with so many
interesting people because it changes
the way you see the world because you
see the world through so many different
people's eyes and you have so many
different people have different
perspectives and different opinions and
different philosophies and different
life stories. And you know, it's an
incredibly enriching and educating
experience having so many conversations
with so many amazing people. And that's
all I started doing. And that's all I do
now. Even now, when I booked the show, I
do it on my phone. And I basically go
through this giant list of emails of all
the people that want to be on the show
or that request to be on the show. And
then I factor in another list that I
have of people that I would like to get
on the show that I'm interested in. And
I just map it out and that's it. And I
go, "Oh, I'd like to talk to him."
>> If it wasn't because of President Trump,
I wouldn't have been bumped up on that
list. [laughter]
>> No, I wanted to talk to you already. I I
just think, you know, what you're doing
is very fascinating. I mean, how would I
not want to talk to you? And then today,
it proved to be absolutely the right
decision.
>> Well, you know, listen, it's it's
strange to be an immigrant one day.
going to Onita Baptist Institute
with with the students that were there
and then here
Nvidia's one of the most consequential
companies in the history of companies.
>> It is a crazy story.
>> It has to be that journey is is a and
it's very humbling and
>> and um I'm very grateful.
>> It's pretty amazing man.
>> Surrounded by amazing people. You're
very fortunate and you've also you seem
very happy and you seem like you're 100%
on the right path in this life. You
know,
>> you know, everybody says you must love
your job. Not every day. [laughter]
>> That's not that's part of the beauty of
everything is that there's ups and
downs. It's never just like this giant
dopamine high.
>> We leave we leave this impression here.
Here's here's an impression I don't
think is healthy. We we um people who
are successful leave the impression
often that that
our job gives us great joy. I think
largely it does
that our jobs were passionate about our
work.
Um and that passion relates to it's just
so much fun. I think it largely is, but
it it it distracts from in fact a lot of
success comes from really really hard
work.
>> Yes,
>> there's long periods of suffering and
loneliness and uncertainty and fear and
embarrassment and humiliation. all of
the feelings that we most not love that
creating something
from the ground up and and Elon will
tell you something similar very
difficult to invent invent something new
>> and people people don't believe you all
the time you're humiliated often
disbelieved most of the time and so so
people forget that part of success and
and I I don't think it's health. I think
it's it's good that we pass that forward
and let people know that that it's just
part of the journey.
>> Yes.
>> Suffering is part of the journey.
>> You will appreciate it so these horrible
feelings that you have when things are
not going so well. You will appreciate
it so much more when they do go well.
>> Deeply grateful.
>> Yeah.
>> Yeah. Deep deep pride. Incredible pride.
In incredible incredible gratefulness
and and and surely incredible memories.
Absolutely. Jensen, thank you so much
for being here. This was really fun. I
really enjoyed it and your story is just
absolutely incredible and very
inspirational and and I you know, I
think it really is the American dream.
It is the American dream.
>> It really is. Thank you so [music] much.
Thank you. All right. Bye, everybody.
[music]

Key Vocabulary

Coming Soon!

We're updating this section. Stay tuned!

Key Grammar Structures

Coming Soon!

We're updating this section. Stay tuned!

Related Songs