Display Bilingual:

I'd love to start with these. 10 years of work  right there. Someone on your team called these   00:00
the real life Tony Stark glasses. Very hard  to make each one of these... That makes me feel   00:04
incredibly optimistic... In a world where AI  gets smarter and smarter... This is probably   00:08
going to be the next major platform after  phones... I miss hugging my mom. Yeah haptics   00:11
is hard... How does generative AI change  how social media feels?... We haven't found   00:16
the end yet... The average American has fewer  friends now than they did 15 years ago. Why   00:21
do you think that's happening? I mean  there's a lot going on to to unpack there... 00:26
I'm about to interview Meta CEO Mark Zuckerberg. There are not   00:33
that many people with more power over what our  future might look like. Nearly half the total human   00:41
population now uses Meta products and I just  tested some of their new tech that feels like   00:47
science fiction. This is crazy! Mark Zuckerberg and  the team at Meta are imagining a future that billions   00:52
of other people might actually end up living in. So  my goal for this conversation is to try to figure   01:00
out what that future really looks like. To paint a  picture of the future Mark Zuckerberg is trying to   01:05
build so that you can decide for yourself what you  think of it. Welcome to the first episode of our   01:10
new series, Huge Conversations 01:15
Hey, good to meet you! Thanks for doing this. Yeah looking forward   01:23
to it. Awesome. I'd love to tell you what my goal  is of this conversation. Go for it. We have a called   01:26
huge if true which is this very optimistic about  science and technology and the potential futures   01:34
that we can build and in every episode we're sort  of exploring what does it look like if you play a   01:39
certain technological future out and so my goal  in this conversation is to try to help people   01:45
see the future that you're imagining when you're  building the products that you and the Meta team   01:52
are building. What are you imagining this looks  like in future? How are you imagining people use   01:57
this? All of that. Cool. All right awesome. So  I'd love to start with these. Let's do it. 10 years   02:01
of work right there! I got to demo them a little  bit earlier today. I heard someone on your team   02:09
call these the real life Tony Stark glasses? We're  getting there. But I'd love to just hear in your   02:15
voice what are these? Well these are the first full  holographic augmented reality glasses I think that   02:20
exist in the world. We've made I think it's a  a few thousand or something right. Very hard to   02:29
make each one of these but this is the culmination  of 10 years of research and and development that   02:37
we've done to basically miniaturize all the  computing that you need to have glasses not a   02:43
headset but glasses that can put full holograms  into the world with a wide field of view. So you   02:53
can imagine sort of in the future we'd be having a  version of this conversation where you know maybe   03:00
I or you are not even here it's like one of us is  physically here and the other one is here as a as   03:06
kind of a full body hologram and it's not just  a video call you can actually interact you can   03:10
do things I mean in the the demo we had the you  know ping pong and games and things like that but   03:14
I mean you could you can interact you can work  together you can you know play poker play chests   03:20
whatever like the holographic cards holographic  board game. I just think it's going to be wild. 03:24
it's going to remake I think so many different  fields that we think about today from how we work   03:29
and productivity to a lot of things around science  a lot of things around education entertainment fun   03:36
gaming. But this is just the beginning you  know this is the first version, it's a   03:43
prototype version that we've made in order  to develop the next version which is hopefully   03:48
going to be the consumer one that we sell to  a lot of people. Why build these? Well I think   03:54
it's going to be the next major computing platform.  So if you look at like the grand arc of computing   03:59
over time you've you've gone from like main  frames to computers that basically like live   04:04
on you know your desk or on a tower to phones  that you have in your hand that you basically   04:11
like you know can take with you everywhere that  you want but it's it's pretty unnatural right it   04:17
takes you away from the world around you and. I  think that the trend in computing is it gets more   04:21
ubiquitous it gets more natural and it just  gets more social right so you want to be able   04:28
to interact with people in the world around you  and I think that this is probably going to be   04:34
the next major platform after phones. I'll give  these to you. These are the clear ones that show   04:38
all the... The whole thing is a special edition and  this is like a really special edition. There's   04:44
not a single millimeter of of space. You know  everything in here from the micro projectors that   04:48
um basically shoot light into the wave guides  right it's a special type of display system. I   05:00
mean these aren't normal displays like you have  in a phone or a TV or computer like the type of   05:06
displays that people have been building for  decades. It's a waveguide system. The projector   05:11
that's shooting light basically goes into these  nano etchings across the wave guide that are what   05:15
catches and creates the holograms. In order to  synchronize that with your where you're looking   05:23
there's eye tracking and little cameras,  they illuminate your eyes and then of course   05:30
there's all the basic stuff that you need all the  computing, the batteries to power the whole thing,   05:35
microphones, the speakers because it needs to be  able to play audio and speak with you and the   05:41
cameras and sensors to see things around you in  the world so that way when it's placing holograms   05:48
in the world it can do that in the right place  and understand where you are so that probably   05:53
is still not covering everything because there's  a lot of things that need to go into syncing up   05:58
the holographic images between the two displays  because you don't just have a single display   06:03
like you have in a phone or TV you have two and  it moves around and you know physical things   06:08
are hard and need to be synced up. There's also  the radio that has to communicate with your other   06:15
computing devices to do heavier computing um and  the wrist based neural interface that you probably   06:19
got to try out. We kind of miniaturized all of this  and fit it into uh you know normal looking pair of   06:25
glasses which is... you know when I told the team  that we were going to do this 10 years ago you   06:31
know people weren't sure if we were going to be  able to but I think you not only we're going   06:38
to be able to do this but I think we're going to  be able to get it cheaper and higher quality and   06:42
even even smaller and more stylish over time. So  I think this is going to be a pretty wild future.   06:46
There are so many versions of trying to get  a similar idea of digital objects in physical   06:51
space. I'm thinking of for example of glasses that  have heads up displays where it's headlocked and   06:57
it's moving with my eyes, glasses that are really  creating digital objects in physical space that   07:05
don't move as I move, I'm thinking of these, I'm  also thinking of the Snapchat Spectacles that they   07:10
just announced, then on the other hand there are  headsets like the Quest and also like the Apple   07:16
Vision Pro that seem to fall into a different  category. I'm curious how you would organize this   07:22
landscape for people and how you think about  people using these tools in their real lives   07:26
in the near future? Yeah so when we were getting  started on this about 10 years ago I thought that   07:31
something like this was going to be the ultimate  product for everyone. Right you get to you know   07:36
normal looking pair of glasses and we'll continue  improving that that can have full holographic   07:41
images. I think it's super powerful  and it is sort of the science fiction future that   07:46
I think we all hope to get to. On the journey we  took a few other approaches as well um to help us   07:51
develop towards that including building glasses  that don't have displays to try to learn. Just   07:59
take a stylish pair of glasses today and put as  much technology into it as you can but really   08:06
focus on the form factor and that's the Ray Ban  Meta glasses and it's doing really well and   08:11
initially we thought that that was sort of intro  product for us to learn how to build this but one   08:16
of the things that's clear now is you're going to  be able to make that product a lot more affordable   08:23
than this probably permanently. So I actually think  that there are going to be a bunch of different of   08:29
these paths that we've taken are going to be  kind of permanent product lines that people   08:35
will choose. I think you'll see display-less glasses  like the Ray Ban Metas continue to get better and   08:40
better, great for AI, no display but you can talk  to it, it can talk back. I think there's going to   08:45
be something in between these that's basically a  heads up display, so it's not a 70° field of view,   08:51
maybe it's a 20° or 30 degree field of view,  so that's not going to be what you want for   08:57
putting kind of a full hologram of a person or  interacting with the world around you but it's   09:03
going to be great for you know when you're talking  to AI, not just having voice but also being able   09:08
to see what it's saying or being able to text  someone with your wrist-based neural interface and   09:12
then have their text show up rather than having it  read to you, which is, we read faster than we   09:18
can listen or getting directions right or just  being able to search for information get all that.   09:22
So there's a lot of value for heads up display  that will be somewhat more expensive than the   09:28
display-less but somewhat cheaper than this.  Then I think you're going to get this. It's going   09:32
to be probably the most premium and and expensive  of glasses products but hopefully still something   09:38
that you know like a computer is generally  accessible to most people in the world but I think   09:46
that there are going to be all of those and I  I think people will like them. I also think that   09:51
the headsets that people are using around mixed  reality will continue to be a thing too because   09:55
no matter how good we get at miniaturizing  the tech for this you're just going to be   10:01
able to fit more compute into a full headset.  Fundamentally our mission is not you know build   10:04
something that is advanced and only a few people  can use, we want to take it you the last mile and   10:11
do all the innovation to get it to everyone. We  you know just shipped or announced Quest 3S,   10:17
the new mixed reality headset where we basically are  delivering high quality mixed reality for $299.   10:22
I was really proud last year when we delivered  Quest 3, the first kind of really high quality   10:30
high resolution color mixed reality device for  $500, right it was like, it's like a fraction of   10:36
the cost of of what the competitors are doing  and I think it's actually higher quality in a   10:42
lot of ways, and now we've just doubled down on  that. So I think that they're all actually going   10:46
to end up being important long-term product lines:  display-less, heads up display, full holographic   10:52
AR, full headsets. I think that they're all going  to be important. Yeah. If you play out the future   10:59
of not just the hardware that we've been talking  about so Meta Ray Bans, Quest, Orion, but also   11:06
the Llama models, if everything goes according to  you and the teams wildest dreams, I'd love for   11:16
you to just begin to describe what that feels like.  I mean I think that there are two primary values   11:23
that we're trying to bring. On the AR and kind of  mixed reality side, the main value we're trying to   11:28
bring is this feeling of presence .Right so there's  something that I think is just really deep about   11:34
being physically present with another person that  you don't get from any other technology today and   11:39
I think that's the thing when people have a very  visceral reaction to experiencing virtual or mixed   11:45
reality what they're really reacting to is that  they actually for the first time with technology   11:51
feel a sense of presence like they're in a place  with the person and that's super powerful. I   11:56
focused on designing social apps and experiences  for 20 years that's sort of like the Holy Grail   12:02
of that is being able to build a technology  platform that delivers this like deep sense of   12:08
of social presence. The other big track is around  personalized AI and for that and that's sort of   12:13
where Llama and Meta AI and all those things are  going. There's all this development that's going   12:20
into making the models smarter and smarter over  time but I think where this is going to get   12:25
really compelling is when it's personalized for  you and in order for it to be personalized for you   12:31
it has to have context and understand what's going  on in your life both kind of at a global level and   12:38
like what's physically happening around you right  now and in order to do that I think that glasses   12:44
are going to be the ideal form factor because  they're positioned on your face in a way where   12:49
they can let them see what you see and hear what  you hear which are the two most important senses   12:53
that we use for for kind of taking information  and context about the world. I think that this is   12:58
all going to be kind of really deep and profound  stuff but it's basically those two things: It's   13:03
this feeling of presence and this capability  of really personalized intelligence that can   13:07
help you. I'd love to talk about each of those  two things. The first on presence, I owe a lot   13:12
to being able to connect with people online. Right  this job that I have is by definition that, also with   13:20
my family. My parents don't live anywhere close  to me. I video call them a lot and when I think   13:25
about the progress of technology like this in a  timeline from the telegram to the telephone   13:31
to video call to some feeling of presence with  another person who's feels like they're right   13:39
there in front of me, that makes me feel incredibly  optimistic. I would love a future where like I can   13:45
lose in Scrabble to my mom and feel like she's  really there in front of me. Yeah and it feels like   13:51
we're not that far away from something - I agree! - that persuades my brain that that's happening. Yeah   13:57
totally. And also I miss hugging my mom right like  that never goes away. Yeah haptics is hard. Yeah and   14:01
so my question is about that  it's about this this feeling of like it's hard   14:12
for me to imagine um a future where real physical  presence is not different and special in some way   14:16
where I don't miss literally hugging my  mom and I'm curious how you think about the   14:25
parts of human connection that are eye contact and  physical touch and things that our ape brains   14:33
value for connection with other people. Yeah well eye contact I think we're going to get to a lot before   14:41
the the touch part. For haptics I do think we'll  make progress on that but it's it's obviously   14:47
there's a spectrum there too from kind of hands  which is where if you you draw out the kind   14:53
of like homunculus version of a person in terms  of like what are what are our kind of sensory you   15:01
know what what's like the majority of what we're  sensing it's like yeah yeah so I think being   15:05
able to do that for your hands is probably the  most important place to start and you have a rough   15:10
version of that with controllers today. I think  that that'll get even more over time. We have this   15:16
demo playing pingpong where you have a controller  where as the digital ball hits the ping pong   15:21
paddle you feel it hit the as if it's hitting the  ping pong paddle wherever it is so you actually   15:27
have a sense of like where it's it's hitting  the the the paddle so I think that was that   15:31
was just a wild demo so I think we'll get some of  that the most extreme version of this is wanting   15:36
force feedback right so I mean like for doing a lot  of sports right it's it's like okay we can kind of   15:41
do a good approximation of like boxing today or  you get like good feedback on your hands but it   15:47
would be hard to do a virtual reality version of  Jiu-Jitsu where you're like grappling with someone and   15:54
you need like real kind of force feedback on  that so that's probably like the hardest thing   15:59
right to go do but I think we'll get there.  You know I think like most science fiction it's   16:04
not this binary thing that you just like wake up  one day and we're like oh we've realized all the   16:11
dreams but but I I do think that these platforms  are going to be the first time that I think that   16:14
there's a realistic sense of presence in all  the ways that that's special to people for   16:20
most things that people want to do which are not  the most physical ones and even some of the basic   16:29
physical ones I think we'll get. But then there's  a long tale of other stuff I mean smell is also   16:33
really important for people yeah right it's  I think it's disproportionately important for   16:38
memories and that's not really a thing that  I think in the next few years we're going to   16:42
have in any of these devices I mean that's a very  difficult and challenging thing on its own. What is   16:49
the piece of that that you feel most interested in,  that you keep coming back to in your mind? This has   16:55
the frustrating property to develop that the  sense of presence is almost like when you're   17:01
designing something that that's sort of trying  to artificially deliver it you're delivering   17:07
an illusion to a person and more than any one  thing that provides a sense of presence it's   17:12
actually more the case that any one thing done  wrong breaks the sense of presence. You kind   17:20
of know that you're interacting with technology  but it's so convincing that um that you just kind   17:24
of go along with it. You're like okay yeah no this  person feels like it feel like they're there right.   17:33
When I did that pingpong demo I like at the end  of it I dropped the pingpong paddle on the virtual   17:37
table and it shattered so that was not the best  for for our internal development but   17:44
like that's winning in our in our development  right it's like when when you feel like something   17:50
is is kind of so realistic that you you're just  convinced that um that it's there now and there   17:55
are a lot of things that can break that right so  I think a a field of view that's too low right so   18:01
something feels real but then you turn your head  and it's not there um latency read physics that   18:06
don't behave like realistic physics. It also is  interesting in some ways what people can accept   18:12
as physically real even though it's not right  so like we've done a ton of work on avatars we   18:19
we have this whole work stream on Kodak avatars  to do these photo avatars and it's I think it's   18:25
going to be incredbly compelling and people are  going to love it but one of the things I found   18:30
interesting is the ability to mix photorealistic  and expressive kind of the cartoony avatars with   18:36
photorealistic worlds and kind of more cartoony  computer game type worlds so you can have the   18:42
a Kodak kind of photorealistic avatar of a  person in what is clearly like a video game   18:49
or cartoon world and people are generally  pretty fine with that it's like okay that   18:54
that feels pretty good and similarly having  a photorealistic world but good increasingly   18:58
good kind of cartoon avatars as long as the  avatars move in a way that feels authentic to   19:06
the person you're interacting with it actually  feels pretty good you know it's when you look at   19:13
a 2d still frame of it some of the stuff can  look a little bit silly and and we've certainly   19:17
you know had had a our share of memes around  that but um but when you're in there you know and   19:22
you you've played around with lot of the stuff it  feels realistic because it's basically mimicking   19:27
the kind of authentic mannerisms of of a person  that you're interacting with and even if it's not   19:32
a Kodak photo realistic avatar if it's kind of  a more cartoony expressive one so I I think that   19:37
that's it's very interesting to see kind of  which pieces you need to unlock and what where you   19:42
just need to be like very technically excellent  and consistent but it's um this isn't a space   19:48
where it's like you deliver one thing and it's  good this is like there's a wide breth of things   19:52
that you need to nail and then have it all come  together and that's why these are you know 10 year 19:58
projects. It seems like an interesting way to learn  about the human brain and what we actually care   20:03
about with respect to what feels real. I was  wondering about, there was this moment in an   20:11
interview that you did with Lex Friedman, you quoted  research that says that the average American has   20:17
fewer friends now than they did 15 years ago  and I was so interested in that because   20:25
it seems like if we want to get to a world where  there's more human connection this is the trend   20:30
that we're going to have to grapple with and just  to give some data on this in the American Time Use  20:36
Survey over the last 20 years the amount of time  American adults spend socializing in person has   20:43
dropped by nearly 30%. For ages 15 to 24 according  to the Surgeon General it's nearly 70%. and I   20:49
look at that data and I think to myself well maybe  if we're all socializing digitally that doesn't   20:58
matter so much maybe there's a future where that's  actually fine but there's also data that suggest   21:03
that we're struggling somewhat. The number of  Americans who say that they don't have a single   21:08
close friend - yeah it's really sad - that share has jumped from 3% to 12% in the last 30 years. It feels to 21:15
me like with all the tools that we've built for human connection, we're struggling to connect and I'm curious   21:24
why do you think that's happening? I mean there's a lot  going on to to unpack there. A lot has changed   21:33
sort of economically and socially during that  period and a lot of those trends go back before   21:43
a lot of the modern technology. So I mean this  is something that a lot of academics and folks   21:49
have have studied but it is an interesting lens  to look at this though because I think whenever   21:54
you're talking about building digital types  of connection one of the first questions that   22:01
you get is is that going to replace the physical  connection and my answer to that especially in the   22:07
case of something like this is that no because  people already don't have as much connection   22:16
as they would like to have. It's not like this is  replacing some sort of better physical connection   22:25
that they would have otherwise had. It's that the  average person would like to have 10 friends and   22:30
they have two right or three and there's just  more demand to socialize than what people are   22:37
able to do given the current construct and giving  people the ability to be present with people who   22:45
are in other places physically just seems like  it will unlock more. It's not going to make it   22:52
so, if I have glasses, it's not going to make  it that I spend less time with my wife, it's going   22:56
to make it so that I spend more time with you  know my sister who lives across the country. And   23:00
that's, I think that's good. I  think people need that. As for the rest, I   23:06
I think we could probably spend a multi-hour  podcast just going into all of the different   23:12
kind of socioeconomic political dynamics that are  going on but none of the trends that I've seen   23:19
does it seem like the primary thing that's going  on is that because people are interacting online   23:28
they're now not interacting with their with people physically. Now certainly I think you   23:33
you I do interact with people online who I also  like to interact with physically but and I think   23:42
that that's kind of like a combination um like  more combined richer relationship that you have   23:48
overall but I think that there's a lot going  on with the loss of of kind of social capital and   23:54
connections that really predates a lot of the  modern technology. The goal of what, I'm what I'm   24:01
trying most to learn about is how we can structure  the technologies that we use in the future to get   24:08
toward this future I think you're imagining of  more human connection in more ways. I'm curious, you   24:15
brought up the other big pillar of AI and in some  of your conversations, I'm thinking of a conversation   24:22
with Tim Ferris in particular, you talked about  a lot of different use cases of AI and they seem   24:29
to me to fall on somewhat of a spectrum. Like  for example you mentioned automatic real-time   24:35
translation, like basically the Star Trek  Universal translator. We're pretty   24:42
much there! Yeah and that's one example on one  end of the spectrum where some people might argue   24:47
that there is a chance that someone is less likely  for example to learn a language because we can all   24:54
speak to each other in real time in different  languages. I think nobody would really argue   24:59
that therefore we shouldn't have that kind of  universal translator. People still learn Latin and   25:04
Greek. Right exactly and so I think that end  of the spectrum is something like um technologies   25:08
that really measurably unlock our humanity because  they remove a struggle between people and then on   25:16
the other end of the spectrum there are a lot of  educational things for example where the struggle   25:23
is kind of the point right? Like it's like building  a muscle. I can think of so many times   25:27
in my life where like the reason why I was doing  something was not the output it was the fact that   25:32
I was trying so hard to do it. There's one example  in the Tim Ferris interview where you talked   25:36
about your kids struggling to articulate  themselves emotionally and adults very much had   25:41
the same problem and you talked about AI as a way  to help them articulate those emotions. Yeah and   25:48
I thought about all of the many times in my life  where I have struggled to articulate my emotions   25:54
and how I really could have used some help in  those moments and I also found myself thinking   26:00
about the times when that was really building  a muscle where like the act of struggling to   26:04
communicate with someone and understand what they  wanted from me was was important to my development.   26:09
And so my question is if you think about that  as a spectrum between things that are really   26:14
important to our humanity where and the struggle  being removed is helpful versus things where the   26:19
struggle is the point and it unlocks  something about our humanity and is important   26:25
to preserve like building a muscle, how do you  draw the line between those things and how do   26:31
we ensure that the muscles that we're building for  this future are stronger and not weaker? Yeah it's   26:37
interesting I mean I think we're always going to  find new things to struggle with and I mean it's   26:42
you can always get better at communicating with  other people and kind of expressing yourself and   26:47
understanding other people so having a tool that  can help you do that better isn't going to mean   26:52
that like oh now we perfectly understand every you  know it's I mean I think the maybe one   26:56
of the most functional aspects of this you're  already seeing a lot of these AI models really   27:05
help people with coding right like a generation  ago um before I was getting started a lot of   27:09
coding was like really low-level system software  and you know then by the time that I got into   27:14
it there was a little bit of that but um you you  can make websites pretty easily make apps pretty   27:20
easily and I think in 20 years or a lot sooner  than that you're going to basically be in a   27:26
world where kids will be able to just describe the  things that they want and build incredibly complex   27:34
pieces of software so it's um in that world  are kids going to be not struggling I I don't   27:39
think so I think that they're going to be just  expressing their creativity and and it'll it'll   27:47
be this kind of constant iterative feedback loop  around like okay like yeah I you know took a few   27:51
minutes to describe this thing and like yeah this  whole like amazing virtual world was created that   27:59
I can have see on my glasses or whatever but like  these things are not exactly what I want them to   28:05
be so now I need to like go back and edit them it  just I don't know I think that there's always   28:10
more. Another way to get this - it's one of the things  that I think makes makes people so good. It just   28:15
there's there's always more to do. We'll always  find the struggle? Yeah. Another way to get at this   28:21
is if you if you play this out to make the  tools even better in like 10 years let's say   28:25
your kids are in high school are there ways that  you would want them using AI because you think it   28:30
would accelerate them intellectually and ways that  you would advocate for them not to use it or   28:35
things that you would have concerns about? I mean  I think that there's some things that you need   28:42
to be able to do yourself. I think that's a lot of  the basic fear that people have around this is  28:46
that while we're building these amazing tools we  get away from this self-confidence and ability of   28:52
being able to do like this basic stuff yourself so  it's like all right you have a calculator but it's   29:01
still good to be able to do kind of basic math in  your head because there are a lot of things that   29:08
come up throughout the day that you just want to  have a general numeracy around right that often   29:13
they're not expressed in numerical terms but just  in terms of understanding trends or understanding   29:19
arguments that people are making, you you kind of  need to understand the shape of how numbers come   29:25
together and so I think one of the big debates  is like should we still teach our kids to program   29:30
computers even though you're going to have these tools in the future that are just so much   29:35
more powerful than anything that we have now to  produce incredibly complicated pieces of software.   29:42
I think the answer to that is probably yes  because I think teaching someone how to code   29:49
is teaching them a way to think rigorously and  that even if they're not doing most of the code   29:55
production I think it's important that you kind of  have the ability to think in that way and I think   30:01
it's going to just make you generally a better  thinker and better person so yeah maybe that's   30:06
like this generation's version of calculators  it's like so you you want to you want to use the   30:14
calculator but you'll also want to be able to  generally do without it. Other ones like language   30:18
I don't know I mean different people can come  out I think this is one of the interesting   30:25
questions about parenting these days is like is  is just kind of like what what's important to   30:28
teach your your kids and in an era where so much  is going to change over the the time that they're   30:34
even in school. Language I think you can make  similar arguments. I think there's a lot of it's   30:40
like it's probably going to be less functionally  relevant in the future to learn multiple languages   30:45
but it sort of helps you think in different ways, you know I found from the languages that I've   30:49
studied that a lot of it you learn about  the structure of your own language, you can   30:54
you know you also learn about the culture right  because so much of how things are expressed in   31:00
different places is tied to the nuance and the  history of kind of what how so I think   31:04
like you that's all valuable and interesting  stuff to get into but then I don't know at the   31:09
same time we only have so many hours in the day  so people need to prioritize what they're going   31:15
to learn and it may be that okay in a world with  perfect translation which by the way we basically   31:18
just announced on the Ray Ban Metas that now  you're going to be able to just like you go to   31:23
countries yeah we're starting out with just a few  languages but we'll roll it out to more and you   31:28
know you'll be you could be traveling anywhere and  you have your glasses and they just translate in   31:33
real time in your ear. So it's wild, yeah so  I think people are going to need to choose what   31:36
what what they want to focus on going forward.  How do the developments that we've been talking   31:42
about in AI intersect with social media and the  platforms that most people use today? There's a  31:48
future where there's images and generated text  and maybe AI influencers. How does generative   31:54
AI change how social media feels in the future?  Yeah I mean I think that that's a really   32:03
deep one. You know there's already been one  big shift which is that social media started   32:10
out as people primarily interacting with their  friends and now it is you know at least half of   32:16
the content is basically people interacting  with creators or content that's not created   32:23
by people who they kind of personally know so  we sort sort of already have that paradigm and   32:28
I think AI is probably going to accelerate that. It  will give all these people additional tools right   32:36
so your friends will create kind of funnier memes  and more interesting content um that'll come from   32:42
a lot of different ways. I think some of it will  be okay your friends have glasses and they capture   32:49
a bunch of stuff and before they might have not  been able bble to edit it to make it interesting   32:54
or maybe it was just too much work or they didn't  even realize that they captured something amazing   32:59
but now the AI is like hey I like made this thing  for you out of your content um it's like okay   33:02
that's awesome like people will enjoy that. Creators  obviously kind of much more specialized skills   33:07
are going to be able to use even more advanced AI  tools to make more compelling content but then I   33:15
think that there will be a bunch of kind of green  field type stuff where maybe in the future there   33:20
will be content that is purely generated by AI  by the system personalized for you maybe it's   33:27
summarizing things that are out there that that  are going to be interesting maybe it's um just   33:35
producing something funny that makes you laugh  this is going to be like a very kind of deep zone   33:41
that there's a lot to to experiment with.  I think there are going to be AI creators as well,  33:46
as creators building AI versions of themselves,  I mean that's a thing that we just showed too   33:52
at Connect is basically I mean if you're a Creator one of the big challenges is   33:58
like all right there are only so many hours  in the day and your community probably has a   34:02
nearly unlimited demand to interact with you and  you want to interact with them because you're   34:08
trying to grow your community. I mean that's both  socially and from a business perspective that's   34:11
sort of you know growing the community is an  important part of what every creator does so   34:16
okay if we can make it so that each creator  can basically make an like an AI artifact   34:20
that their community can interact with people be  clear it's not the actual creator themselves but   34:28
it's almost like a piece of digital art that  you're producing like an interactive sculpture   34:32
or something that it's like it's like you train  it to here's the context that I wanted to have   34:37
here's the topics I wanted to communicate  on here's stuff that I wanted to stay away   34:41
from you're giving your community something to  interact with when you can't be there to to kind   34:45
of answer all the questions and I think that's  going to be super compelling so there's like   34:51
these interesting things but I think it's I AI  it's kind of like the internet in a way where   34:57
it's probably going to change almost every field  and almost every feature of every application that   35:04
we use um it seems sort of hyperbolic to say that  but I do think that's true and it's just hard to   35:11
sort of enumerate all the different things up  front but I think that over the next 5 to 10   35:18
years we're just going to explore the impacts  in each of these areas and it's going to be   35:23
like an amazing amount of innovation and really  exciting. I feel two things simultaneously when   35:27
you say that. I feel both like I really want  to be optimistic about the future of these   35:32
platforms and I obviously have gained so much from  an enormous pace of change right like everything   35:38
that we're doing now and what I actually feel is  worried. I feel some specific concerns around the   35:45
way that you know I might communicate with an  audience and the way that they might respond to   35:54
that or the way that human communication might  change but also more generalized just sort of   35:57
fear of the pace of change and and worry and I  don't think I'm alone in that feeling. Yeah and   36:02
you're supposed to be the optimist! I know! And I'm  curious like how you talk to people who feel that   36:07
way. What concerns do you feel are most legitimate  and what do you feel most misunderstood? I think   36:14
the pace of change is always a concerning  thing right it's there is a lot of uncertainty   36:21
about how how things will go in the future and  we're all going to get really amazing new tools   36:30
to do both our hobbies and our jobs and they'll make it so we can do better work and   36:35
have better lives but at least on the professional  side it's going to be our responsibility to keep   36:44
up with that or else it's going to be difficult  for us to compete with other people who are   36:48
doing a good job of kind of keeping up with  the new trends. So I get it. I mean I think   36:53
you know especially in the you know line of of  work of being a creator and it's a very sort of   36:58
competitive space, I don't think that like creators  necessarily think about it as competitive but it   37:04
is right it's like it's you know and um and so I  get it. I think that this is going to make it so   37:07
that like the quality of work that people produce  and how interesting it is and how much they can   37:16
communicate and like really efficiently is is  just going to kind of go through the roof but   37:20
but when you're staring down a set of changes like  you know that there's some big change coming and   37:28
you don't know what it is that's always a time of  anxiety so I get it. If I take my creator hat   37:35
off and I'm just a person who is youngish starting  out my career-ish, starting out building a family,   37:42
how would you advise someone like me to prepare  well for the future that we're headed toward   37:51
to be able to learn new skills now or just think  about this future in an educated way? Yeah I mean   38:00
I just think maintaining curiosity about things is  is important. I do think we can overstate to what   38:09
extent the next 10 years is going to be sort of  different from the last 10 or 15. I mean a ton of   38:16
stuff changed over the last 10 or 15 years too.  It's not like this is the only time in history   38:21
where there's some technology it's going to make  it so there's new opportunities and things change   38:25
the internet coming into maturity and everyone  having smartphones has already rewired things   38:30
dramatically and I mean maybe the next period will  be a somewhat bigger change or maybe it won't I   38:36
think it'll feel different to different people but I don't think this is like going from zero to   38:44
one it's not like okay everything's just kind of  been normal and now like now it's about to change   38:51
it's like the technology of evolves over time and  and like the opportunities that we have evolve and   38:55
improve and I think that's like the people who  do well I think are are people who are generally   39:01
curious about it and and dig in and and try  to use it to live better lives rather than the   39:06
people who who basically you know try to fight it  in in some way. One thing that I really want to ask   39:14
you about is open source. Yeah. I think imagine that  we're talking to an audience that has maybe heard   39:23
that term but doesn't have any real idea of how  that might impact them in the development of AI.  39:30
How would you explain the reasonable debate  that people in your field are having about this   39:37
right now? Well I think there are two pieces. I mean  so what does open source mean? It means that people   39:41
can build a lot of different things right so at  a high level I look at the vision that a bunch of   39:47
companies have right so Open AI, Google, they're  building an AI right like one AI that I think   39:52
in general they're like okay this is going to be  it's like you're going to use they think you're   39:59
going to use Gemini or ChatGPT for like all the  different things that you want to interact with   40:03
and at a high level that's just not how I think  the world is going to go. I think we're going to   40:07
have a lot of different AI systems just like we're  going to have we have a lot of different apps.   40:11
I think in the future every business just like  they have a website and a phone number and an   40:17
email address and a social media account is also  going to have an AI that can interact with with   40:22
their customers to help them sell things to help  them do support. I think a lot of creators will   40:28
have their own AIs right I think like a lot  of people will interact with with a bunch of   40:34
different things. There's a question of okay do you  want a future that's fundamentally kind of very   40:39
concentrated and where you're interacting with  kind of one system for everything or do you want   40:45
one where a lot of different people are building a lot of different AIs and systems just kind   40:50
of like you probably didn't want there to be you  know just one app or just one website. It's like a   40:56
richer world when there's a diversity of different  things so that's one piece is is just giving   41:00
people the ability to build it themselves and  what open source does it makes it that everyone   41:05
can take and modify the model and build stuff on  top of it which is different from the kind   41:09
of closed and centralized approach. The safety  debate is a specific part of this which is in a   41:15
world where AI gets smarter and smarter, what's the  way that we have the highest chance of of having a   41:26
a a kind of positive future and and not having  a lot of the safety concerns? And I think some   41:35
people think that if we keep the model closed  and don't give it to a lot of developers that   41:40
should make it safer because then you don't get  bad developers doing bad things with the model. 41:48
Historically I think what we've seen with open  source is actually the opposite which is that   41:59
this is not the first open source project right  I mean this is obviously this has been a thing in   42:05
the industry for decades and I think what we've  traditionally seen is that open source software   42:09
is safer and more secure largely because you put  it out there more people can scrutinize it because   42:14
they can see all parts of the system and then  there are inevitably issues with any software   42:20
there are bugs there are security issues and  initially with open source people thought hey if   42:27
you're putting the software out there and there  are holes in it isn't everyone just going to go   42:32
exploit those holes and especially the bad  guys but it turned out that it sort of in this   42:36
counterintuitive way that by making by adding more  scrutiny to the systems the holes became apparent   42:41
quicker and then were fixed and then people  roll out a new version just like we roll out   42:49
a new version of our models right Llama 3, Llama  3.1, Llama 3.2 everyone upgrades, so I think the   42:52
same thing is going to happen here I think it's  sort of this counterintuitive thing where even   42:59
though I I think there's some concern around all  right are bad guys going to do bad things with   43:04
these models. I actually think you just get a kind  of smarter and safer model for everyone the more   43:12
it's rolled out and the more kind of scrutiny  is on it and then part of that is we get   43:18
feedback and we make the model safer so that is  we roll it out to to more people it's safer   43:23
for more people to use. So I think that the history  of open source in the software industry generally   43:27
would suggest that open source is going to lead  to a more prosperous and safer future. Our show   43:33
is called Huge If True and what I mean by that is  kind of testing the most optimistic non-obvious   43:39
thing and so my question to you is what is the  biggest open genuine question on your mind right 43:46
now? In which field? You're in so many! I am  particularly curious about the combination of   43:51
AI and hardware but I realize that we've covered  a lot so I'm curious the direction you'd take this   44:07
on a question that occupies you right now. Gosh  I mean I think maybe one that's a little more   44:12
AI specific is there a current set of methods  that seem to be scaling very well right so with   44:17
past AI architecture you could kind of feed an  AI system a certain amount of data and and use   44:25
a certain amount of compute but eventually it  hit a plateau and one of the interesting things   44:32
about these new transformer based architectures  over the last you know 5 to 10 years is that we   44:37
haven't found the end yet. So that leads to this  dynamic where Llama 3 you know we could train on   44:44
you know 10 to 20,000 gpus, Llama 4 we could train  on you know more more than 100,000 gpus, Llama 5   44:52
we can plan to scale even further and there's just  an interesting question of how far that goes. It's   44:59
totally possible that at some point we just like  hit a limit and just like previous systems there's   45:06
an asymptote and it doesn't keep on growing but  it's also possible that that limit is not going   45:11
to happen anytime soon and that we're going to be  able to keep on just building more clusters and   45:17
generating more you know synthetic data train the  systems and that they're just going to keep on   45:24
getting more and more useful for people for quite  a while to come and it's a really big and high   45:30
stakes question I think for for the company is  because we're basically making these bets on how   45:36
much infrastructure to build out for the future  and this is like hundreds of billions of dollars   45:42
of infrastructure so like I'm clearly betting  that this is going to keep scaling for a while   45:48
but it's one of the big questions I think in the  field because it is possible that it doesn't. You   45:54
know that obviously would lead to a very different  world where it's I mean I'm sure people still   45:59
figure it out eventually just need to make some  new fundamental improvements to the architecture   46:04
in some way but that might be a somewhat longer  trajectory for okay maybe you know the the kind   46:09
of fundamental AI advances slow down for a bit  and we just take some time to build new products   46:15
around this or it could be the case and that's  what I'm betting on that the fundamental AI will   46:21
just continue advancing for quite a while and that  we're going to get both a new set of products that   46:26
are just really compelling in all these ways  and that the technology landscape and what's   46:31
possible will just continue being dynamic over  like a 20-year period and that's probably what   46:35
I'd guess is going to happen but it I think it's  one of the bigger questions in the industry and   46:42
kind of for technology across the world today.  Is there anything else that you want to say? I   46:46
don't know! Awesome. We're good. Amazing yeah thank  you so much for doing this. Yeah no thank you... 46:52

– English Lyrics

📚 Don’t just sing along to "" – train your ears, learn vocab, and become a language pro in the app!
By
Viewed
4,733,643
Language
Learn this song

Lyrics & Translation

[English]
I'd love to start with these. 10 years of work  right there. Someone on your team called these  
the real life Tony Stark glasses. Very hard  to make each one of these... That makes me feel  
incredibly optimistic... In a world where AI  gets smarter and smarter... This is probably  
going to be the next major platform after  phones... I miss hugging my mom. Yeah haptics  
is hard... How does generative AI change  how social media feels?... We haven't found  
the end yet... The average American has fewer  friends now than they did 15 years ago. Why  
do you think that's happening? I mean  there's a lot going on to to unpack there...
I'm about to interview Meta CEO Mark Zuckerberg. There are not  
that many people with more power over what our  future might look like. Nearly half the total human  
population now uses Meta products and I just  tested some of their new tech that feels like  
science fiction. This is crazy! Mark Zuckerberg and  the team at Meta are imagining a future that billions  
of other people might actually end up living in. So  my goal for this conversation is to try to figure  
out what that future really looks like. To paint a  picture of the future Mark Zuckerberg is trying to  
build so that you can decide for yourself what you  think of it. Welcome to the first episode of our  
new series, Huge Conversations
Hey, good to meet you! Thanks for doing this. Yeah looking forward  
to it. Awesome. I'd love to tell you what my goal  is of this conversation. Go for it. We have a called  
huge if true which is this very optimistic about  science and technology and the potential futures  
that we can build and in every episode we're sort  of exploring what does it look like if you play a  
certain technological future out and so my goal  in this conversation is to try to help people  
see the future that you're imagining when you're  building the products that you and the Meta team  
are building. What are you imagining this looks  like in future? How are you imagining people use  
this? All of that. Cool. All right awesome. So  I'd love to start with these. Let's do it. 10 years  
of work right there! I got to demo them a little  bit earlier today. I heard someone on your team  
call these the real life Tony Stark glasses? We're  getting there. But I'd love to just hear in your  
voice what are these? Well these are the first full  holographic augmented reality glasses I think that  
exist in the world. We've made I think it's a  a few thousand or something right. Very hard to  
make each one of these but this is the culmination  of 10 years of research and and development that  
we've done to basically miniaturize all the  computing that you need to have glasses not a  
headset but glasses that can put full holograms  into the world with a wide field of view. So you  
can imagine sort of in the future we'd be having a  version of this conversation where you know maybe  
I or you are not even here it's like one of us is  physically here and the other one is here as a as  
kind of a full body hologram and it's not just  a video call you can actually interact you can  
do things I mean in the the demo we had the you  know ping pong and games and things like that but  
I mean you could you can interact you can work  together you can you know play poker play chests  
whatever like the holographic cards holographic  board game. I just think it's going to be wild.
it's going to remake I think so many different  fields that we think about today from how we work  
and productivity to a lot of things around science  a lot of things around education entertainment fun  
gaming. But this is just the beginning you  know this is the first version, it's a  
prototype version that we've made in order  to develop the next version which is hopefully  
going to be the consumer one that we sell to  a lot of people. Why build these? Well I think  
it's going to be the next major computing platform.  So if you look at like the grand arc of computing  
over time you've you've gone from like main  frames to computers that basically like live  
on you know your desk or on a tower to phones  that you have in your hand that you basically  
like you know can take with you everywhere that  you want but it's it's pretty unnatural right it  
takes you away from the world around you and. I  think that the trend in computing is it gets more  
ubiquitous it gets more natural and it just  gets more social right so you want to be able  
to interact with people in the world around you  and I think that this is probably going to be  
the next major platform after phones. I'll give  these to you. These are the clear ones that show  
all the... The whole thing is a special edition and  this is like a really special edition. There's  
not a single millimeter of of space. You know  everything in here from the micro projectors that  
um basically shoot light into the wave guides  right it's a special type of display system. I  
mean these aren't normal displays like you have  in a phone or a TV or computer like the type of  
displays that people have been building for  decades. It's a waveguide system. The projector  
that's shooting light basically goes into these  nano etchings across the wave guide that are what  
catches and creates the holograms. In order to  synchronize that with your where you're looking  
there's eye tracking and little cameras,  they illuminate your eyes and then of course  
there's all the basic stuff that you need all the  computing, the batteries to power the whole thing,  
microphones, the speakers because it needs to be  able to play audio and speak with you and the  
cameras and sensors to see things around you in  the world so that way when it's placing holograms  
in the world it can do that in the right place  and understand where you are so that probably  
is still not covering everything because there's  a lot of things that need to go into syncing up  
the holographic images between the two displays  because you don't just have a single display  
like you have in a phone or TV you have two and  it moves around and you know physical things  
are hard and need to be synced up. There's also  the radio that has to communicate with your other  
computing devices to do heavier computing um and  the wrist based neural interface that you probably  
got to try out. We kind of miniaturized all of this  and fit it into uh you know normal looking pair of  
glasses which is... you know when I told the team  that we were going to do this 10 years ago you  
know people weren't sure if we were going to be  able to but I think you not only we're going  
to be able to do this but I think we're going to  be able to get it cheaper and higher quality and  
even even smaller and more stylish over time. So  I think this is going to be a pretty wild future.  
There are so many versions of trying to get  a similar idea of digital objects in physical  
space. I'm thinking of for example of glasses that  have heads up displays where it's headlocked and  
it's moving with my eyes, glasses that are really  creating digital objects in physical space that  
don't move as I move, I'm thinking of these, I'm  also thinking of the Snapchat Spectacles that they  
just announced, then on the other hand there are  headsets like the Quest and also like the Apple  
Vision Pro that seem to fall into a different  category. I'm curious how you would organize this  
landscape for people and how you think about  people using these tools in their real lives  
in the near future? Yeah so when we were getting  started on this about 10 years ago I thought that  
something like this was going to be the ultimate  product for everyone. Right you get to you know  
normal looking pair of glasses and we'll continue  improving that that can have full holographic  
images. I think it's super powerful  and it is sort of the science fiction future that  
I think we all hope to get to. On the journey we  took a few other approaches as well um to help us  
develop towards that including building glasses  that don't have displays to try to learn. Just  
take a stylish pair of glasses today and put as  much technology into it as you can but really  
focus on the form factor and that's the Ray Ban  Meta glasses and it's doing really well and  
initially we thought that that was sort of intro  product for us to learn how to build this but one  
of the things that's clear now is you're going to  be able to make that product a lot more affordable  
than this probably permanently. So I actually think  that there are going to be a bunch of different of  
these paths that we've taken are going to be  kind of permanent product lines that people  
will choose. I think you'll see display-less glasses  like the Ray Ban Metas continue to get better and  
better, great for AI, no display but you can talk  to it, it can talk back. I think there's going to  
be something in between these that's basically a  heads up display, so it's not a 70° field of view,  
maybe it's a 20° or 30 degree field of view,  so that's not going to be what you want for  
putting kind of a full hologram of a person or  interacting with the world around you but it's  
going to be great for you know when you're talking  to AI, not just having voice but also being able  
to see what it's saying or being able to text  someone with your wrist-based neural interface and  
then have their text show up rather than having it  read to you, which is, we read faster than we  
can listen or getting directions right or just  being able to search for information get all that.  
So there's a lot of value for heads up display  that will be somewhat more expensive than the  
display-less but somewhat cheaper than this.  Then I think you're going to get this. It's going  
to be probably the most premium and and expensive  of glasses products but hopefully still something  
that you know like a computer is generally  accessible to most people in the world but I think  
that there are going to be all of those and I  I think people will like them. I also think that  
the headsets that people are using around mixed  reality will continue to be a thing too because  
no matter how good we get at miniaturizing  the tech for this you're just going to be  
able to fit more compute into a full headset.  Fundamentally our mission is not you know build  
something that is advanced and only a few people  can use, we want to take it you the last mile and  
do all the innovation to get it to everyone. We  you know just shipped or announced Quest 3S,  
the new mixed reality headset where we basically are  delivering high quality mixed reality for $299.  
I was really proud last year when we delivered  Quest 3, the first kind of really high quality  
high resolution color mixed reality device for  $500, right it was like, it's like a fraction of  
the cost of of what the competitors are doing  and I think it's actually higher quality in a  
lot of ways, and now we've just doubled down on  that. So I think that they're all actually going  
to end up being important long-term product lines:  display-less, heads up display, full holographic  
AR, full headsets. I think that they're all going  to be important. Yeah. If you play out the future  
of not just the hardware that we've been talking  about so Meta Ray Bans, Quest, Orion, but also  
the Llama models, if everything goes according to  you and the teams wildest dreams, I'd love for  
you to just begin to describe what that feels like.  I mean I think that there are two primary values  
that we're trying to bring. On the AR and kind of  mixed reality side, the main value we're trying to  
bring is this feeling of presence .Right so there's  something that I think is just really deep about  
being physically present with another person that  you don't get from any other technology today and  
I think that's the thing when people have a very  visceral reaction to experiencing virtual or mixed  
reality what they're really reacting to is that  they actually for the first time with technology  
feel a sense of presence like they're in a place  with the person and that's super powerful. I  
focused on designing social apps and experiences  for 20 years that's sort of like the Holy Grail  
of that is being able to build a technology  platform that delivers this like deep sense of  
of social presence. The other big track is around  personalized AI and for that and that's sort of  
where Llama and Meta AI and all those things are  going. There's all this development that's going  
into making the models smarter and smarter over  time but I think where this is going to get  
really compelling is when it's personalized for  you and in order for it to be personalized for you  
it has to have context and understand what's going  on in your life both kind of at a global level and  
like what's physically happening around you right  now and in order to do that I think that glasses  
are going to be the ideal form factor because  they're positioned on your face in a way where  
they can let them see what you see and hear what  you hear which are the two most important senses  
that we use for for kind of taking information  and context about the world. I think that this is  
all going to be kind of really deep and profound  stuff but it's basically those two things: It's  
this feeling of presence and this capability  of really personalized intelligence that can  
help you. I'd love to talk about each of those  two things. The first on presence, I owe a lot  
to being able to connect with people online. Right  this job that I have is by definition that, also with  
my family. My parents don't live anywhere close  to me. I video call them a lot and when I think  
about the progress of technology like this in a  timeline from the telegram to the telephone  
to video call to some feeling of presence with  another person who's feels like they're right  
there in front of me, that makes me feel incredibly  optimistic. I would love a future where like I can  
lose in Scrabble to my mom and feel like she's  really there in front of me. Yeah and it feels like  
we're not that far away from something - I agree! - that persuades my brain that that's happening. Yeah  
totally. And also I miss hugging my mom right like  that never goes away. Yeah haptics is hard. Yeah and  
so my question is about that  it's about this this feeling of like it's hard  
for me to imagine um a future where real physical  presence is not different and special in some way  
where I don't miss literally hugging my  mom and I'm curious how you think about the  
parts of human connection that are eye contact and  physical touch and things that our ape brains  
value for connection with other people. Yeah well eye contact I think we're going to get to a lot before  
the the touch part. For haptics I do think we'll  make progress on that but it's it's obviously  
there's a spectrum there too from kind of hands  which is where if you you draw out the kind  
of like homunculus version of a person in terms  of like what are what are our kind of sensory you  
know what what's like the majority of what we're  sensing it's like yeah yeah so I think being  
able to do that for your hands is probably the  most important place to start and you have a rough  
version of that with controllers today. I think  that that'll get even more over time. We have this  
demo playing pingpong where you have a controller  where as the digital ball hits the ping pong  
paddle you feel it hit the as if it's hitting the  ping pong paddle wherever it is so you actually  
have a sense of like where it's it's hitting  the the the paddle so I think that was that  
was just a wild demo so I think we'll get some of  that the most extreme version of this is wanting  
force feedback right so I mean like for doing a lot  of sports right it's it's like okay we can kind of  
do a good approximation of like boxing today or  you get like good feedback on your hands but it  
would be hard to do a virtual reality version of  Jiu-Jitsu where you're like grappling with someone and  
you need like real kind of force feedback on  that so that's probably like the hardest thing  
right to go do but I think we'll get there.  You know I think like most science fiction it's  
not this binary thing that you just like wake up  one day and we're like oh we've realized all the  
dreams but but I I do think that these platforms  are going to be the first time that I think that  
there's a realistic sense of presence in all  the ways that that's special to people for  
most things that people want to do which are not  the most physical ones and even some of the basic  
physical ones I think we'll get. But then there's  a long tale of other stuff I mean smell is also  
really important for people yeah right it's  I think it's disproportionately important for  
memories and that's not really a thing that  I think in the next few years we're going to  
have in any of these devices I mean that's a very  difficult and challenging thing on its own. What is  
the piece of that that you feel most interested in,  that you keep coming back to in your mind? This has  
the frustrating property to develop that the  sense of presence is almost like when you're  
designing something that that's sort of trying  to artificially deliver it you're delivering  
an illusion to a person and more than any one  thing that provides a sense of presence it's  
actually more the case that any one thing done  wrong breaks the sense of presence. You kind  
of know that you're interacting with technology  but it's so convincing that um that you just kind  
of go along with it. You're like okay yeah no this  person feels like it feel like they're there right.  
When I did that pingpong demo I like at the end  of it I dropped the pingpong paddle on the virtual  
table and it shattered so that was not the best  for for our internal development but  
like that's winning in our in our development  right it's like when when you feel like something  
is is kind of so realistic that you you're just  convinced that um that it's there now and there  
are a lot of things that can break that right so  I think a a field of view that's too low right so  
something feels real but then you turn your head  and it's not there um latency read physics that  
don't behave like realistic physics. It also is  interesting in some ways what people can accept  
as physically real even though it's not right  so like we've done a ton of work on avatars we  
we have this whole work stream on Kodak avatars  to do these photo avatars and it's I think it's  
going to be incredbly compelling and people are  going to love it but one of the things I found  
interesting is the ability to mix photorealistic  and expressive kind of the cartoony avatars with  
photorealistic worlds and kind of more cartoony  computer game type worlds so you can have the  
a Kodak kind of photorealistic avatar of a  person in what is clearly like a video game  
or cartoon world and people are generally  pretty fine with that it's like okay that  
that feels pretty good and similarly having  a photorealistic world but good increasingly  
good kind of cartoon avatars as long as the  avatars move in a way that feels authentic to  
the person you're interacting with it actually  feels pretty good you know it's when you look at  
a 2d still frame of it some of the stuff can  look a little bit silly and and we've certainly  
you know had had a our share of memes around  that but um but when you're in there you know and  
you you've played around with lot of the stuff it  feels realistic because it's basically mimicking  
the kind of authentic mannerisms of of a person  that you're interacting with and even if it's not  
a Kodak photo realistic avatar if it's kind of  a more cartoony expressive one so I I think that  
that's it's very interesting to see kind of  which pieces you need to unlock and what where you  
just need to be like very technically excellent  and consistent but it's um this isn't a space  
where it's like you deliver one thing and it's  good this is like there's a wide breth of things  
that you need to nail and then have it all come  together and that's why these are you know 10 year
projects. It seems like an interesting way to learn  about the human brain and what we actually care  
about with respect to what feels real. I was  wondering about, there was this moment in an  
interview that you did with Lex Friedman, you quoted  research that says that the average American has  
fewer friends now than they did 15 years ago  and I was so interested in that because  
it seems like if we want to get to a world where  there's more human connection this is the trend  
that we're going to have to grapple with and just  to give some data on this in the American Time Use 
Survey over the last 20 years the amount of time  American adults spend socializing in person has  
dropped by nearly 30%. For ages 15 to 24 according  to the Surgeon General it's nearly 70%. and I  
look at that data and I think to myself well maybe  if we're all socializing digitally that doesn't  
matter so much maybe there's a future where that's  actually fine but there's also data that suggest  
that we're struggling somewhat. The number of  Americans who say that they don't have a single  
close friend - yeah it's really sad - that share has jumped from 3% to 12% in the last 30 years. It feels to
me like with all the tools that we've built for human connection, we're struggling to connect and I'm curious  
why do you think that's happening? I mean there's a lot  going on to to unpack there. A lot has changed  
sort of economically and socially during that  period and a lot of those trends go back before  
a lot of the modern technology. So I mean this  is something that a lot of academics and folks  
have have studied but it is an interesting lens  to look at this though because I think whenever  
you're talking about building digital types  of connection one of the first questions that  
you get is is that going to replace the physical  connection and my answer to that especially in the  
case of something like this is that no because  people already don't have as much connection  
as they would like to have. It's not like this is  replacing some sort of better physical connection  
that they would have otherwise had. It's that the  average person would like to have 10 friends and  
they have two right or three and there's just  more demand to socialize than what people are  
able to do given the current construct and giving  people the ability to be present with people who  
are in other places physically just seems like  it will unlock more. It's not going to make it  
so, if I have glasses, it's not going to make  it that I spend less time with my wife, it's going  
to make it so that I spend more time with you  know my sister who lives across the country. And  
that's, I think that's good. I  think people need that. As for the rest, I  
I think we could probably spend a multi-hour  podcast just going into all of the different  
kind of socioeconomic political dynamics that are  going on but none of the trends that I've seen  
does it seem like the primary thing that's going  on is that because people are interacting online  
they're now not interacting with their with people physically. Now certainly I think you  
you I do interact with people online who I also  like to interact with physically but and I think  
that that's kind of like a combination um like  more combined richer relationship that you have  
overall but I think that there's a lot going  on with the loss of of kind of social capital and  
connections that really predates a lot of the  modern technology. The goal of what, I'm what I'm  
trying most to learn about is how we can structure  the technologies that we use in the future to get  
toward this future I think you're imagining of  more human connection in more ways. I'm curious, you  
brought up the other big pillar of AI and in some  of your conversations, I'm thinking of a conversation  
with Tim Ferris in particular, you talked about  a lot of different use cases of AI and they seem  
to me to fall on somewhat of a spectrum. Like  for example you mentioned automatic real-time  
translation, like basically the Star Trek  Universal translator. We're pretty  
much there! Yeah and that's one example on one  end of the spectrum where some people might argue  
that there is a chance that someone is less likely  for example to learn a language because we can all  
speak to each other in real time in different  languages. I think nobody would really argue  
that therefore we shouldn't have that kind of  universal translator. People still learn Latin and  
Greek. Right exactly and so I think that end  of the spectrum is something like um technologies  
that really measurably unlock our humanity because  they remove a struggle between people and then on  
the other end of the spectrum there are a lot of  educational things for example where the struggle  
is kind of the point right? Like it's like building  a muscle. I can think of so many times  
in my life where like the reason why I was doing  something was not the output it was the fact that  
I was trying so hard to do it. There's one example  in the Tim Ferris interview where you talked  
about your kids struggling to articulate  themselves emotionally and adults very much had  
the same problem and you talked about AI as a way  to help them articulate those emotions. Yeah and  
I thought about all of the many times in my life  where I have struggled to articulate my emotions  
and how I really could have used some help in  those moments and I also found myself thinking  
about the times when that was really building  a muscle where like the act of struggling to  
communicate with someone and understand what they  wanted from me was was important to my development.  
And so my question is if you think about that  as a spectrum between things that are really  
important to our humanity where and the struggle  being removed is helpful versus things where the  
struggle is the point and it unlocks  something about our humanity and is important  
to preserve like building a muscle, how do you  draw the line between those things and how do  
we ensure that the muscles that we're building for  this future are stronger and not weaker? Yeah it's  
interesting I mean I think we're always going to  find new things to struggle with and I mean it's  
you can always get better at communicating with  other people and kind of expressing yourself and  
understanding other people so having a tool that  can help you do that better isn't going to mean  
that like oh now we perfectly understand every you  know it's I mean I think the maybe one  
of the most functional aspects of this you're  already seeing a lot of these AI models really  
help people with coding right like a generation  ago um before I was getting started a lot of  
coding was like really low-level system software  and you know then by the time that I got into  
it there was a little bit of that but um you you  can make websites pretty easily make apps pretty  
easily and I think in 20 years or a lot sooner  than that you're going to basically be in a  
world where kids will be able to just describe the  things that they want and build incredibly complex  
pieces of software so it's um in that world  are kids going to be not struggling I I don't  
think so I think that they're going to be just  expressing their creativity and and it'll it'll  
be this kind of constant iterative feedback loop  around like okay like yeah I you know took a few  
minutes to describe this thing and like yeah this  whole like amazing virtual world was created that  
I can have see on my glasses or whatever but like  these things are not exactly what I want them to  
be so now I need to like go back and edit them it  just I don't know I think that there's always  
more. Another way to get this - it's one of the things  that I think makes makes people so good. It just  
there's there's always more to do. We'll always  find the struggle? Yeah. Another way to get at this  
is if you if you play this out to make the  tools even better in like 10 years let's say  
your kids are in high school are there ways that  you would want them using AI because you think it  
would accelerate them intellectually and ways that  you would advocate for them not to use it or  
things that you would have concerns about? I mean  I think that there's some things that you need  
to be able to do yourself. I think that's a lot of  the basic fear that people have around this is 
that while we're building these amazing tools we  get away from this self-confidence and ability of  
being able to do like this basic stuff yourself so  it's like all right you have a calculator but it's  
still good to be able to do kind of basic math in  your head because there are a lot of things that  
come up throughout the day that you just want to  have a general numeracy around right that often  
they're not expressed in numerical terms but just  in terms of understanding trends or understanding  
arguments that people are making, you you kind of  need to understand the shape of how numbers come  
together and so I think one of the big debates  is like should we still teach our kids to program  
computers even though you're going to have these tools in the future that are just so much  
more powerful than anything that we have now to  produce incredibly complicated pieces of software.  
I think the answer to that is probably yes  because I think teaching someone how to code  
is teaching them a way to think rigorously and  that even if they're not doing most of the code  
production I think it's important that you kind of  have the ability to think in that way and I think  
it's going to just make you generally a better  thinker and better person so yeah maybe that's  
like this generation's version of calculators  it's like so you you want to you want to use the  
calculator but you'll also want to be able to  generally do without it. Other ones like language  
I don't know I mean different people can come  out I think this is one of the interesting  
questions about parenting these days is like is  is just kind of like what what's important to  
teach your your kids and in an era where so much  is going to change over the the time that they're  
even in school. Language I think you can make  similar arguments. I think there's a lot of it's  
like it's probably going to be less functionally  relevant in the future to learn multiple languages  
but it sort of helps you think in different ways, you know I found from the languages that I've  
studied that a lot of it you learn about  the structure of your own language, you can  
you know you also learn about the culture right  because so much of how things are expressed in  
different places is tied to the nuance and the  history of kind of what how so I think  
like you that's all valuable and interesting  stuff to get into but then I don't know at the  
same time we only have so many hours in the day  so people need to prioritize what they're going  
to learn and it may be that okay in a world with  perfect translation which by the way we basically  
just announced on the Ray Ban Metas that now  you're going to be able to just like you go to  
countries yeah we're starting out with just a few  languages but we'll roll it out to more and you  
know you'll be you could be traveling anywhere and  you have your glasses and they just translate in  
real time in your ear. So it's wild, yeah so  I think people are going to need to choose what  
what what they want to focus on going forward.  How do the developments that we've been talking  
about in AI intersect with social media and the  platforms that most people use today? There's a 
future where there's images and generated text  and maybe AI influencers. How does generative  
AI change how social media feels in the future?  Yeah I mean I think that that's a really  
deep one. You know there's already been one  big shift which is that social media started  
out as people primarily interacting with their  friends and now it is you know at least half of  
the content is basically people interacting  with creators or content that's not created  
by people who they kind of personally know so  we sort sort of already have that paradigm and  
I think AI is probably going to accelerate that. It  will give all these people additional tools right  
so your friends will create kind of funnier memes  and more interesting content um that'll come from  
a lot of different ways. I think some of it will  be okay your friends have glasses and they capture  
a bunch of stuff and before they might have not  been able bble to edit it to make it interesting  
or maybe it was just too much work or they didn't  even realize that they captured something amazing  
but now the AI is like hey I like made this thing  for you out of your content um it's like okay  
that's awesome like people will enjoy that. Creators  obviously kind of much more specialized skills  
are going to be able to use even more advanced AI  tools to make more compelling content but then I  
think that there will be a bunch of kind of green  field type stuff where maybe in the future there  
will be content that is purely generated by AI  by the system personalized for you maybe it's  
summarizing things that are out there that that  are going to be interesting maybe it's um just  
producing something funny that makes you laugh  this is going to be like a very kind of deep zone  
that there's a lot to to experiment with.  I think there are going to be AI creators as well, 
as creators building AI versions of themselves,  I mean that's a thing that we just showed too  
at Connect is basically I mean if you're a Creator one of the big challenges is  
like all right there are only so many hours  in the day and your community probably has a  
nearly unlimited demand to interact with you and  you want to interact with them because you're  
trying to grow your community. I mean that's both  socially and from a business perspective that's  
sort of you know growing the community is an  important part of what every creator does so  
okay if we can make it so that each creator  can basically make an like an AI artifact  
that their community can interact with people be  clear it's not the actual creator themselves but  
it's almost like a piece of digital art that  you're producing like an interactive sculpture  
or something that it's like it's like you train  it to here's the context that I wanted to have  
here's the topics I wanted to communicate  on here's stuff that I wanted to stay away  
from you're giving your community something to  interact with when you can't be there to to kind  
of answer all the questions and I think that's  going to be super compelling so there's like  
these interesting things but I think it's I AI  it's kind of like the internet in a way where  
it's probably going to change almost every field  and almost every feature of every application that  
we use um it seems sort of hyperbolic to say that  but I do think that's true and it's just hard to  
sort of enumerate all the different things up  front but I think that over the next 5 to 10  
years we're just going to explore the impacts  in each of these areas and it's going to be  
like an amazing amount of innovation and really  exciting. I feel two things simultaneously when  
you say that. I feel both like I really want  to be optimistic about the future of these  
platforms and I obviously have gained so much from  an enormous pace of change right like everything  
that we're doing now and what I actually feel is  worried. I feel some specific concerns around the  
way that you know I might communicate with an  audience and the way that they might respond to  
that or the way that human communication might  change but also more generalized just sort of  
fear of the pace of change and and worry and I  don't think I'm alone in that feeling. Yeah and  
you're supposed to be the optimist! I know! And I'm  curious like how you talk to people who feel that  
way. What concerns do you feel are most legitimate  and what do you feel most misunderstood? I think  
the pace of change is always a concerning  thing right it's there is a lot of uncertainty  
about how how things will go in the future and  we're all going to get really amazing new tools  
to do both our hobbies and our jobs and they'll make it so we can do better work and  
have better lives but at least on the professional  side it's going to be our responsibility to keep  
up with that or else it's going to be difficult  for us to compete with other people who are  
doing a good job of kind of keeping up with  the new trends. So I get it. I mean I think  
you know especially in the you know line of of  work of being a creator and it's a very sort of  
competitive space, I don't think that like creators  necessarily think about it as competitive but it  
is right it's like it's you know and um and so I  get it. I think that this is going to make it so  
that like the quality of work that people produce  and how interesting it is and how much they can  
communicate and like really efficiently is is  just going to kind of go through the roof but  
but when you're staring down a set of changes like  you know that there's some big change coming and  
you don't know what it is that's always a time of  anxiety so I get it. If I take my creator hat  
off and I'm just a person who is youngish starting  out my career-ish, starting out building a family,  
how would you advise someone like me to prepare  well for the future that we're headed toward  
to be able to learn new skills now or just think  about this future in an educated way? Yeah I mean  
I just think maintaining curiosity about things is  is important. I do think we can overstate to what  
extent the next 10 years is going to be sort of  different from the last 10 or 15. I mean a ton of  
stuff changed over the last 10 or 15 years too.  It's not like this is the only time in history  
where there's some technology it's going to make  it so there's new opportunities and things change  
the internet coming into maturity and everyone  having smartphones has already rewired things  
dramatically and I mean maybe the next period will  be a somewhat bigger change or maybe it won't I  
think it'll feel different to different people but I don't think this is like going from zero to  
one it's not like okay everything's just kind of  been normal and now like now it's about to change  
it's like the technology of evolves over time and  and like the opportunities that we have evolve and  
improve and I think that's like the people who  do well I think are are people who are generally  
curious about it and and dig in and and try  to use it to live better lives rather than the  
people who who basically you know try to fight it  in in some way. One thing that I really want to ask  
you about is open source. Yeah. I think imagine that  we're talking to an audience that has maybe heard  
that term but doesn't have any real idea of how  that might impact them in the development of AI. 
How would you explain the reasonable debate  that people in your field are having about this  
right now? Well I think there are two pieces. I mean  so what does open source mean? It means that people  
can build a lot of different things right so at  a high level I look at the vision that a bunch of  
companies have right so Open AI, Google, they're  building an AI right like one AI that I think  
in general they're like okay this is going to be  it's like you're going to use they think you're  
going to use Gemini or ChatGPT for like all the  different things that you want to interact with  
and at a high level that's just not how I think  the world is going to go. I think we're going to  
have a lot of different AI systems just like we're  going to have we have a lot of different apps.  
I think in the future every business just like  they have a website and a phone number and an  
email address and a social media account is also  going to have an AI that can interact with with  
their customers to help them sell things to help  them do support. I think a lot of creators will  
have their own AIs right I think like a lot  of people will interact with with a bunch of  
different things. There's a question of okay do you  want a future that's fundamentally kind of very  
concentrated and where you're interacting with  kind of one system for everything or do you want  
one where a lot of different people are building a lot of different AIs and systems just kind  
of like you probably didn't want there to be you  know just one app or just one website. It's like a  
richer world when there's a diversity of different  things so that's one piece is is just giving  
people the ability to build it themselves and  what open source does it makes it that everyone  
can take and modify the model and build stuff on  top of it which is different from the kind  
of closed and centralized approach. The safety  debate is a specific part of this which is in a  
world where AI gets smarter and smarter, what's the  way that we have the highest chance of of having a  
a a kind of positive future and and not having  a lot of the safety concerns? And I think some  
people think that if we keep the model closed  and don't give it to a lot of developers that  
should make it safer because then you don't get  bad developers doing bad things with the model.
Historically I think what we've seen with open  source is actually the opposite which is that  
this is not the first open source project right  I mean this is obviously this has been a thing in  
the industry for decades and I think what we've  traditionally seen is that open source software  
is safer and more secure largely because you put  it out there more people can scrutinize it because  
they can see all parts of the system and then  there are inevitably issues with any software  
there are bugs there are security issues and  initially with open source people thought hey if  
you're putting the software out there and there  are holes in it isn't everyone just going to go  
exploit those holes and especially the bad  guys but it turned out that it sort of in this  
counterintuitive way that by making by adding more  scrutiny to the systems the holes became apparent  
quicker and then were fixed and then people  roll out a new version just like we roll out  
a new version of our models right Llama 3, Llama  3.1, Llama 3.2 everyone upgrades, so I think the  
same thing is going to happen here I think it's  sort of this counterintuitive thing where even  
though I I think there's some concern around all  right are bad guys going to do bad things with  
these models. I actually think you just get a kind  of smarter and safer model for everyone the more  
it's rolled out and the more kind of scrutiny  is on it and then part of that is we get  
feedback and we make the model safer so that is  we roll it out to to more people it's safer  
for more people to use. So I think that the history  of open source in the software industry generally  
would suggest that open source is going to lead  to a more prosperous and safer future. Our show  
is called Huge If True and what I mean by that is  kind of testing the most optimistic non-obvious  
thing and so my question to you is what is the  biggest open genuine question on your mind right
now? In which field? You're in so many! I am  particularly curious about the combination of  
AI and hardware but I realize that we've covered  a lot so I'm curious the direction you'd take this  
on a question that occupies you right now. Gosh  I mean I think maybe one that's a little more  
AI specific is there a current set of methods  that seem to be scaling very well right so with  
past AI architecture you could kind of feed an  AI system a certain amount of data and and use  
a certain amount of compute but eventually it  hit a plateau and one of the interesting things  
about these new transformer based architectures  over the last you know 5 to 10 years is that we  
haven't found the end yet. So that leads to this  dynamic where Llama 3 you know we could train on  
you know 10 to 20,000 gpus, Llama 4 we could train  on you know more more than 100,000 gpus, Llama 5  
we can plan to scale even further and there's just  an interesting question of how far that goes. It's  
totally possible that at some point we just like  hit a limit and just like previous systems there's  
an asymptote and it doesn't keep on growing but  it's also possible that that limit is not going  
to happen anytime soon and that we're going to be  able to keep on just building more clusters and  
generating more you know synthetic data train the  systems and that they're just going to keep on  
getting more and more useful for people for quite  a while to come and it's a really big and high  
stakes question I think for for the company is  because we're basically making these bets on how  
much infrastructure to build out for the future  and this is like hundreds of billions of dollars  
of infrastructure so like I'm clearly betting  that this is going to keep scaling for a while  
but it's one of the big questions I think in the  field because it is possible that it doesn't. You  
know that obviously would lead to a very different  world where it's I mean I'm sure people still  
figure it out eventually just need to make some  new fundamental improvements to the architecture  
in some way but that might be a somewhat longer  trajectory for okay maybe you know the the kind  
of fundamental AI advances slow down for a bit  and we just take some time to build new products  
around this or it could be the case and that's  what I'm betting on that the fundamental AI will  
just continue advancing for quite a while and that  we're going to get both a new set of products that  
are just really compelling in all these ways  and that the technology landscape and what's  
possible will just continue being dynamic over  like a 20-year period and that's probably what  
I'd guess is going to happen but it I think it's  one of the bigger questions in the industry and  
kind of for technology across the world today.  Is there anything else that you want to say? I  
don't know! Awesome. We're good. Amazing yeah thank  you so much for doing this. Yeah no thank you...

Key Vocabulary

Start Practicing
Vocabulary Meanings

optimistic

/ˌɒptɪˈmɪstɪk/

B2
  • adjective
  • - hopeful and confident about the future.

platform

/ˈplæt.fɔːrm/

B1
  • noun
  • - a type of media or technology.

haptics

/ˈhæptɪks/

C1
  • noun
  • - the science and technology of touch.

generative

/ˈdʒenərətɪv/

C1
  • adjective
  • - relating to or capable of generating something.

average

/ˈævərɪdʒ/

A2
  • adjective
  • - typical or usual.

friends

/frendz/

A1
  • noun
  • - people whom one knows and with whom one has a bond of mutual affection.

future

/ˈfjuːtʃər/

A2
  • noun
  • - the time yet to come.

power

/ˈpaʊər/

B1
  • noun
  • - the ability to control people or events.

population

/ˌpɒpjuˈleɪʃən/

B2
  • noun
  • - the number of people living in a particular area.

tested

/ˈtestɪd/

A2
  • verb
  • - to try something to find out if it works.

tech

/tek/

B1
  • noun
  • - technology.

fiction

/ˈfɪkʃən/

B2
  • noun
  • - literature in the form of novels, short stories, etc.

imagine

/ɪˈmædʒɪn/

B1
  • verb
  • - to form a mental image of something.

build

/bɪld/

A2
  • verb
  • - to construct something.

potential

/pəˈtenʃəl/

B2
  • noun
  • - having or showing the capacity to become or develop into something in the future.

miniaturize

/ˌmɪnɪəˈtaɪz/

C1
  • verb
  • - to reduce something to a very small size.

Are there any new words in “” you don’t know yet?

💡 Hint: optimistic, platform… Jump into the app and start learning now!

Key Grammar Structures

  • Someone on your team called these the real life Tony Stark glasses?

    ➔ Indirect Question

    ➔ The sentence uses 'called' to report what someone said, turning a direct question into an indirect one. Note the word order change (subject-verb) and the lack of a question mark at the end.

  • This is probably going to be the next major platform after phones...

    ➔ Future Progressive with Probability

    ➔ The use of 'going to' indicates a future intention or prediction. 'Probably' adds a degree of uncertainty. The progressive aspect ('going to be') suggests a process unfolding over time.

  • I think we're going to be able to get it cheaper and higher quality and even even smaller and more stylish over time.

    ➔ Comparative and Superlative Adjectives with Intensifiers

    ➔ The sentence uses comparative adjectives ('cheaper', 'higher quality', 'smaller', 'more stylish') to show increasing levels of these qualities. The repetition of 'even' intensifies the comparison.

  • We've made I think it's a few thousand or something right.

    ➔ Tag Question

    ➔ The 'right?' at the end is a tag question, seeking confirmation from the listener. It's a common feature of informal spoken English.

  • It's a special edition and this is like a really special edition.

    ➔ Intensifying Adverbs and Repetition for Emphasis

    ➔ The use of 'really' before 'special' intensifies the adjective. Repeating the phrase emphasizes the uniqueness and value of the item.

Related Songs