Display Bilingual:

PATRICK WINSTON: The Uniform Code of Military Justice 00:19
specifies court martial for any officer who sends a soldier 00:23
into battle without a weapon. 00:27
There ought to be a similar protection for students 00:30
because students shouldn't go out 00:32
into life without the ability to communicate, 00:34
and that's because your success in life 00:38
will be determined largely by your ability to speak, 00:40
your ability to write, and the quality of your ideas, 00:43
in that order. 00:47
I know that I can be successful in this 00:50
because the quality of communication, 00:52
your speaking, your writing, is largely 00:57
determined by this formula. 00:59
It's a matter of how much knowledge you have, 01:01
how much you practice with that knowledge, 01:05
and your inherent talent, and notice 01:07
that the T is very small. 01:10
What really matters is what you know. 01:12
This point came to me suddenly a few decades ago when 01:15
I was skiing at Sun Valley. 01:19
I had heard that it was Celebrity Weekend, and one 01:22
of the celebrities was Mary Lou Retton, 01:25
famous Olympic gymnast, perfect 10s in the vault. 01:30
And I heard that she was a novice at skiing, 01:35
so when the opportune moment arrived, 01:38
I looked over on the novice slope 01:40
and saw this young woman who, when she became unbalanced, 01:42
went like that. 01:46
And I said that's got to be her. 01:48
That must be the gymnast. 01:50
But then, it occurred to me, I'm a much better skier 01:53
than she is, and she's an Olympic athlete-- not only 01:56
an ordinary Olympic athlete, an outstanding one. 01:58
And I was a better skier because I had the K, and I had the P, 02:03
and all she had was the T. So you 02:08
can get a lot better than people who 02:10
may have inherent talents if you have 02:12
the right amount of knowledge. 02:15
So that's what my objective is today, and here's my promise. 02:17
Today, you will see some examples 02:20
of what you can put in your armamentarium of speaking 02:24
techniques, and it will be the case 02:28
that some one of those examples, some heuristic, some technique, 02:32
maybe only one, will make-- 02:37
will be the one that gets you the job. 02:40
And so this is a very non-linear process. 02:43
You never know when it's going to happen, 02:45
but that is my promise. 02:47
By the end of the next 60 minutes, 02:48
you'll have been exposed to a lot of ideas, some of which 02:52
you'll incorporate into your own repertoire, 02:55
and they will ensure that you get the maximum opportunity 02:58
to have your ideas valued and accepted 03:03
by the people you speak with. 03:09
Now, in order to do that, we have 03:11
to have a rule of engagement, and that 03:14
is no laptops, no cell phones. 03:17
So if you could close those, I'll 03:22
start up as soon as you're done. 03:24
Some people ask why that is a rule of engagement, 03:27
and the answer is, we humans only 03:31
have one language processor. 03:34
And if your language processor is enga-- 03:36
could you shut the laptop, please? 03:38
If your language processor is engaged browsing the web 03:40
or reading your email, you're distracted. 03:44
And worse yet, you distract all of the people around you. 03:48
Studies have shown that. 03:50
And worse yet, if I see a open laptop somewhere back 03:52
there or up here, it drives me nuts, and I do a worse job. 03:56
And so that ensures that all of your friends 04:02
who are paying attention don't get the performance 04:04
that they came to have. 04:08
So that's it for preamble. 04:11
Let's get started. 04:13
First thing we talk about, of course, is how to start. 04:16
Some people think the right thing to do 04:25
is to start a talk with a joke. 04:28
I don't recommend it, and the reason 04:39
is that, in the beginning of a talk, 04:44
people are still putting their laptops away. 04:46
They're becoming adjusted to your speaking parameters, 04:49
to your vocal parameters, and they're not ready for a joke. 04:52
So it doesn't work very well. 04:58
They usually fall flat. 05:00
What you want to do instead is start with empowerment promise. 05:02
You want to tell people what they're 05:09
going to know at the end of the hour 05:11
that they didn't know at the beginning of the hour. 05:13
It's an empowerment promise. 05:16
It's the reason for being here. 05:17
What would be an example? 05:21
Oh, I see. 05:22
At the end of this 60 minutes, you will know things 05:24
about speaking you don't know now, 05:28
and something among those things you know 05:30
will make a difference in your life. 05:32
Yeah, that's an empowerment promise, 05:34
so that's the best way to start. 05:36
So now that I've talked a little bit about how to start, 05:38
what I want to do is give you some samples of heuristics 05:41
that are always on my mind when I give a talk, 05:44
and first of these heuristics is that it's a good idea to cycle 05:48
on the subject. 05:53
Go around it. 05:56
Go round it again. 05:57
Go round it again. 05:59
Some people say, tell him what you want to tell him. 06:01
Tell him again, and then tell him a third time, 06:05
as if people weren't intelligent. 06:08
But the point is-- 06:11
the reason is-- well, there are many reasons, one of which 06:12
is, at any given moment, about 20% of you 06:16
will be fogged out no matter what the lecture is. 06:19
So if you want to ensure that the probability that everybody 06:22
gets it is high, you need to say it three times. 06:24
So cycling is one of the things that I always 06:29
think about when I give a talk. 06:31
Another thing I think about is, in explaining my idea, 06:33
I want to build a fence around it so that it's not confused 06:38
with somebody else's idea. 06:45
So if you were from Mars, and I was teaching you 06:48
about what an arch is, I might say to you, 06:50
well, that's an arch. 06:53
And that's not to be confused with some other things 06:55
that other people might think is-- 06:57
this is not an arch. 06:58
That's not an arch. 07:02
I'm building a fence around my idea 07:04
so that it can be distinguished from somebody else's idea. 07:05
So in a more technical sense, I might say, well, 07:09
my algorithm might similar-- 07:12
might seem similar to Jones's algorithm, 07:13
except his is exponential, and mine's linear. 07:15
That's putting a fence around your idea 07:18
so that people can not be confused about how it 07:19
might relate to something else. 07:22
The third thing on this list of samples 07:26
is the idea of verbal punctuation. 07:30
And the idea here is that, because people 07:44
will occasionally fog out and need to get back on the bus, 07:48
you need to provide some landmark places where 07:52
you're announcing that it's a good time to get back on. 07:56
So I might, in this talk, say something 08:00
about this being my outline. 08:02
The first thing we're going to do is talk about how to start. 08:05
Then we're going to deal with these four samples, 08:09
and among these four samples, I've 08:11
talked about the first idea-- that's cycling. 08:13
The second idea, building-- and now, 08:16
the third idea is verbal punctuation. 08:18
So I'm enumerating and providing numbers. 08:22
I'm giving you a sense that there's a seam in the talk, 08:24
and you can get back on. 08:28
So now, we're on a roll, and since we're on a roll, 08:33
can you guess what fourth idea might be here-- 08:38
an idea that helps people get back on the bus? 08:42
AUDIENCE: Ask a question. 08:48
PATRICK WINSTON: Yes? 08:51
AUDIENCE: Ask a question. 08:52
[INAUDIBLE] 08:53
PATRICK WINSTON: Ask a question, yes. 08:53
Thank you. 08:55
So ask a question. 08:58
And so I will ask a question-- how much dead air can there be? 09:05
How long can I pause? 09:09
I counted seven seconds. 09:11
It seemed like an eternity to me to wait and not say anything 09:13
for seven seconds, but that's the standard amount of time 09:16
you can wait for an answer. 09:19
And of course, the question has to be carefully chosen. 09:20
It can't be too obvious because then people 09:23
will be embarrassed to say it, but the answers can't 09:25
be too hard because then nobody will have anything to say. 09:28
So here are some sample heuristics 09:32
you can put in your armamentarium 09:34
and build up your repertoire of ideas about presentation. 09:37
And now, if this persuades you that there 09:43
is something to know, that there is knowledge, 09:47
then I've already succeeded because what I want to convince 09:52
you of, is if you watch the speakers you admire and feel 09:55
are effective, and ask yourselves 09:59
why they're successful, then you can 10:01
build up your own personal repertoire 10:03
and develop your own personal style. 10:06
And that's my fundamental objective, 10:08
and the rest of this talk is about some 10:10
of the things that are in my armamentarium 10:12
that I think are effective. 10:15
So next thing on our agenda, as we 10:17
start to discuss these other things, 10:20
is a discussion of time and place. 10:22
So what do you think is a good time to have a lecture? 10:25
11 AM? 10:30
Yeah. 10:31
And the reason is most people at MIT are awake by then, 10:38
and hardly anyone has gone back to sleep. 10:44
It's not right after a meal. 10:48
People aren't fatigued from this or that. 10:50
It's a great time to have a lecture. 10:52
So that brings me, next, to the question of what 10:54
about the place? 10:56
And the most important thing about the place 10:58
is that it be well lit. 11:01
This room is well lit. 11:09
Problem with other kinds of rooms is that we humans, 11:11
whenever the lights go down, or whenever 11:16
the room is dimly lighted, it signals 11:18
that we should go to sleep. 11:21
So whenever I go somewhere to give a talk, 11:23
even today, the first thing I do when 11:25
I speak to the audio-visual people 11:27
is say, keep the lights full up. 11:29
Oh, they might reply, people will see the slides better 11:34
if we turn the lights off, and then I reply, 11:39
it's extremely hard to see slides through closed eyelids. 11:42
What else can you say about the place? 11:50
Well, the place should be cased, and I 11:53
mean that in a colloquial sense, of like if you're 11:58
robbing a bank, you would go to the bank 12:01
some occasions before to see what it's like, 12:05
so there are no surprises when you do your robbery. 12:08
So whenever I go somewhere to speak, 12:13
the first thing I ask my host to do is to take me to the place 12:15
where I'll be speaking so that if there are any weirdnesses, 12:18
I'll be able to deal with it. 12:22
Sometimes, it might require some intervention. 12:26
Sometimes, it just might require me to understand 12:29
what the challenges are. 12:31
So when I came here this morning, 12:33
I did what I typically do. 12:36
I imagined that all the seats were 12:39
filled with disinterested farm animals, 12:40
and that way, I knew that, no matter how bad it was, 12:44
it wouldn't be as bad as that. 12:46
So finally, it should be reasonably-- 12:51
it should be reasonably populated. 12:55
It should be the case that-- 13:03
if there were 10 people in this hall, 13:07
everyone would be wondering, what's 13:09
going on that's so much more interesting that nobody's here. 13:11
So you want to get a right sized place that's-- 13:14
doesn't have to be packed, but it 13:17
has to be more than half full. 13:18
So those are some thoughts about a time and place. 13:20
Next thing I want to talk about is a subject 13:24
of boards and props and slides. 13:27
Well, these are the tools of the trade. 13:38
I believe that this is the right tool for speaking 13:41
when your purpose is informing. 13:49
The slides are good when your purpose is exposing, 13:52
but this is what I use when I'm informing, teaching, lecturing, 13:56
and there's several reasons why I use it. 14:00
For one thing, when you use the board, 14:02
you have a graphic quality. 14:04
It's the case that, when you have a board, then 14:10
you can easily exploit the fact that you can use graphics 14:14
in your presentation. 14:19
So that's the graphic quality that I like, and the next thing 14:22
I like is the speed property. 14:25
The speed with which you write on the blackboard 14:30
is approximately the speed at which people can absorb ideas. 14:32
If you go flipping through a bunch of slides, 14:36
nobody can go that fast. 14:39
Finally, one great property of a board 14:44
is that it can be a target. 14:47
Many people who are novices at speaking 14:53
find themselves suddenly aware of their hands. 14:59
It's as if their hands were private parts that shouldn't 15:04
be exposed in public, so right away, they go into the pockets, 15:06
and this is considered insulting in some parts of the world. 15:10
Or alternatively, maybe the hands 15:14
will go in back like this. 15:16
I was once in a convent in Serbia, and my host-- 15:19
as soon as we entered, a nun came up to us 15:27
and offered us a refreshment. 15:30
And I was about to say, no, thank you, 15:32
and he said, eat that stuff or die. 15:33
It's a question of local custom and politeness. 15:38
But then before anything happened there, 15:42
the nun pulled my hands out like this 15:46
because it was extraordinarily insulting in that culture 15:49
to have your hands behind your back. 15:52
So why is that? 15:54
Well, it's usually supposed that that's 15:56
that it has to do with whether you're concealing a weapon. 15:59
So if your hands are in your pockets or behind your back, 16:02
then it looks like you might have a weapon, 16:05
and that's what I mean by the virtue-- 16:09
one of these virtues of the board. 16:12
Now, you have something to do with your hands. 16:13
You can point out the stuff. 16:15
I was once watching Seymour Papert give a lecture, 16:20
and I thought it was terrific. 16:22
So I went a second time-- 16:24
first time to absorb the content, second time 16:25
to note style. 16:28
And what I discovered is that Papert was constantly 16:29
pointing at the board. 16:32
And then I thought about it a little while, 16:33
and I noted that none of the stuff he was pointing to 16:35
had anything to do with what he was saying. 16:38
Nevertheless, it was an effective technique. 16:43
So that's just a little bit about the virtue 16:49
of blackboards. 16:52
Now, I want to talk about props. 16:53
The custodians of knowledge about props 16:56
are the playwrights. 16:59
Many decades ago, I saw a play by Henrik Ibsen. 17:01
It was Hedda Gabler. 17:05
I remember vaguely that it was about a woman in an unhappy 17:07
marriage, and her husband was in competition for an academic job 17:11
with somebody else. 17:16
And he was going to lose partly because he was boring, 17:17
and partly because the competitor had just 17:20
written a magnificent book. 17:23
By the way, this is back in the days 17:25
before there were copying machines and computers. 17:27
Anyhow, as the play opens, there's a potbellied stove, 17:30
and in the beginning of the play, 17:43
the potbelly stove, with its open door, 17:47
just has some slightly glowing embers. 17:50
But the potbellied stove is always there, 17:54
and as tension mounts in the play, 17:57
and you see this manuscript, this 17:59
prop that Ibsen so artfully used, you just know 18:01
that something's going to happen, 18:06
because as the play goes on, the fire gets bigger and hotter 18:08
and finally all consuming, and you just 18:13
know that that manuscript is going to go into that fire. 18:15
This memorable thing is what I remember about the play. 18:21
So playwrights have got this all figured out, 18:26
but on the other hand, they're not the only people 18:29
who can use props. 18:31
Here's an example of the use of a prop, also 18:34
due to Seymour Papert. 18:38
He was talking about how it's important to look 18:39
at the problem in the right way, and here's 18:42
an example that not only teaches that, but makes it possible 18:45
for you to embarrass your friends 18:50
in mechanical engineering. 18:51
So here's what you do. 18:53
Take a bicycle wheel, and you start it spinning. 18:55
And then you put some torque on the axle, 18:58
or equivalently, you blow on the edge. 19:02
And the issue is, does it go that way, 19:06
or does it go that way? 19:09
Now, the mechanical engineers will immediately say, oh, yes, 19:12
I see-- right hand screw wheel. 19:16
And they'll put their fingers in this position, 19:18
but forget exactly how to align their fingers 19:20
with the various aspects of the problem. 19:24
And so it's usually the case that they get it right 19:27
with about a 50% probability. 19:30
So their very fancy education gets them up 19:34
to the point where they're equivalent to flipping a coin. 19:38
But it doesn't have to be that way 19:43
because you can think about the problem a little differently. 19:45
So here's what you do. 19:49
You take some duct tape, and you put it 19:50
around the part of the wheel like that. 19:54
And now, you start to think about, not the whole wheel, 19:57
but just a little piece that's underneath the duct tape. 20:00
So here, that piece comes rolling over the top, 20:03
and at this point, you blow on it with a puff of air. 20:06
Forgetting about the rest of the wheel, 20:09
what happens to that little piece that's 20:11
under the duct tape? 20:12
It must want to go that way because you 20:13
banged on it like that. 20:15
It's already going down like that. 20:17
And what about the next piece? 20:19
Same thing. 20:20
Next piece? 20:21
Same thing. 20:22
So the only thing that can happen 20:23
is that the wheel goes over like that. 20:25
And so now, you'll never wonder again 20:28
because you're thinking about the problem in the right way, 20:30
and it's demonstrated by the use of a prop. 20:33
You can try this after we're done. 20:38
Another example I like to remember 20:44
is one from when I was taking 8.01. 20:47
Alan Lazarus was the instructor at the time, 20:50
and he was talking about the conservation of energy, kinetic 20:53
and potential. 20:57
And there was a long wire in a ceiling in 26-100 attached 20:59
to a much bigger steel ball, but one-- 21:04
not one like this. 21:07
And Lazarus took the ball up against the wall like this. 21:09
He put his head flat against the wall to steady himself, 21:15
and then he let go, and the pendulum 21:19
takes many seconds to go over and back, 21:22
and then gently kisses Lazarus's nose. 21:25
And so you have many seconds to think, 21:31
this guy really believes in the conservation of energy. 21:33
Do not try this at home. 21:43
The problem is that, the first time you do this, 21:46
you may not just let go. 21:50
There's a natural human tendency to push. 21:51
So that's a little bit on a subject of props. 22:01
It's interesting. 22:24
Whenever surveys are taken, students always say more chalk, 22:25
less PowerPoint. 22:29
And why would that be? 22:31
Props are also very effective. 22:34
Why would that be? 22:37
I'll give you my lunatic fringe view on this. 22:39
It has to do with what I would call empathetic mirroring. 22:42
When you're sitting up there watching me write on the board, 23:02
all those little mirror neurons in your head, I believe, 23:05
become actuated, and you can feel yourself 23:08
writing on the blackboard. 23:11
And even more so, when I talk about this steel ball going 23:13
that way and this way, you can feel the ball 23:18
as if you were me, and you can't do that with a slide. 23:22
You can't do it with a picture. 23:26
You need to see it in the physical world. 23:28
That's why I think that-- 23:31
oh, yes, of course, it's-- 23:34
there are speed questions involved, too, 23:35
that have to be separated out. 23:37
But I think the empathetic mirroring 23:39
is why props and the use of a blackboard are so effective. 23:41
Well, let's see-- oh, yes, there is one more thing 23:47
by way of the tools, and that has 23:53
to do with the use of slides. 23:57
I repeat, I think they're for exposing ideas, 24:02
not for teaching ideas, but that's what we do in a job talk 24:05
or conference talk-- 24:08
expose ideas. 24:11
We don't teach them. 24:12
So let me tell you a little bit about my views on that. 24:14
I remember, once, I was in Terminal A at Logan Airport. 24:20
I'd just come back from a really miserable conference, 24:29
and the flight was really horrible. 24:33
It was one of those that feels like an unbalanced washing 24:35
machine. 24:37
And for the only time in my life, 24:39
I decided to stop on my way to my car and have a cup of coffee 24:40
and relax a little bit. 24:46
And as I was there for a few minutes, someone came up to me 24:48
and said, are you Professor Winston? 24:51
I think so, I said. 24:54
I don't know. 24:57
I guess I was trying to be funny. 24:58
In any event, he said, I'm on my way to Europe 25:00
to give a job talk. 25:02
Would you mine critiquing my slides? 25:04
Not at all, I said. 25:07
You have too many, and they have too many words. 25:08
How did you know, he said, thinking perhaps I 25:12
had seen a talk of his before. 25:15
I hadn't. 25:17
My reply was, because it's always true. 25:19
There are always too many slides, always too many words. 25:22
So let me show you some extreme examples of how not to use 25:26
slides. 25:29
Well, for this demonstration, I need to be way over here 25:34
and when I get over here, then I can start to say things like, 25:42
one of the things you shouldn't do is read your transparencies. 25:48
People in your audience know how to read, 25:51
and reading will just annoy them. 25:53
Also, you should be sure that you 25:55
have only a few words on each transparency, 25:56
and that the words are easy to read. 25:59
And I hope I'm driving you crazy because I'm 26:02
committing all kinds of crimes, the first of which 26:05
is that there are too many words on the slide. 26:08
Second of which is, I'm way over there, 26:12
and the slide's way over there. 26:14
So you get into this tennis match feeling 26:16
of shifting back and forth between the slide 26:20
and the speaker. 26:23
You want the slides to be condiments to what 26:24
you're saying, not the main event or the opposite way 26:26
around. 26:29
So how can we fix this? 26:31
Step number one is to get rid of the background junk. 26:33
That's always distraction. 26:37
Step number two is to get rid of the words. 26:40
When I reduced the words to these, 26:43
then everything I read a previous time, 26:46
I'm not licensed to say, because it's not on the slide. 26:50
I'm not reading my slides anymore, 26:53
but I'm saying what was written on the slides 26:55
in a previous example. 26:58
So what else can we do to simplify this? 27:02
Well, we can get rid of the logos. 27:05
We don't need them. 27:07
Simplification. 27:10
What else can we do? 27:13
Get rid of the title. 27:15
Now, I want to talk to you about some rules for slide 27:17
preparation. 27:20
I'm telling you the title. 27:21
It doesn't have to be up there. 27:22
By reducing the number of words on the slide, 27:24
I'm allowing you to pay more attention to me 27:27
and less to what's written on the slide. 27:29
I mentioned it before-- we-- have only one language 27:32
processor, and we can either use it to read stuff 27:34
or to listen to the speaker. 27:38
And so if we have too many words on the slide, 27:40
it forces people in the audience to read this stuff 27:43
and not listen. 27:45
A student of mine did an experiment a few years ago. 27:49
He taught some students some web-based programming ideas. 27:52
Half the information was on slides, he said the other half, 28:00
and then for a control group, he reversed it. 28:04
And the question was, what did the subjects-- 28:07
that is to say, freshmen at his fraternity-- 28:10
what did the subjects remember best, what he said, 28:13
or what they read on the slide? 28:18
And the answer is, what they read on the slide. 28:21
When their slides have a lot of material on it, 28:26
they don't pay attention to the speaker. 28:28
In fact, in the after action report, one of the subjects 28:30
said, I wish you hadn't talked so much. 28:33
It was distracting. 28:36
Well, the last item is eliminate clutter. 28:41
Here's some clutter. 28:44
No reason even for those bullets. 28:46
So the too many words problem is a consequence 28:49
of a crime Microsoft has committed 28:51
by allowing you to use fonts that are too small. 28:55
So you should all have a sample slide like this 28:59
that you can use to determine what the minimum font 29:03
size is that's easily legible. 29:06
[INAUDIBLE],, what do you think of those? 29:09
AUDIENCE: Which size is right? 29:14
PATRICK WINSTON: What's that? 29:16
AUDIENCE: Did you ask me what size is right? 29:17
PATRICK WINSTON: Yeah, minimum, maybe. 29:19
AUDIENCE: 40 or 50. 29:21
PATRICK WINSTON: Yeah, he says 40 or 50. 29:22
I think that's about right. 29:24
35 is beginning to get too small, not necessarily 29:27
because you can't read it, but because you're probably 29:29
using it to get too many words on the slide. 29:32
What other crimes do we have? 29:37
Well, we have the laser pointer crime. 29:39
And for that-- in the old days, when 29:43
we didn't have laser pointers, we used wooden ones, 29:46
and people would go waving these things around. 29:49
And pretty soon it became almost like a baton twirling contest, 29:52
so here's what I recommended in the old days 29:59
for dealing with this kind of pointer. 30:02
This is an example of use of a prop. 30:08
Jim Glass up there saw this talk about 20 years ago, 30:14
and said, oh, yeah, I remember that talk. 30:17
That's the one where you broke the pointer. 30:19
It's amazing how props tend to be 30:23
the things that are remembered. 30:25
Well, now, we don't have physical pointers anymore. 30:27
We've got laser pointers. 30:32
It's a wonder more people aren't driven into epileptic fits 30:35
over this sort of stuff. 30:39
Well, here's what tends to happen. 30:41
Look at that. 30:43
It's a lovely recursive picture, and I can become part of it 30:44
by putting that laser beam right on the back of my head 30:49
up there. 30:52
Then what do you see? 30:56
You see the back of my head. 30:58
I have no eye contact, no engagement, nothing. 31:01
I was sitting with a student watching a talk one day, 31:04
and she said, you know what, we could all leave, 31:08
and he wouldn't know. 31:11
So what happens when you use a laser pointer? 31:16
You can't use a laser pointer without turning your head 31:17
and pointing it at something, and when you do that, 31:21
you lose contact with the audience. 31:25
You don't want to do it. 31:27
So what do you do if you need to identify something 31:29
in your image, and you don't want 31:32
to point at it with a laser? 31:34
This is what you do. 31:35
Put a little arrow on there and say, 31:36
now, look at that guy at the end of arrow number one. 31:38
You don't need to have laser pointer to do that. 31:41
The too-heavy crime-- when people 31:48
ask me to review a presentation, I 31:52
ask them to print it out and lay it out on a table. 31:55
When they do that, it's easy to see whether the talk is 32:01
too heavy, too much text, not enough air, not 32:04
enough white space, not enough imagery. 32:08
This is a good example of such a talk-- 32:12
way too heavy. 32:16
The presenter has taken advantage of a small font sizes 32:19
to get as much on the slide as he wanted. 32:22
Lots of other crimes here, but the too-heavy-- the fact 32:27
that it's too heavy is what I wanted to illustrate. 32:31
So here, by contrast, another talk-- 32:33
one I gave a few years ago. 32:36
It's not-- it wasn't a deeply technical talk, 32:37
but I show it to you because there's air in it. 32:41
It's mostly pictures of things. 32:46
There are three or four slides that have text on them, 32:49
but when I come to those, I give the audience time to read them. 32:52
And they're there because they might have 32:56
some historical significance. 32:57
The first slide with a lot of text on it 33:00
is an extraction from the 1957-- 33:02
from the proposal for the 1957 AI conference at Dartmouth. 33:06
Extraordinarily interesting event, 33:10
and that historical extraction from the proposal 33:13
helps drive that point home. 33:17
What else have we got here? 33:20
Oh, yeah, your vocabulary word for the day. 33:23
This is an hapax legomenon. 33:25
What that means is, this is the kind of slide 33:28
you can get away with exactly once in your presentation. 33:31
This is a slide that got some currency some years 33:36
ago because it shows the complexity of governing 33:38
in Afghanistan by showing how impossibly complex it is. 33:43
It's something you in the audience can't understand, 33:49
and that's the point, but you can't have many of these. 33:52
You can have one per work, one per presentation, 33:55
one per paper, one per book. 33:58
That's what hapax legomenon is, and this is an example of it. 34:00
Well, I've shown you some crimes. 34:06
So you might be asking, do these crimes actually occur? 34:08
So they do. 34:12
[LAUGHTER] 34:16
There's the hands in the pockets crime. 34:21
There's a crime and time and place selection here. 34:26
This is how you get to the Bartos Theater. 34:32
First thing you do is you get on these steps 34:35
over at the Media Lab, then you cross this large open space, 34:37
then you turn right down this corridor. 34:44
[LAUGHTER] 34:45
At this point, whenever I go in there, 34:47
I wonder if there are torture implements around the corner. 34:48
[LAUGHTER] 34:51
And then when you get in there, you 34:52
get into this dark, gloomy place. 34:54
So it's well named when they call it the Bartos Theater 34:57
because it's a place where you can watch a movie, 35:00
but it's not a place where you can give a talk. 35:02
Now, on a subject of does it happen, 35:07
here's a talk I attended a while back in Stata. 35:10
Notice that the speaker is far away from the slides. 35:14
Speaker's using a laser pointer. 35:19
And you say to me, well, what's happening here? 35:22
It's, by the way, the 80th - 80th! 35:26
slide of the presentation. 35:29
Notice that it extends with the words, 35:31
this is the first of 10 conclusions slides. 35:33
[LAUGHTER] 35:35
So what's the audience reaction? 35:37
That's the sponsor of the meeting. 35:41
[LAUGHTER] 35:43
He's reading his email. 35:44
This is the co-sponsor of the meeting. 35:47
He's examining the lunch menu. 35:50
[LAUGHTER] 35:52
What about this person? 35:54
This person looks like he's paying attention, 35:58
but just because it's a still picture. 36:02
If you were to see a video, what you would see 36:04
is something like this [YAWNS]. 36:06
[LAUGHTER] 36:10
So yeah, it does happen. 36:14
Well, now, that's a quick review of tools. 36:17
Now, I want to talk about some special cases. 36:23
We could talk a little bit about the informing 36:30
or to say another way, doing what I'm doing now. 36:32
But I'll just say a few words about that. 36:38
In that kind of presentation, you 36:40
want to start with a promise like I did for this hour 36:42
that we're going through now. 36:46
And then it comes to the question 36:48
of how do you inspire people? 36:49
I've given this talk for a long time, 36:52
and a few years ago, our department chairman 36:54
said, would you please give this talk to a new faculty, 36:58
and be sure to emphasize what it takes to inspire students. 37:02
And strangely, I hadn't thought about that question before. 37:06
So I started a survey. 37:09
I'd talked to some of my incoming freshmen advisees, 37:11
and I talked to senior faculty and everything 37:14
in between about how they've been inspired. 37:17
What I found from the incoming freshmen 37:21
is that they were inspired by some high school teacher who 37:23
told them they could do it. 37:26
What I found in the senior faculty, 37:29
they were inspired by someone who 37:32
helped them see a problem in a new way. 37:35
And what I saw from everyone is that they were inspired when 37:38
someone exhibited passion about what they were doing, 37:44
exhibited passion about what they were doing. 37:49
So that's one way to be inspiring. 37:52
It's easy for me because I do artificial intelligence. 37:57
And how can you not be interested 38:03
in artificial intelligence? 38:06
[LAUGHTER] 38:07
I mean, if you're not interested in artificial intelligence, 38:08
you're probably not interested in interesting things. 38:10
So when I'm lecturing in my AI class, it's natural for me 38:15
to talk about what I think is cool 38:20
and how exciting some new idea is. 38:23
So that's the kind of expression of passion 38:27
that makes a difference while informing with respect 38:31
to this question of inspiring. 38:34
Oh, yeah and of course, during this promise phase, 38:39
you can also express how cool stuff is. 38:43
Let me give you an example of a lecture that starts this way. 38:47
I'm talking about resource allocation. 38:50
It's the same sort of stuff you would think of when your-- 38:53
it's the same sort of ideas you would 38:55
need if you're allocating aircraft to a flight schedule 38:57
or trying to schedule a factory or something like that. 39:01
But the example is putting colors 39:04
on the states in the United States 39:06
without any bordering states having the same color. 39:08
So here it goes. 39:11
This is what I show at the beginning of the class. 39:15
This is a way of doing that coloring. 39:18
And you might say, well, why don't we wait till it finishes? 39:21
Would you like to do that? 39:25
No? 39:27
Well, we're not going to wait till it finishes 39:29
because the sun will have exploded and consumed the earth 39:31
before this program finishes. 39:33
[LAUGHTER] 39:35
But with a slight adjustment to how the program works, which 39:36
I tell my students you will understand in the next 50 39:41
minutes, this is what you get. 39:44
Isn't that cool? 39:49
You got to be amazed by stuff that 39:53
takes a computation from longer than the lifetime 39:55
of the solar system into a few seconds. 39:57
So that's what I mean by providing a promise upfront 40:00
and expressing some passion about what 40:05
you're talking about. 40:07
Well, the last item in this little block 40:10
here is it has to do with what people 40:12
think that they do it at MIT. 40:15
You ask faculty what the most important purpose is, 40:16
and they'll say, well, the most important thing I do 40:19
is teach people how to think. 40:23
And then you say oh, that's great. 40:26
How do you teach people how to think? 40:29
Blank stare. 40:32
No one can quite respond to that part, 40:35
that natural next question. 40:38
So how do you teach people how to think? 40:40
Well, I believe that we are storytelling animals. 40:42
And that we start developing our story, 40:48
understanding and manipulating skills 40:52
with fairy tales in childhood and continue on 40:54
through professional schools like law, business, medicine, 40:57
everything. 41:02
And we continue doing that throughout life. 41:03
So if that is what thinking is all about. 41:06
And we want to teach people how to think, 41:09
you provide them with the stories they need to know, 41:11
the questions they need to ask about those stories, 41:14
mechanisms for analyzing those stories, 41:17
ways of putting stories together, 41:19
ways of evaluating how reliable a story is. 41:20
And that's what I think you need to do when you teach people 41:24
how to think. 41:28
But that's all about education. 41:29
And many of you here are not necessarily 41:31
for that, but rather for this part, 41:35
for persuading, which breaks down into several categories, 41:39
oral exams, not shown, shop talks, getting famous. 41:43
I won't say much about oral exams other than the fact 41:48
that they used to be a lot scarier than they are today. 41:51
In the old days, reading the literature 41:54
in a foreign language was a part of that. 41:59
And there was a high failure rate. 42:01
And when you look back on those failures, 42:04
the most usual reason for people failing an oral exam 42:08
is failure to situate and a failure to practice. 42:12
By situate, I mean, it's important to talk 42:17
about your research in context. 42:20
This is a problem that's being pursued all over the world. 42:22
There hasn't been any progress before me in the past 30 years. 42:25
Everyone is looking for a solution 42:30
because it will have impact on so 42:32
many other things, such situating and time and place 42:33
and feel. 42:37
And then as far as practice is concerned, yes, 42:38
practice is important. 42:41
But that doesn't mean showing your slides to the people 42:43
you share an with. 42:48
The problem with that is that if people know what you're doing, 42:50
they will hallucinate that there's 42:54
material in your presentation that isn't there 42:55
if it isn't there. 42:57
A variation on the scene, by the way, 42:59
is your faculty supervisor is not a very good person 43:01
to help you debug a talk because they, in fact, know 43:06
what you're doing. 43:09
And they will, in fact, hallucinate 43:10
there's material in your presentation that isn't there. 43:11
So you need to get together with some friends who 43:14
don't know what you're doing and have them-- 43:16
well, you start the practice session by saying, 43:20
if you can't make me cry, I won't value as a friend 43:23
anymore. 43:27
[LAUGHTER] 43:27
And then when you get to the faculty on a oral exam, 43:28
it will be easy. 43:33
You see, difficulty-- the amount of flak 43:35
you'll get from somebody is proportional to age. 43:39
The older somebody is, the more they 43:41
understand where they are in the world. 43:45
But the young people are trying to show the old people 43:47
how smart they are, so it's subtly vicious. 43:49
So whenever you have an opportunity 43:52
to have an examining committee that's 43:53
full of people with gray hair, that's what you want. 43:55
Well, that's just a word or two about something 43:59
I haven't listed here. 44:01
Let's get into the subject of job talks. 44:02
So I was sitting in a bar many years ago in San Diego. 44:05
I was a member of the Navy Science Board, 44:14
and I was sitting with a couple of my colleagues on the board 44:16
Delores Etter from the University of Colorado. 44:21
She made me so jealous I could spit because she'd written 21 44:24
books, and I'd only written 17. 44:27
And then the other one was Bill Weldon 44:30
from the University of Texas. 44:35
He was an electromagnetism guy, and he 44:38
knew how to use rail guns to drive steel rods through tank 44:41
armor. 44:45
These were interesting people. 44:45
So I said, what do you look for in a faculty candidate? 44:47
And within one microsecond, Delores 44:53
said, they have to show us they've 44:58
got some kind of vision, quickly followed by Bill who said, 45:00
they have to show us that they've done something. 45:05
Oh, that sounds good, I said. 45:15
And then I said to them, how long 45:18
does a candidate have to establish these two things? 45:20
What do you think? 45:24
Well, compare your answer to theirs. 45:26
Five minutes. 45:33
So if you haven't expressed your vision, 45:36
if you haven't told people that you've done something in five 45:38
minutes, you've already lost. 45:42
So you have to be able to do that. 45:45
And let me just mention a couple of things in that connection. 45:47
Here, the vision is in part, a problem 45:51
that somebody cares about and something new in your approach. 45:54
So the problem is understanding the nature 46:06
of human intelligence. 46:08
And the approach is asking questions 46:10
about what makes us different from chimpanzees 46:12
and Neanderthals. 46:16
Is it merely a matter of quantity, 46:18
or we're just a little bit smarter in some continuous way? 46:19
Or do we have something that's fundamentally different 46:23
that chimpanzees don't have and Neanderthals either? 46:26
And the answer is yes, we do have something different. 46:30
We are symbolic creatures. 46:34
And because we're symbolic creatures, 46:36
we can build symbolic descriptions 46:39
of relations and events. 46:44
We can string them together and make stories. 46:46
And because we can make stories, that's what makes us different. 46:48
So that's my stump speech. 46:51
That's how I start most of my talks 46:54
on my own personal research. 46:56
How do you express the notion that you've done something? 46:59
By listing the steps that need to be taken in order to achieve 47:04
the solution to that problem. 47:10
You don't have to have done all of those steps. 47:12
But you can say here's what needs to be done. 47:14
An example, here's what needs to be done. 47:18
We need to specify some behavior. 47:20
We need to enumerate the constraints that 47:23
make it possible to deal with that behavior. 47:25
We have to implement a system because we're engineers, 47:28
and we don't think that we've understood something 47:31
unless we can build it. 47:33
And we've built such a system, and we're 47:35
about to demonstrate it to you today. 47:37
That would be an example of enumerating a series of steps 47:38
needed to realize the vision. 47:42
So then blah, blah, blah, blah, blah, blah, blah, blah. 47:45
And then you conclude by-- 47:49
you conclude by enumerating your contributions. 47:51
It's kind of mirror of these steps. 48:01
And it helps to establish that you've done something. 48:03
So that's a kind of general purpose framework 48:06
for doing a technical talk. 48:08
Now, only a few more things left to do today. 48:12
Getting famous is the next item on our agenda 48:16
because once you've got the job, you 48:19
need to think a little bit about how 48:20
you're going to be recognized for what you do. 48:22
So oh, first of all, why should you care about getting famous? 48:25
I thought about this in connection 48:38
with a fundraising event I attended 48:40
once, a fundraising event for raising money 48:44
to save Venice from going under water and having all of its art 48:49
destroyed. 48:52
Anyway, I was sitting here, and JC was sitting here. 48:53
That was Julia, the late Julia Child. 49:00
And as the evening wore on, more and more people 49:08
would come up and ask Julia to autograph something 49:10
or express a feeling that she had changed their life. 49:14
And it just happened over and over again. 49:19
So eventually, I turned to Julia, and I said, Ms. Child, 49:23
is it fun to be famous? 49:27
And she thought about it for a second. 49:30
And she said, you get used to it. 49:31
[LAUGHTER] 49:34
But you know what occured to me? 49:35
You never get used to being ignored. 49:38
So it's-- here's a way to think about it. 49:41
Your ideas are like your children. 49:45
And you don't want them to go into the world in rags. 49:47
So what you want to do is to be sure 49:50
that you have these techniques, these mechanisms, 49:51
these thoughts about how to present ideas that you have so 49:55
that they're recognized for the value that is in them. 49:58
So that's why it's a legitimate thing to concern yourself 50:02
with packaging. 50:05
Now, how do you get remembered? 50:08
Well, there's something I like to call Winston's star. 50:11
And every one of the items I'm about to articulate starts 50:14
with an S. So if you want your presentation ideas 50:20
to be remembered, one of the things you need to do 50:24
is to make sure that you have some kind of symbol associated 50:27
with your work. 50:32
So this arch example is actually from my PhD thesis 50:34
many, many years ago. 50:37
And in the course of my work at that time, 50:39
this work on arch learning became mildly famous, 50:45
and I didn't know why. 50:47
It was only many years later that I realized 50:49
that that work accidentally had all of the elements 50:51
on this star. 50:54
So the first element is that there was a kind of symbol. 50:56
It's the arch itself. 50:59
Next thing you need is some kind of slogan, 51:05
a kind of phrase that provides a handle on the work. 51:10
And in this case, the phrase was one shot learning. 51:13
And it was one shot because the program I wrote 51:20
learned something definite from every example that 51:23
was presented to us. 51:27
So in going from a model based on this configuration 51:28
to something that isn't an arch base on that configuration, 51:32
the program learned that it has to be on top, 51:35
one shot learning. 51:38
So that's a symbol, slogan. 51:41
And now we need a surprise. 51:45
Yeah, the surprise is you don't need a million examples 51:51
of something to learn. 51:54
You can do it with one example if you're 51:55
smart enough to make use of that example appropriately. 51:58
So that was the surprise. 52:02
You can learn something definite from each example. 52:03
Next item was a salient idea. 52:07
Now, when I say salient idea, I don't mean important. 52:13
What I mean is an idea that sticks out. 52:16
Some theses, funnily enough, have too many good ideas, 52:21
and you don't know what it's all about because which one is it? 52:24
So you need an idea that sticks out. 52:27
And the idea that stuck out here was the notion of a near miss. 52:29
You see, this is not an arch, but it doesn't miss by much. 52:39
So it's a near miss. 52:43
And finally, you need to tell the story 52:45
of how you did it, how it works, why it's important. 52:50
So that's a bit on how to not so much get famous, 52:56
but how to ensure that your work is recognized. 53:01
Well, we're almost finished because now we're 53:06
down to this last item, which is how to stop. 53:08
And when we come to that, there's 53:13
a question of all right, well, what is the final slide? 53:14
And what are the final words? 53:22
So for the final slide, let me give you 53:30
some examples of possibilities. 53:32
How about this one? 53:37
Well, you might see that slide and think to yourself, 53:42
there are 1,000 faculty at MIT. 53:50
Nice piece of work, but not so much, 53:53
but it's only a tiny piece of work if you divide by 1,000. 53:55
So when you show a whole gigantic list of collaborators 54:01
at the end of a talk, it's a kind of let down 54:03
because it suggests that nobody knows. 54:07
Well, did you do anything significant? 54:09
Now, you've got to recognize your collaborators, right? 54:12
So where do you do that? 54:15
Not on the last slide, on the first slide. 54:16
All this was on the first slide. 54:19
These are the collaborators, so you don't 54:21
want to put them at the end. 54:23
You don't want a slide like this. 54:24
How about this one? 54:28
This is the worst possible way to end a talk. 54:31
[LAUGHTER] 54:33
Because this slide can be up there for 20 minutes. 54:34
I've seen it happen. 54:39
It squanders real estate. 54:40
It squanders an opportunity to tell people who you are. 54:43
It's just-- 54:47
What about this one? 54:51
I often see it. 54:56
I never see anybody write it down. 54:57
Also, it wastes opportunity. 55:01
Oh my God, even worse. 55:06
All of these lines do nothing for you. 55:14
They waste an opportunity for you to tell people-- 55:18
to leave people with what you-- 55:21
with who you are. 55:23
Well, what about this? 55:26
Is this a good one? 55:29
It might seem so at first, but here's the problem. 55:31
If you say these are my conclusions, 55:38
these are perfectly legitimate conclusions 55:41
that nobody cares about. 55:42
What they care about is what you have done. 55:44
And that's why your final slide should 55:47
have this label, contributions. 55:49
It's a mirror of what I said over there about how job talks 55:53
ought to be like a sandwich. 55:56
And the final slide, the one that's 55:57
up there while people are asking questions and filing out, 55:59
it ought to be the one that has your contributions on it. 56:02
Here's an example from my own stump speech. 56:05
Yeah, this is what I talk about a lot. 56:09
Yes, here are the things that I typically demonstrate. 56:13
And I wait for people to read it. 56:21
And the final element there is this is what we get out of it, 56:23
so that's an example of a contribution slide. 56:27
All right, now, what about the other part? 56:32
You got your final slide up there. 56:37
It's a contribution slide. 56:39
Somehow you have to tell people you're finished. 56:41
So let's see it, check out a few possibilities. 56:44
One thing you could do in the final words 56:50
is you could tell a joke. 56:54
It's OK. 56:59
By the time you're done, people have adjusted themselves 57:02
to your voice parameters. 57:04
They're ready for a joke. 57:05
I was sitting in another bar, this time in Austin, Texas 57:10
with a colleague of mine named Doug Lenat. 57:13
And Doug's a fantastic speaker. 57:16
And so I said to Doug, Doug, you're 57:18
a fantastic speaker, what's your secret? 57:21
And he said, oh, I always finish with a joke, 57:24
and that way, people think they've had fun the whole time. 57:29
[LAUGHTER] 57:32
So yeah, a joke will work down there. 57:35
How about this one? 57:39
Thank you. 57:50
I don't recommend it. 57:54
It's a weak move. 57:55
You will not go to hell if you conclude 57:58
your talk by saying thank you, but it's a weak move, 58:00
and here's why. 58:02
When you say thank you, even worse, thank you for listening, 58:04
it suggests that everybody has stayed 58:08
that long out of politeness and that they had a profound desire 58:10
to be somewhere else. 58:14
But they're so polite, they stuck it out. 58:15
And that's what you're thanking them for. 58:17
So once wild applause has started, 58:20
you can mouth a thank you, and there's 58:21
nothing wrong with that. 58:24
But the last thing you do should not be saying thank you. 58:25
Now, you say to me, well, doesn't everybody say 58:29
thank you? 58:31
Well, what everybody does is not necessarily the right thing. 58:33
And I like to illustrate how some talks can 58:37
end without saying thank you. 58:40
I like to draw from political speeches, 58:41
but the ones that I've heard recently aren't so good, so-- 58:45
[LAUGHTER] 58:47
So I'm going to have to go go back a little bit. 58:50
So here is Governor Christie. 58:55
He gave the Republican keynote address one year. 58:57
This is the end of his talk. 59:03
Let's see what he does. 59:05
[APPLAUSE] 59:07
CHRIS CHRISTIE: And together, everybody, together. 59:08
We will stand up once again for American greatness 59:11
for our children and grandchildren. 59:16
God bless you, and God bless America. 59:18
[APPLAUSE] 59:20
PATRICK WINSTON: So that's a classic benediction ending. 59:23
God bless you, God bless America. 59:27
Now, I don't want to be partisan about this. 59:30
So I think I'd better switch to the keynote address 59:32
in the Democratic Convention. 59:35
It was delivered that year by Bill Clinton, who knows 59:38
something about how to speak. 59:42
[APPLAUSE] 59:45
BILL CLINTON: If that is what you want, 59:46
if that is what you believe, you must vote, 59:48
and you must re-elect President Barack Obama. 59:52
God bless you, and God bless America. 59:57
[APPLAUSE] 59:58
[LAUGHTER] 00:00
PATRICK WINSTON: Now, watch this. 00:09
Let's go back a little bit and redo it. 00:11
What I want you to see is that at one point, 00:13
he seems to be almost pressing his lips together, forcing 00:15
himself not to say thank you. 00:18
Then there's another place where he does a little salute. 00:20
So watch for those this time around. 00:22
[APPLAUSE] 00:24
BILL CLINTON: If that is what you want, 00:25
if that is what you believe, you must vote, 00:28
and you must re-elect President Barack Obama. 00:31
God bless you., and God bless America. 00:36
[APPLAUSE] 00:38
PATRICK WINSTON: That's where he's pursing his lips. 00:39
[LAUGHTER] 00:42
There's the salute. 00:43
[LAUGHTER] 00:45
Yeah, I think that's pretty good. 00:49
Now, what are we gonna take away from this? 00:50
Well, I suppose I could conclude this talk by saying God bless 00:52
you, and God bless the Massachusetts Institute 00:57
of Technology, but it might not work so well. 01:00
But what you can get out of this is 01:04
you don't have to say thank you. 01:06
There are other things you can do. 01:08
And it's interesting that over time, people figure this out, 01:09
and there's some stock ways of ending things. 01:13
So in the Catholic church, and the good old Latin mass, 01:15
it ended with ite missa est, which 01:21
translates approximately to OK, the mass is over, 01:27
you can go home now. 01:31
[LAUGHTER] 01:32
And of course, at musical concerts, 01:34
you know that it's time to clap not at the end of the song, 01:37
but rather when the conductor goes over and shakes hands 01:42
with the concert master. 01:45
Those are conventions that tell you that the event is over. 01:47
So those are all possibilities for here. 01:53
But one more possibility, and that 01:58
is that you can salute the audience. 02:00
And by that, I mean, you can say something 02:07
about how much you value your time at a place. 02:09
So I could say, well, it's been great fun being here. 02:13
It's been fascinating to see what you folks are doing here 02:20
at MIT. 02:22
I've been much stimulated and provoked 02:24
by the kinds of questions you've been asking, 02:27
it's been really great. 02:29
And I look forward to coming back 02:30
on many occasions in the future. 02:33
So that salutes the audience. 02:35
You can do that. 02:36
Well, there it is. 02:40
You know what? 02:42
I'm glad you're here. 02:45
And the reason is by being here, I 02:46
think you have demonstrated an understanding 02:48
that how you present and how you package your ideas is 02:51
an important thing. 02:54
And I salute you for that. 02:56
[LAUGHTER] And I suggest that you come back again and bring 02:58
your friends. 03:03
[APPLAUSE] 03:05

– English Lyrics

🕺 Listening to "" and picking up vocab? Open the app and learn it while it’s hot!
By
Viewed
22,811,358
Language
Learn this song

Lyrics & Translation

[English]
PATRICK WINSTON: The Uniform Code of Military Justice
specifies court martial for any officer who sends a soldier
into battle without a weapon.
There ought to be a similar protection for students
because students shouldn't go out
into life without the ability to communicate,
and that's because your success in life
will be determined largely by your ability to speak,
your ability to write, and the quality of your ideas,
in that order.
I know that I can be successful in this
because the quality of communication,
your speaking, your writing, is largely
determined by this formula.
It's a matter of how much knowledge you have,
how much you practice with that knowledge,
and your inherent talent, and notice
that the T is very small.
What really matters is what you know.
This point came to me suddenly a few decades ago when
I was skiing at Sun Valley.
I had heard that it was Celebrity Weekend, and one
of the celebrities was Mary Lou Retton,
famous Olympic gymnast, perfect 10s in the vault.
And I heard that she was a novice at skiing,
so when the opportune moment arrived,
I looked over on the novice slope
and saw this young woman who, when she became unbalanced,
went like that.
And I said that's got to be her.
That must be the gymnast.
But then, it occurred to me, I'm a much better skier
than she is, and she's an Olympic athlete-- not only
an ordinary Olympic athlete, an outstanding one.
And I was a better skier because I had the K, and I had the P,
and all she had was the T. So you
can get a lot better than people who
may have inherent talents if you have
the right amount of knowledge.
So that's what my objective is today, and here's my promise.
Today, you will see some examples
of what you can put in your armamentarium of speaking
techniques, and it will be the case
that some one of those examples, some heuristic, some technique,
maybe only one, will make--
will be the one that gets you the job.
And so this is a very non-linear process.
You never know when it's going to happen,
but that is my promise.
By the end of the next 60 minutes,
you'll have been exposed to a lot of ideas, some of which
you'll incorporate into your own repertoire,
and they will ensure that you get the maximum opportunity
to have your ideas valued and accepted
by the people you speak with.
Now, in order to do that, we have
to have a rule of engagement, and that
is no laptops, no cell phones.
So if you could close those, I'll
start up as soon as you're done.
Some people ask why that is a rule of engagement,
and the answer is, we humans only
have one language processor.
And if your language processor is enga--
could you shut the laptop, please?
If your language processor is engaged browsing the web
or reading your email, you're distracted.
And worse yet, you distract all of the people around you.
Studies have shown that.
And worse yet, if I see a open laptop somewhere back
there or up here, it drives me nuts, and I do a worse job.
And so that ensures that all of your friends
who are paying attention don't get the performance
that they came to have.
So that's it for preamble.
Let's get started.
First thing we talk about, of course, is how to start.
Some people think the right thing to do
is to start a talk with a joke.
I don't recommend it, and the reason
is that, in the beginning of a talk,
people are still putting their laptops away.
They're becoming adjusted to your speaking parameters,
to your vocal parameters, and they're not ready for a joke.
So it doesn't work very well.
They usually fall flat.
What you want to do instead is start with empowerment promise.
You want to tell people what they're
going to know at the end of the hour
that they didn't know at the beginning of the hour.
It's an empowerment promise.
It's the reason for being here.
What would be an example?
Oh, I see.
At the end of this 60 minutes, you will know things
about speaking you don't know now,
and something among those things you know
will make a difference in your life.
Yeah, that's an empowerment promise,
so that's the best way to start.
So now that I've talked a little bit about how to start,
what I want to do is give you some samples of heuristics
that are always on my mind when I give a talk,
and first of these heuristics is that it's a good idea to cycle
on the subject.
Go around it.
Go round it again.
Go round it again.
Some people say, tell him what you want to tell him.
Tell him again, and then tell him a third time,
as if people weren't intelligent.
But the point is--
the reason is-- well, there are many reasons, one of which
is, at any given moment, about 20% of you
will be fogged out no matter what the lecture is.
So if you want to ensure that the probability that everybody
gets it is high, you need to say it three times.
So cycling is one of the things that I always
think about when I give a talk.
Another thing I think about is, in explaining my idea,
I want to build a fence around it so that it's not confused
with somebody else's idea.
So if you were from Mars, and I was teaching you
about what an arch is, I might say to you,
well, that's an arch.
And that's not to be confused with some other things
that other people might think is--
this is not an arch.
That's not an arch.
I'm building a fence around my idea
so that it can be distinguished from somebody else's idea.
So in a more technical sense, I might say, well,
my algorithm might similar--
might seem similar to Jones's algorithm,
except his is exponential, and mine's linear.
That's putting a fence around your idea
so that people can not be confused about how it
might relate to something else.
The third thing on this list of samples
is the idea of verbal punctuation.
And the idea here is that, because people
will occasionally fog out and need to get back on the bus,
you need to provide some landmark places where
you're announcing that it's a good time to get back on.
So I might, in this talk, say something
about this being my outline.
The first thing we're going to do is talk about how to start.
Then we're going to deal with these four samples,
and among these four samples, I've
talked about the first idea-- that's cycling.
The second idea, building-- and now,
the third idea is verbal punctuation.
So I'm enumerating and providing numbers.
I'm giving you a sense that there's a seam in the talk,
and you can get back on.
So now, we're on a roll, and since we're on a roll,
can you guess what fourth idea might be here--
an idea that helps people get back on the bus?
AUDIENCE: Ask a question.
PATRICK WINSTON: Yes?
AUDIENCE: Ask a question.
[INAUDIBLE]
PATRICK WINSTON: Ask a question, yes.
Thank you.
So ask a question.
And so I will ask a question-- how much dead air can there be?
How long can I pause?
I counted seven seconds.
It seemed like an eternity to me to wait and not say anything
for seven seconds, but that's the standard amount of time
you can wait for an answer.
And of course, the question has to be carefully chosen.
It can't be too obvious because then people
will be embarrassed to say it, but the answers can't
be too hard because then nobody will have anything to say.
So here are some sample heuristics
you can put in your armamentarium
and build up your repertoire of ideas about presentation.
And now, if this persuades you that there
is something to know, that there is knowledge,
then I've already succeeded because what I want to convince
you of, is if you watch the speakers you admire and feel
are effective, and ask yourselves
why they're successful, then you can
build up your own personal repertoire
and develop your own personal style.
And that's my fundamental objective,
and the rest of this talk is about some
of the things that are in my armamentarium
that I think are effective.
So next thing on our agenda, as we
start to discuss these other things,
is a discussion of time and place.
So what do you think is a good time to have a lecture?
11 AM?
Yeah.
And the reason is most people at MIT are awake by then,
and hardly anyone has gone back to sleep.
It's not right after a meal.
People aren't fatigued from this or that.
It's a great time to have a lecture.
So that brings me, next, to the question of what
about the place?
And the most important thing about the place
is that it be well lit.
This room is well lit.
Problem with other kinds of rooms is that we humans,
whenever the lights go down, or whenever
the room is dimly lighted, it signals
that we should go to sleep.
So whenever I go somewhere to give a talk,
even today, the first thing I do when
I speak to the audio-visual people
is say, keep the lights full up.
Oh, they might reply, people will see the slides better
if we turn the lights off, and then I reply,
it's extremely hard to see slides through closed eyelids.
What else can you say about the place?
Well, the place should be cased, and I
mean that in a colloquial sense, of like if you're
robbing a bank, you would go to the bank
some occasions before to see what it's like,
so there are no surprises when you do your robbery.
So whenever I go somewhere to speak,
the first thing I ask my host to do is to take me to the place
where I'll be speaking so that if there are any weirdnesses,
I'll be able to deal with it.
Sometimes, it might require some intervention.
Sometimes, it just might require me to understand
what the challenges are.
So when I came here this morning,
I did what I typically do.
I imagined that all the seats were
filled with disinterested farm animals,
and that way, I knew that, no matter how bad it was,
it wouldn't be as bad as that.
So finally, it should be reasonably--
it should be reasonably populated.
It should be the case that--
if there were 10 people in this hall,
everyone would be wondering, what's
going on that's so much more interesting that nobody's here.
So you want to get a right sized place that's--
doesn't have to be packed, but it
has to be more than half full.
So those are some thoughts about a time and place.
Next thing I want to talk about is a subject
of boards and props and slides.
Well, these are the tools of the trade.
I believe that this is the right tool for speaking
when your purpose is informing.
The slides are good when your purpose is exposing,
but this is what I use when I'm informing, teaching, lecturing,
and there's several reasons why I use it.
For one thing, when you use the board,
you have a graphic quality.
It's the case that, when you have a board, then
you can easily exploit the fact that you can use graphics
in your presentation.
So that's the graphic quality that I like, and the next thing
I like is the speed property.
The speed with which you write on the blackboard
is approximately the speed at which people can absorb ideas.
If you go flipping through a bunch of slides,
nobody can go that fast.
Finally, one great property of a board
is that it can be a target.
Many people who are novices at speaking
find themselves suddenly aware of their hands.
It's as if their hands were private parts that shouldn't
be exposed in public, so right away, they go into the pockets,
and this is considered insulting in some parts of the world.
Or alternatively, maybe the hands
will go in back like this.
I was once in a convent in Serbia, and my host--
as soon as we entered, a nun came up to us
and offered us a refreshment.
And I was about to say, no, thank you,
and he said, eat that stuff or die.
It's a question of local custom and politeness.
But then before anything happened there,
the nun pulled my hands out like this
because it was extraordinarily insulting in that culture
to have your hands behind your back.
So why is that?
Well, it's usually supposed that that's
that it has to do with whether you're concealing a weapon.
So if your hands are in your pockets or behind your back,
then it looks like you might have a weapon,
and that's what I mean by the virtue--
one of these virtues of the board.
Now, you have something to do with your hands.
You can point out the stuff.
I was once watching Seymour Papert give a lecture,
and I thought it was terrific.
So I went a second time--
first time to absorb the content, second time
to note style.
And what I discovered is that Papert was constantly
pointing at the board.
And then I thought about it a little while,
and I noted that none of the stuff he was pointing to
had anything to do with what he was saying.
Nevertheless, it was an effective technique.
So that's just a little bit about the virtue
of blackboards.
Now, I want to talk about props.
The custodians of knowledge about props
are the playwrights.
Many decades ago, I saw a play by Henrik Ibsen.
It was Hedda Gabler.
I remember vaguely that it was about a woman in an unhappy
marriage, and her husband was in competition for an academic job
with somebody else.
And he was going to lose partly because he was boring,
and partly because the competitor had just
written a magnificent book.
By the way, this is back in the days
before there were copying machines and computers.
Anyhow, as the play opens, there's a potbellied stove,
and in the beginning of the play,
the potbelly stove, with its open door,
just has some slightly glowing embers.
But the potbellied stove is always there,
and as tension mounts in the play,
and you see this manuscript, this
prop that Ibsen so artfully used, you just know
that something's going to happen,
because as the play goes on, the fire gets bigger and hotter
and finally all consuming, and you just
know that that manuscript is going to go into that fire.
This memorable thing is what I remember about the play.
So playwrights have got this all figured out,
but on the other hand, they're not the only people
who can use props.
Here's an example of the use of a prop, also
due to Seymour Papert.
He was talking about how it's important to look
at the problem in the right way, and here's
an example that not only teaches that, but makes it possible
for you to embarrass your friends
in mechanical engineering.
So here's what you do.
Take a bicycle wheel, and you start it spinning.
And then you put some torque on the axle,
or equivalently, you blow on the edge.
And the issue is, does it go that way,
or does it go that way?
Now, the mechanical engineers will immediately say, oh, yes,
I see-- right hand screw wheel.
And they'll put their fingers in this position,
but forget exactly how to align their fingers
with the various aspects of the problem.
And so it's usually the case that they get it right
with about a 50% probability.
So their very fancy education gets them up
to the point where they're equivalent to flipping a coin.
But it doesn't have to be that way
because you can think about the problem a little differently.
So here's what you do.
You take some duct tape, and you put it
around the part of the wheel like that.
And now, you start to think about, not the whole wheel,
but just a little piece that's underneath the duct tape.
So here, that piece comes rolling over the top,
and at this point, you blow on it with a puff of air.
Forgetting about the rest of the wheel,
what happens to that little piece that's
under the duct tape?
It must want to go that way because you
banged on it like that.
It's already going down like that.
And what about the next piece?
Same thing.
Next piece?
Same thing.
So the only thing that can happen
is that the wheel goes over like that.
And so now, you'll never wonder again
because you're thinking about the problem in the right way,
and it's demonstrated by the use of a prop.
You can try this after we're done.
Another example I like to remember
is one from when I was taking 8.01.
Alan Lazarus was the instructor at the time,
and he was talking about the conservation of energy, kinetic
and potential.
And there was a long wire in a ceiling in 26-100 attached
to a much bigger steel ball, but one--
not one like this.
And Lazarus took the ball up against the wall like this.
He put his head flat against the wall to steady himself,
and then he let go, and the pendulum
takes many seconds to go over and back,
and then gently kisses Lazarus's nose.
And so you have many seconds to think,
this guy really believes in the conservation of energy.
Do not try this at home.
The problem is that, the first time you do this,
you may not just let go.
There's a natural human tendency to push.
So that's a little bit on a subject of props.
It's interesting.
Whenever surveys are taken, students always say more chalk,
less PowerPoint.
And why would that be?
Props are also very effective.
Why would that be?
I'll give you my lunatic fringe view on this.
It has to do with what I would call empathetic mirroring.
When you're sitting up there watching me write on the board,
all those little mirror neurons in your head, I believe,
become actuated, and you can feel yourself
writing on the blackboard.
And even more so, when I talk about this steel ball going
that way and this way, you can feel the ball
as if you were me, and you can't do that with a slide.
You can't do it with a picture.
You need to see it in the physical world.
That's why I think that--
oh, yes, of course, it's--
there are speed questions involved, too,
that have to be separated out.
But I think the empathetic mirroring
is why props and the use of a blackboard are so effective.
Well, let's see-- oh, yes, there is one more thing
by way of the tools, and that has
to do with the use of slides.
I repeat, I think they're for exposing ideas,
not for teaching ideas, but that's what we do in a job talk
or conference talk--
expose ideas.
We don't teach them.
So let me tell you a little bit about my views on that.
I remember, once, I was in Terminal A at Logan Airport.
I'd just come back from a really miserable conference,
and the flight was really horrible.
It was one of those that feels like an unbalanced washing
machine.
And for the only time in my life,
I decided to stop on my way to my car and have a cup of coffee
and relax a little bit.
And as I was there for a few minutes, someone came up to me
and said, are you Professor Winston?
I think so, I said.
I don't know.
I guess I was trying to be funny.
In any event, he said, I'm on my way to Europe
to give a job talk.
Would you mine critiquing my slides?
Not at all, I said.
You have too many, and they have too many words.
How did you know, he said, thinking perhaps I
had seen a talk of his before.
I hadn't.
My reply was, because it's always true.
There are always too many slides, always too many words.
So let me show you some extreme examples of how not to use
slides.
Well, for this demonstration, I need to be way over here
and when I get over here, then I can start to say things like,
one of the things you shouldn't do is read your transparencies.
People in your audience know how to read,
and reading will just annoy them.
Also, you should be sure that you
have only a few words on each transparency,
and that the words are easy to read.
And I hope I'm driving you crazy because I'm
committing all kinds of crimes, the first of which
is that there are too many words on the slide.
Second of which is, I'm way over there,
and the slide's way over there.
So you get into this tennis match feeling
of shifting back and forth between the slide
and the speaker.
You want the slides to be condiments to what
you're saying, not the main event or the opposite way
around.
So how can we fix this?
Step number one is to get rid of the background junk.
That's always distraction.
Step number two is to get rid of the words.
When I reduced the words to these,
then everything I read a previous time,
I'm not licensed to say, because it's not on the slide.
I'm not reading my slides anymore,
but I'm saying what was written on the slides
in a previous example.
So what else can we do to simplify this?
Well, we can get rid of the logos.
We don't need them.
Simplification.
What else can we do?
Get rid of the title.
Now, I want to talk to you about some rules for slide
preparation.
I'm telling you the title.
It doesn't have to be up there.
By reducing the number of words on the slide,
I'm allowing you to pay more attention to me
and less to what's written on the slide.
I mentioned it before-- we-- have only one language
processor, and we can either use it to read stuff
or to listen to the speaker.
And so if we have too many words on the slide,
it forces people in the audience to read this stuff
and not listen.
A student of mine did an experiment a few years ago.
He taught some students some web-based programming ideas.
Half the information was on slides, he said the other half,
and then for a control group, he reversed it.
And the question was, what did the subjects--
that is to say, freshmen at his fraternity--
what did the subjects remember best, what he said,
or what they read on the slide?
And the answer is, what they read on the slide.
When their slides have a lot of material on it,
they don't pay attention to the speaker.
In fact, in the after action report, one of the subjects
said, I wish you hadn't talked so much.
It was distracting.
Well, the last item is eliminate clutter.
Here's some clutter.
No reason even for those bullets.
So the too many words problem is a consequence
of a crime Microsoft has committed
by allowing you to use fonts that are too small.
So you should all have a sample slide like this
that you can use to determine what the minimum font
size is that's easily legible.
[INAUDIBLE],, what do you think of those?
AUDIENCE: Which size is right?
PATRICK WINSTON: What's that?
AUDIENCE: Did you ask me what size is right?
PATRICK WINSTON: Yeah, minimum, maybe.
AUDIENCE: 40 or 50.
PATRICK WINSTON: Yeah, he says 40 or 50.
I think that's about right.
35 is beginning to get too small, not necessarily
because you can't read it, but because you're probably
using it to get too many words on the slide.
What other crimes do we have?
Well, we have the laser pointer crime.
And for that-- in the old days, when
we didn't have laser pointers, we used wooden ones,
and people would go waving these things around.
And pretty soon it became almost like a baton twirling contest,
so here's what I recommended in the old days
for dealing with this kind of pointer.
This is an example of use of a prop.
Jim Glass up there saw this talk about 20 years ago,
and said, oh, yeah, I remember that talk.
That's the one where you broke the pointer.
It's amazing how props tend to be
the things that are remembered.
Well, now, we don't have physical pointers anymore.
We've got laser pointers.
It's a wonder more people aren't driven into epileptic fits
over this sort of stuff.
Well, here's what tends to happen.
Look at that.
It's a lovely recursive picture, and I can become part of it
by putting that laser beam right on the back of my head
up there.
Then what do you see?
You see the back of my head.
I have no eye contact, no engagement, nothing.
I was sitting with a student watching a talk one day,
and she said, you know what, we could all leave,
and he wouldn't know.
So what happens when you use a laser pointer?
You can't use a laser pointer without turning your head
and pointing it at something, and when you do that,
you lose contact with the audience.
You don't want to do it.
So what do you do if you need to identify something
in your image, and you don't want
to point at it with a laser?
This is what you do.
Put a little arrow on there and say,
now, look at that guy at the end of arrow number one.
You don't need to have laser pointer to do that.
The too-heavy crime-- when people
ask me to review a presentation, I
ask them to print it out and lay it out on a table.
When they do that, it's easy to see whether the talk is
too heavy, too much text, not enough air, not
enough white space, not enough imagery.
This is a good example of such a talk--
way too heavy.
The presenter has taken advantage of a small font sizes
to get as much on the slide as he wanted.
Lots of other crimes here, but the too-heavy-- the fact
that it's too heavy is what I wanted to illustrate.
So here, by contrast, another talk--
one I gave a few years ago.
It's not-- it wasn't a deeply technical talk,
but I show it to you because there's air in it.
It's mostly pictures of things.
There are three or four slides that have text on them,
but when I come to those, I give the audience time to read them.
And they're there because they might have
some historical significance.
The first slide with a lot of text on it
is an extraction from the 1957--
from the proposal for the 1957 AI conference at Dartmouth.
Extraordinarily interesting event,
and that historical extraction from the proposal
helps drive that point home.
What else have we got here?
Oh, yeah, your vocabulary word for the day.
This is an hapax legomenon.
What that means is, this is the kind of slide
you can get away with exactly once in your presentation.
This is a slide that got some currency some years
ago because it shows the complexity of governing
in Afghanistan by showing how impossibly complex it is.
It's something you in the audience can't understand,
and that's the point, but you can't have many of these.
You can have one per work, one per presentation,
one per paper, one per book.
That's what hapax legomenon is, and this is an example of it.
Well, I've shown you some crimes.
So you might be asking, do these crimes actually occur?
So they do.
[LAUGHTER]
There's the hands in the pockets crime.
There's a crime and time and place selection here.
This is how you get to the Bartos Theater.
First thing you do is you get on these steps
over at the Media Lab, then you cross this large open space,
then you turn right down this corridor.
[LAUGHTER]
At this point, whenever I go in there,
I wonder if there are torture implements around the corner.
[LAUGHTER]
And then when you get in there, you
get into this dark, gloomy place.
So it's well named when they call it the Bartos Theater
because it's a place where you can watch a movie,
but it's not a place where you can give a talk.
Now, on a subject of does it happen,
here's a talk I attended a while back in Stata.
Notice that the speaker is far away from the slides.
Speaker's using a laser pointer.
And you say to me, well, what's happening here?
It's, by the way, the 80th - 80th!
slide of the presentation.
Notice that it extends with the words,
this is the first of 10 conclusions slides.
[LAUGHTER]
So what's the audience reaction?
That's the sponsor of the meeting.
[LAUGHTER]
He's reading his email.
This is the co-sponsor of the meeting.
He's examining the lunch menu.
[LAUGHTER]
What about this person?
This person looks like he's paying attention,
but just because it's a still picture.
If you were to see a video, what you would see
is something like this [YAWNS].
[LAUGHTER]
So yeah, it does happen.
Well, now, that's a quick review of tools.
Now, I want to talk about some special cases.
We could talk a little bit about the informing
or to say another way, doing what I'm doing now.
But I'll just say a few words about that.
In that kind of presentation, you
want to start with a promise like I did for this hour
that we're going through now.
And then it comes to the question
of how do you inspire people?
I've given this talk for a long time,
and a few years ago, our department chairman
said, would you please give this talk to a new faculty,
and be sure to emphasize what it takes to inspire students.
And strangely, I hadn't thought about that question before.
So I started a survey.
I'd talked to some of my incoming freshmen advisees,
and I talked to senior faculty and everything
in between about how they've been inspired.
What I found from the incoming freshmen
is that they were inspired by some high school teacher who
told them they could do it.
What I found in the senior faculty,
they were inspired by someone who
helped them see a problem in a new way.
And what I saw from everyone is that they were inspired when
someone exhibited passion about what they were doing,
exhibited passion about what they were doing.
So that's one way to be inspiring.
It's easy for me because I do artificial intelligence.
And how can you not be interested
in artificial intelligence?
[LAUGHTER]
I mean, if you're not interested in artificial intelligence,
you're probably not interested in interesting things.
So when I'm lecturing in my AI class, it's natural for me
to talk about what I think is cool
and how exciting some new idea is.
So that's the kind of expression of passion
that makes a difference while informing with respect
to this question of inspiring.
Oh, yeah and of course, during this promise phase,
you can also express how cool stuff is.
Let me give you an example of a lecture that starts this way.
I'm talking about resource allocation.
It's the same sort of stuff you would think of when your--
it's the same sort of ideas you would
need if you're allocating aircraft to a flight schedule
or trying to schedule a factory or something like that.
But the example is putting colors
on the states in the United States
without any bordering states having the same color.
So here it goes.
This is what I show at the beginning of the class.
This is a way of doing that coloring.
And you might say, well, why don't we wait till it finishes?
Would you like to do that?
No?
Well, we're not going to wait till it finishes
because the sun will have exploded and consumed the earth
before this program finishes.
[LAUGHTER]
But with a slight adjustment to how the program works, which
I tell my students you will understand in the next 50
minutes, this is what you get.
Isn't that cool?
You got to be amazed by stuff that
takes a computation from longer than the lifetime
of the solar system into a few seconds.
So that's what I mean by providing a promise upfront
and expressing some passion about what
you're talking about.
Well, the last item in this little block
here is it has to do with what people
think that they do it at MIT.
You ask faculty what the most important purpose is,
and they'll say, well, the most important thing I do
is teach people how to think.
And then you say oh, that's great.
How do you teach people how to think?
Blank stare.
No one can quite respond to that part,
that natural next question.
So how do you teach people how to think?
Well, I believe that we are storytelling animals.
And that we start developing our story,
understanding and manipulating skills
with fairy tales in childhood and continue on
through professional schools like law, business, medicine,
everything.
And we continue doing that throughout life.
So if that is what thinking is all about.
And we want to teach people how to think,
you provide them with the stories they need to know,
the questions they need to ask about those stories,
mechanisms for analyzing those stories,
ways of putting stories together,
ways of evaluating how reliable a story is.
And that's what I think you need to do when you teach people
how to think.
But that's all about education.
And many of you here are not necessarily
for that, but rather for this part,
for persuading, which breaks down into several categories,
oral exams, not shown, shop talks, getting famous.
I won't say much about oral exams other than the fact
that they used to be a lot scarier than they are today.
In the old days, reading the literature
in a foreign language was a part of that.
And there was a high failure rate.
And when you look back on those failures,
the most usual reason for people failing an oral exam
is failure to situate and a failure to practice.
By situate, I mean, it's important to talk
about your research in context.
This is a problem that's being pursued all over the world.
There hasn't been any progress before me in the past 30 years.
Everyone is looking for a solution
because it will have impact on so
many other things, such situating and time and place
and feel.
And then as far as practice is concerned, yes,
practice is important.
But that doesn't mean showing your slides to the people
you share an with.
The problem with that is that if people know what you're doing,
they will hallucinate that there's
material in your presentation that isn't there
if it isn't there.
A variation on the scene, by the way,
is your faculty supervisor is not a very good person
to help you debug a talk because they, in fact, know
what you're doing.
And they will, in fact, hallucinate
there's material in your presentation that isn't there.
So you need to get together with some friends who
don't know what you're doing and have them--
well, you start the practice session by saying,
if you can't make me cry, I won't value as a friend
anymore.
[LAUGHTER]
And then when you get to the faculty on a oral exam,
it will be easy.
You see, difficulty-- the amount of flak
you'll get from somebody is proportional to age.
The older somebody is, the more they
understand where they are in the world.
But the young people are trying to show the old people
how smart they are, so it's subtly vicious.
So whenever you have an opportunity
to have an examining committee that's
full of people with gray hair, that's what you want.
Well, that's just a word or two about something
I haven't listed here.
Let's get into the subject of job talks.
So I was sitting in a bar many years ago in San Diego.
I was a member of the Navy Science Board,
and I was sitting with a couple of my colleagues on the board
Delores Etter from the University of Colorado.
She made me so jealous I could spit because she'd written 21
books, and I'd only written 17.
And then the other one was Bill Weldon
from the University of Texas.
He was an electromagnetism guy, and he
knew how to use rail guns to drive steel rods through tank
armor.
These were interesting people.
So I said, what do you look for in a faculty candidate?
And within one microsecond, Delores
said, they have to show us they've
got some kind of vision, quickly followed by Bill who said,
they have to show us that they've done something.
Oh, that sounds good, I said.
And then I said to them, how long
does a candidate have to establish these two things?
What do you think?
Well, compare your answer to theirs.
Five minutes.
So if you haven't expressed your vision,
if you haven't told people that you've done something in five
minutes, you've already lost.
So you have to be able to do that.
And let me just mention a couple of things in that connection.
Here, the vision is in part, a problem
that somebody cares about and something new in your approach.
So the problem is understanding the nature
of human intelligence.
And the approach is asking questions
about what makes us different from chimpanzees
and Neanderthals.
Is it merely a matter of quantity,
or we're just a little bit smarter in some continuous way?
Or do we have something that's fundamentally different
that chimpanzees don't have and Neanderthals either?
And the answer is yes, we do have something different.
We are symbolic creatures.
And because we're symbolic creatures,
we can build symbolic descriptions
of relations and events.
We can string them together and make stories.
And because we can make stories, that's what makes us different.
So that's my stump speech.
That's how I start most of my talks
on my own personal research.
How do you express the notion that you've done something?
By listing the steps that need to be taken in order to achieve
the solution to that problem.
You don't have to have done all of those steps.
But you can say here's what needs to be done.
An example, here's what needs to be done.
We need to specify some behavior.
We need to enumerate the constraints that
make it possible to deal with that behavior.
We have to implement a system because we're engineers,
and we don't think that we've understood something
unless we can build it.
And we've built such a system, and we're
about to demonstrate it to you today.
That would be an example of enumerating a series of steps
needed to realize the vision.
So then blah, blah, blah, blah, blah, blah, blah, blah.
And then you conclude by--
you conclude by enumerating your contributions.
It's kind of mirror of these steps.
And it helps to establish that you've done something.
So that's a kind of general purpose framework
for doing a technical talk.
Now, only a few more things left to do today.
Getting famous is the next item on our agenda
because once you've got the job, you
need to think a little bit about how
you're going to be recognized for what you do.
So oh, first of all, why should you care about getting famous?
I thought about this in connection
with a fundraising event I attended
once, a fundraising event for raising money
to save Venice from going under water and having all of its art
destroyed.
Anyway, I was sitting here, and JC was sitting here.
That was Julia, the late Julia Child.
And as the evening wore on, more and more people
would come up and ask Julia to autograph something
or express a feeling that she had changed their life.
And it just happened over and over again.
So eventually, I turned to Julia, and I said, Ms. Child,
is it fun to be famous?
And she thought about it for a second.
And she said, you get used to it.
[LAUGHTER]
But you know what occured to me?
You never get used to being ignored.
So it's-- here's a way to think about it.
Your ideas are like your children.
And you don't want them to go into the world in rags.
So what you want to do is to be sure
that you have these techniques, these mechanisms,
these thoughts about how to present ideas that you have so
that they're recognized for the value that is in them.
So that's why it's a legitimate thing to concern yourself
with packaging.
Now, how do you get remembered?
Well, there's something I like to call Winston's star.
And every one of the items I'm about to articulate starts
with an S. So if you want your presentation ideas
to be remembered, one of the things you need to do
is to make sure that you have some kind of symbol associated
with your work.
So this arch example is actually from my PhD thesis
many, many years ago.
And in the course of my work at that time,
this work on arch learning became mildly famous,
and I didn't know why.
It was only many years later that I realized
that that work accidentally had all of the elements
on this star.
So the first element is that there was a kind of symbol.
It's the arch itself.
Next thing you need is some kind of slogan,
a kind of phrase that provides a handle on the work.
And in this case, the phrase was one shot learning.
And it was one shot because the program I wrote
learned something definite from every example that
was presented to us.
So in going from a model based on this configuration
to something that isn't an arch base on that configuration,
the program learned that it has to be on top,
one shot learning.
So that's a symbol, slogan.
And now we need a surprise.
Yeah, the surprise is you don't need a million examples
of something to learn.
You can do it with one example if you're
smart enough to make use of that example appropriately.
So that was the surprise.
You can learn something definite from each example.
Next item was a salient idea.
Now, when I say salient idea, I don't mean important.
What I mean is an idea that sticks out.
Some theses, funnily enough, have too many good ideas,
and you don't know what it's all about because which one is it?
So you need an idea that sticks out.
And the idea that stuck out here was the notion of a near miss.
You see, this is not an arch, but it doesn't miss by much.
So it's a near miss.
And finally, you need to tell the story
of how you did it, how it works, why it's important.
So that's a bit on how to not so much get famous,
but how to ensure that your work is recognized.
Well, we're almost finished because now we're
down to this last item, which is how to stop.
And when we come to that, there's
a question of all right, well, what is the final slide?
And what are the final words?
So for the final slide, let me give you
some examples of possibilities.
How about this one?
Well, you might see that slide and think to yourself,
there are 1,000 faculty at MIT.
Nice piece of work, but not so much,
but it's only a tiny piece of work if you divide by 1,000.
So when you show a whole gigantic list of collaborators
at the end of a talk, it's a kind of let down
because it suggests that nobody knows.
Well, did you do anything significant?
Now, you've got to recognize your collaborators, right?
So where do you do that?
Not on the last slide, on the first slide.
All this was on the first slide.
These are the collaborators, so you don't
want to put them at the end.
You don't want a slide like this.
How about this one?
This is the worst possible way to end a talk.
[LAUGHTER]
Because this slide can be up there for 20 minutes.
I've seen it happen.
It squanders real estate.
It squanders an opportunity to tell people who you are.
It's just--
What about this one?
I often see it.
I never see anybody write it down.
Also, it wastes opportunity.
Oh my God, even worse.
All of these lines do nothing for you.
They waste an opportunity for you to tell people--
to leave people with what you--
with who you are.
Well, what about this?
Is this a good one?
It might seem so at first, but here's the problem.
If you say these are my conclusions,
these are perfectly legitimate conclusions
that nobody cares about.
What they care about is what you have done.
And that's why your final slide should
have this label, contributions.
It's a mirror of what I said over there about how job talks
ought to be like a sandwich.
And the final slide, the one that's
up there while people are asking questions and filing out,
it ought to be the one that has your contributions on it.
Here's an example from my own stump speech.
Yeah, this is what I talk about a lot.
Yes, here are the things that I typically demonstrate.
And I wait for people to read it.
And the final element there is this is what we get out of it,
so that's an example of a contribution slide.
All right, now, what about the other part?
You got your final slide up there.
It's a contribution slide.
Somehow you have to tell people you're finished.
So let's see it, check out a few possibilities.
One thing you could do in the final words
is you could tell a joke.
It's OK.
By the time you're done, people have adjusted themselves
to your voice parameters.
They're ready for a joke.
I was sitting in another bar, this time in Austin, Texas
with a colleague of mine named Doug Lenat.
And Doug's a fantastic speaker.
And so I said to Doug, Doug, you're
a fantastic speaker, what's your secret?
And he said, oh, I always finish with a joke,
and that way, people think they've had fun the whole time.
[LAUGHTER]
So yeah, a joke will work down there.
How about this one?
Thank you.
I don't recommend it.
It's a weak move.
You will not go to hell if you conclude
your talk by saying thank you, but it's a weak move,
and here's why.
When you say thank you, even worse, thank you for listening,
it suggests that everybody has stayed
that long out of politeness and that they had a profound desire
to be somewhere else.
But they're so polite, they stuck it out.
And that's what you're thanking them for.
So once wild applause has started,
you can mouth a thank you, and there's
nothing wrong with that.
But the last thing you do should not be saying thank you.
Now, you say to me, well, doesn't everybody say
thank you?
Well, what everybody does is not necessarily the right thing.
And I like to illustrate how some talks can
end without saying thank you.
I like to draw from political speeches,
but the ones that I've heard recently aren't so good, so--
[LAUGHTER]
So I'm going to have to go go back a little bit.
So here is Governor Christie.
He gave the Republican keynote address one year.
This is the end of his talk.
Let's see what he does.
[APPLAUSE]
CHRIS CHRISTIE: And together, everybody, together.
We will stand up once again for American greatness
for our children and grandchildren.
God bless you, and God bless America.
[APPLAUSE]
PATRICK WINSTON: So that's a classic benediction ending.
God bless you, God bless America.
Now, I don't want to be partisan about this.
So I think I'd better switch to the keynote address
in the Democratic Convention.
It was delivered that year by Bill Clinton, who knows
something about how to speak.
[APPLAUSE]
BILL CLINTON: If that is what you want,
if that is what you believe, you must vote,
and you must re-elect President Barack Obama.
God bless you, and God bless America.
[APPLAUSE]
[LAUGHTER]
PATRICK WINSTON: Now, watch this.
Let's go back a little bit and redo it.
What I want you to see is that at one point,
he seems to be almost pressing his lips together, forcing
himself not to say thank you.
Then there's another place where he does a little salute.
So watch for those this time around.
[APPLAUSE]
BILL CLINTON: If that is what you want,
if that is what you believe, you must vote,
and you must re-elect President Barack Obama.
God bless you., and God bless America.
[APPLAUSE]
PATRICK WINSTON: That's where he's pursing his lips.
[LAUGHTER]
There's the salute.
[LAUGHTER]
Yeah, I think that's pretty good.
Now, what are we gonna take away from this?
Well, I suppose I could conclude this talk by saying God bless
you, and God bless the Massachusetts Institute
of Technology, but it might not work so well.
But what you can get out of this is
you don't have to say thank you.
There are other things you can do.
And it's interesting that over time, people figure this out,
and there's some stock ways of ending things.
So in the Catholic church, and the good old Latin mass,
it ended with ite missa est, which
translates approximately to OK, the mass is over,
you can go home now.
[LAUGHTER]
And of course, at musical concerts,
you know that it's time to clap not at the end of the song,
but rather when the conductor goes over and shakes hands
with the concert master.
Those are conventions that tell you that the event is over.
So those are all possibilities for here.
But one more possibility, and that
is that you can salute the audience.
And by that, I mean, you can say something
about how much you value your time at a place.
So I could say, well, it's been great fun being here.
It's been fascinating to see what you folks are doing here
at MIT.
I've been much stimulated and provoked
by the kinds of questions you've been asking,
it's been really great.
And I look forward to coming back
on many occasions in the future.
So that salutes the audience.
You can do that.
Well, there it is.
You know what?
I'm glad you're here.
And the reason is by being here, I
think you have demonstrated an understanding
that how you present and how you package your ideas is
an important thing.
And I salute you for that.
[LAUGHTER] And I suggest that you come back again and bring
your friends.
[APPLAUSE]

Key Vocabulary

Start Practicing
Vocabulary Meanings

armamentarium

/ˌɑːrməˌmænˈteəriəm/

C2
  • noun
  • - the collection of resources, equipment, or techniques available to a person

heuristic

/hjuˈrɪstɪk/

C2
  • noun
  • - a practical approach or rule of thumb for problem-solving

repertoire

/ˈrepətwɑːr/

B2
  • noun
  • - a stock of skills or types of behavior that a person habitually uses

inherent

/ɪnˈhɪərənt/

C1
  • adjective
  • - existing in something as a permanent, essential, or characteristic attribute

novice

/ˈnɒvɪs/

B2
  • noun
  • - a person new to or inexperienced in a field or situation

engage

/ɪnˈɡeɪdʒ/

B2
  • verb
  • - to occupy, attract, or involve someone's interest or attention

distracted

/dɪˈstræktɪd/

B1
  • adjective
  • - unable to concentrate because one's mind is preoccupied

empowerment

/ɪmˈpaʊəmənt/

C1
  • noun
  • - the process of becoming stronger and more confident

enumerate

/ɪˈnjuːməreɪt/

C2
  • verb
  • - to mention a number of things one by one

concise

/kənˈsaɪs/

C1
  • adjective
  • - giving a lot of information clearly and in a few words; brief

legible

/ˈledʒəbl/

B2
  • adjective
  • - (of handwriting or print) clear enough to read

recursive

/rɪˈkɜːsɪv/

C2
  • adjective
  • - characterized by recurrence or repetition

hapax legomenon

/ˌhæpæks ləˈɡɒmɪnɒn/

C2
  • noun
  • - a word that occurs only once within a context

salient

/ˈseɪliənt/

C2
  • adjective
  • - most noticeable or important

benediction

/ˌbenɪˈdɪkʃn/

C2
  • noun
  • - the utterance or bestowing of a blessing

🧩 Unlock "" – every sentence and word gets easier with the app!

💬 Don’t let tough words stop you – the app’s got your back!

Key Grammar Structures

  • your success in life will be determined largely by your ability to speak

    ➔ Future Passive Voice

    ➔ The structure "will be determined" uses the passive voice to emphasize the result (success) rather than the agent.

  • you will have been exposed to a lot of ideas

    ➔ Future Perfect Passive

    ➔ The structure "will have been exposed" describes an action that will be completed by a specific time in the future.

  • if your language processor is engaged browsing the web, you're distracted

    ➔ First Conditional (Real Condition)

    ➔ The "if" clause establishes a realistic condition, and the main clause states the logical consequence.

  • at the end of this 60 minutes, you will know things about speaking you don't know now

    ➔ Relative Clause (Reduced)

    ➔ The phrase "things [that] you don't know now" contains an implied relative pronoun "that".

  • I was once in a convent in Serbia, and my host—as soon as we entered, a nun came up to us

    ➔ Adverbial Clause of Time

    ➔ The phrase "as soon as we entered" specifies the exact moment the action (the nun coming up) occurred.

  • it's extremely hard to see slides through closed eyelids

    ➔ Infinitive Phrase as Subject Complement

    ➔ The structure "It is [adjective] to [verb]" uses an infinitive to describe the quality of the action.

  • what they remembered best, what he said, or what they read on the slide

    ➔ Noun Clauses as Objects

    ➔ Clauses starting with "what" function as the object of the verb "remembered".

  • if you haven't expressed your vision, you've already lost

    ➔ Present Perfect in Conditional

    ➔ The present perfect "haven't expressed" implies an action that needs to be completed within a specific past-to-present window.

Related Songs