YouTube2Text

15. Backward induction: chess, strategies, and credible threats — Transcript

by YaleCourses · 10,006 words · 1,042 segments · language en · Watch on YouTube

Full transcript

  1. 0:01Professor Ben Polak: So last time we finished up by
  2. 0:04playing the game of Nim and you'll remember,
  3. 0:06I hope, that the game of Nim was a game where there was two
  4. 0:11piles of stones--we made do with lines on the board--and the
  5. 0:15winner was the person who picked up the last stone.
  6. 0:19Remember you had to pick piles. I want to use the game of Nim
  7. 0:23to make a transition here. So what we had pointed out
  8. 0:27about the game of Nim was it illustrated very nicely for us
  9. 0:31that games can have first mover advantages or they can have
  10. 0:34second mover advantages. A very small change in the
  11. 0:38game, essentially a very small change in where we started from,
  12. 0:42could switch a game from a game with a first mover advantage to
  13. 0:46a game with a second mover advantage.
  14. 0:49Now today, I want to just draw a slightly grander lesson out of
  15. 0:54that game. So not only was it the case
  16. 0:56that the game sometimes has first mover advantages and
  17. 0:59sometimes has second mover advantages,
  18. 1:01but moreover, we could tell when it had a
  19. 1:04first mover advantage and we could tell when it had a second
  20. 1:08mover advantage. Is that right?
  21. 1:10When we actually looked at the initial set up of those stones,
  22. 1:13we knew immediately that's a game in which Player 1 is going
  23. 1:16to win, or alternatively,
  24. 1:18we knew immediately that's a game which Player 2 is going to
  25. 1:22win. Now it turns out that that idea
  26. 1:24is very general and actually has a name attached to it,
  27. 1:28and that name is Zermelo.
  28. 1:35So today we'll start off by talking about a theorem due to a
  29. 1:38guy called Zermelo, and the idea of this theorem is
  30. 1:42this. We're going to look at games
  31. 1:44more general than just Nim, and we're going to ask the
  32. 1:46question, under what circumstances would
  33. 1:49you know about a game either that Player 1,
  34. 1:51the person who goes first, can force a win,
  35. 1:54or that Player 2 can force a win, or will allow a third
  36. 1:58possibility, which is it's going to be a tie.
  37. 2:03So here's the theorem, suppose there are two players
  38. 2:06in this game, like the games that we looked
  39. 2:09at last time, and suppose--I won't define
  40. 2:13this formally now--but suppose the game is a game of perfect
  41. 2:18information. So what do I mean by perfect
  42. 2:21information? I'll define this later on in
  43. 2:23the class, but for now all I mean is, that whenever a player
  44. 2:27has his turn to move, that player knows exactly what
  45. 2:31has happened prior in the game. So, for example,
  46. 2:34all these sequential move games we've been looking at are moves
  47. 2:36of perfect information. When I get to move I know
  48. 2:39exactly what you did yesterday, I know what I did the day
  49. 2:42before yesterday and so on. So it's a game of perfect
  50. 2:45information. I'm going to assume that the
  51. 2:48game has a finite number of nodes.
  52. 2:51So two things here, it can't go on forever,
  53. 2:54this game, and also there's no point in which it branches in an
  54. 2:58infinite way. So there's a finite number of
  55. 3:01nodes, and we'll assume that the game has three possible
  56. 3:04outcomes. Actually there's a more general
  57. 3:07version of this theorem but this will do for now.
  58. 3:09The three possible outcomes are either a win for Player 1,
  59. 3:14so I'll call it W_1, or a loss for Player 1,
  60. 3:19which is obviously a win for Player 2, or a tie.
  61. 3:25So the game--like Nim last time, that only had two
  62. 3:27outcomes. So here we're going to look up
  63. 3:30to three outcomes or three or fewer outcomes I should say.
  64. 3:35So these are the conditions and here's the result.
  65. 3:39So I said three, it could be three but it could
  66. 3:42also be two here, I'm just allowing for three.
  67. 3:45(One is trivial.) So under these conditions the following
  68. 3:51is true. Either Player 1 can force a
  69. 3:55win, so either it's the case that this game is a game that if
  70. 4:01Player 1 plays as well as they can,
  71. 4:04they're going to win the game no matter what Player 2 does.
  72. 4:09Or 1 can at least force a tie, which means Player 1 can play
  73. 4:17in such a way that they can assure themselves of a tie
  74. 4:23regardless of what Player 2 does.
  75. 4:28Or it could be a game in which 2 can force a loss on 1,
  76. 4:41so a win for 2. So this theorem,
  77. 4:45when you first look at it, it doesn't seem to say very
  78. 4:48much. You're staring at this
  79. 4:49thing--you might think, we already knew that we're
  80. 4:52looking at games that only have three possible outcomes win,
  81. 4:56loss, or tie so it doesn't seem so surprising if you look at
  82. 5:00this theorem, it says,
  83. 5:02well, you're going to end up with a win, or a loss,
  84. 5:04or a tie. However, that's not quite what
  85. 5:06the theorem says. The theorem says,
  86. 5:08not only are you going to end up there--we knew that
  87. 5:11already--but the games divide themselves.
  88. 5:13Games of these forms divide themselves into those games in
  89. 5:17which Player 1 has a way of winning regardless of what
  90. 5:20Player 2 does; or games in which Player 1 has
  91. 5:23a way of forcing a tie regardless of what Player 2
  92. 5:27does; or Player 2 has a way of
  93. 5:29winning regardless of what Player 1 does,
  94. 5:32so these games all have a solution.
  95. 5:34Let's just go back to Nim to illustrate the point.
  96. 5:37So in Nim actually there's no tie so we can forget the middle
  97. 5:41of these, and in Nim, under certain circumstances it
  98. 5:45is the case that Player 1 can force a win.
  99. 5:48Who remembers what the case was, for when Player 1 can force
  100. 5:52a win? Anybody?
  101. 5:54The people who played last time. No, yes, Ale,
  102. 6:00there's somebody here. Shout it out.
  103. 6:04Student: Insuring that the piles are equal for the
  104. 6:06other player. Professor Ben Polak: All
  105. 6:10right, so if the piles start unequal, then Player 1 can
  106. 6:14actually force a win. So in Nim if the piles are
  107. 6:21unequal at the start, then 1 can force a win.
  108. 6:29It really doesn't matter what 2 does, 2 is "toast."
  109. 6:33Or the alternative case is the piles are equal at the start,
  110. 6:37and if they're equal at the start then it's Player 1 who's
  111. 6:42"toast." Player 2 is going
  112. 6:44to--rather--force a loss on 1, so 2 can force a loss on 1,
  113. 6:51i.e. a win for Player 2.
  114. 6:55Does everyone remember that from last time?
  115. 6:58It's just before the weekend, it shouldn't be so long ago.
  116. 7:02So this theorem applies to all games of this form.
  117. 7:08So what games are of this form? Let's try and think of some
  118. 7:10other examples. So one example is tic-tac-toe.
  119. 7:15Everyone know the rules of tic-tac-toe?
  120. 7:16In England we call it Noughts and Crosses, but you guys call
  121. 7:18it tic-tac-toe, is that right?
  122. 7:20Everyone know what tic-tac-toe is?
  123. 7:22Yeah, which category is tic-tac-toe?
  124. 7:26Is it a game which Player 1 can force a win, or is it a category
  125. 7:29in which Player 1 can only force a tie,
  126. 7:32or is it a category which you'd rather go second and Player 2
  127. 7:35can force a win for Player 2 or a loss for Player 1?
  128. 7:37Which is tic-tac-toe? Let's have a show of hands here.
  129. 7:41Who thinks tic-tac-toe is a game in which Player 1 can force
  130. 7:45a win? Who thinks tic-tac-toe is a
  131. 7:47game in which Player 1 can only force a tie?
  132. 7:50Who thinks Player 2's going to win?
  133. 7:53Most of you are right. It's a game in which if people
  134. 7:56play correctly then it'll turn out to be a tie.
  135. 7:59So tic-tac-toe is a game that leads to a tie.
  136. 8:07Player 1 can still make a mistake, in which case they can
  137. 8:10lose. Player 2 can make a mistake in
  138. 8:13which case they would lose, but there is a way of playing
  139. 8:17that forces a tie. So these are fairly simple
  140. 8:19games, let's talk about more complicated games.
  141. 8:21So what about the game of checkers?
  142. 8:24So the game of checkers meets these conditions.
  143. 8:26It's a two player game. You always know all the moves
  144. 8:29prior to your move. It's finite:
  145. 8:31there's some rules in checkers that prevent it going on
  146. 8:34forever. And there are two or three
  147. 8:36outcomes: I guess there's a third outcome if you get into a
  148. 8:39cycle you could tie. So checkers fits all these
  149. 8:42descriptions and what this theorem tells us is that
  150. 8:45checkers has a solution. I'm not sure I know what that
  151. 8:48solution is, or I think actually somebody did compute it quite
  152. 8:50recently, even in the last few months,
  153. 8:52I just forgot to Google it this morning to remind myself.
  154. 8:54But what this theorem tells us even before those people that
  155. 8:57computed it: checkers has a solution.
  156. 9:00Let's be a bit more ambitious. What about chess?
  157. 9:04So chess meets this description. Chess is a two player game,
  158. 9:07everybody knows all the moves before them, it's sequential,
  159. 9:11it has finite number of moves, it's a very large number but it
  160. 9:15is finite, and it has three possible outcomes,
  161. 9:18a win, a loss, or a tie. So let's be careful,
  162. 9:21the reason it's finite is that if you cycle--I forget what it
  163. 9:25is--three times then the game is declared a draw,
  164. 9:28declared a tie. So what's this theorem telling
  165. 9:30us? It's telling us that there is a
  166. 9:35way to solve chess. Chess has a solution.
  167. 9:41We don't know what that solution is.
  168. 9:43It could be that solution is that Player 1,
  169. 9:45who's the player with the white pieces can force a win.
  170. 9:49It could be that Player 1 can only force a tie,
  171. 9:52and it could even be that Player 2 can force a win.
  172. 9:54We don't know which it is, but there is a solution.
  173. 9:59There's a catch to this theorem. What's the catch?
  174. 10:02The catch is it doesn't actually tell us--this theorem
  175. 10:05is not going to tell us what that solution is.
  176. 10:07It doesn't tell us how to play. This theorem,
  177. 10:10in and of itself, doesn't tell us how to play
  178. 10:12chess. It just says there is a
  179. 10:16way to play chess. So we're going to try and prove
  180. 10:19this. We don't often do proofs in
  181. 10:21class, but the reason I want to prove this particular one is
  182. 10:25because I think the proof is instructive as part of sort of
  183. 10:28QR at Yale. So here's another example here,
  184. 10:31and some other examples. You could think of chess as
  185. 10:34being the most dramatic example.
  186. 10:49So the reason I want to spend actually some time proving this
  187. 10:56today is because we're going to prove it by induction and I'm
  188. 11:03going to sketch the proof. I'm not going to go through
  189. 11:08every possible step but I want to give people here a feeling
  190. 11:10for what a proof by induction looks like.
  191. 11:12The reason for this is, my guess is,
  192. 11:14well let's find out, how many of you have seen a
  193. 11:17proof by induction before? How many have not?
  194. 11:20So for those of you who haven't I think it's a good thing in
  195. 11:22life, at one point in your life to see a proof by induction,
  196. 11:24and for those who have, my guess is you saw it in some
  197. 11:27awful math class in high school and it just went over--it didn't
  198. 11:30necessarily go over your head but,
  199. 11:32the excitement of it doesn't catch on.
  200. 11:36This is a context where it might appeal.
  201. 11:40So proof by induction. We're going to prove this by
  202. 11:46induction on the maximum length of the game and we'll call that
  203. 11:57N. We'll call N the maximum length
  204. 11:59of the game. What do I mean by this?
  205. 12:00If I write down a tree I can always look at all the paths
  206. 12:06from the beginning of the tree all the way through to the end
  207. 12:11of the tree. And I'm going to look at the
  208. 12:14path in that particular tree that has the largest length,
  209. 12:18and I'll call that the length of the game, the maximum length
  210. 12:21of the game. So we're going to do induction
  211. 12:24on the maximum length of the game.
  212. 12:26So how do we start a proof by induction?
  213. 12:28Let's just remind ourselves, those people who have seen them
  214. 12:30before. We're going to prove that this
  215. 12:33theorem this true, the claim in the theorem is
  216. 12:36true for the easy case when the game is only 1 move long.
  217. 12:41That's the first step, and then we're going to try and
  218. 12:45show that if it's true for all games of length <
  219. 12:49= N, whatever N is,
  220. 12:51then it must therefore be true for games of length N+1.
  221. 12:56That's the way you do a proof by induction.
  222. 12:58So let's just see how that works in practice.
  223. 13:01So let's start with the easy step and we'll do it in some
  224. 13:04detail, more detail than you really need to in a math class.
  225. 13:08So if N = 1, what do these games look like?
  226. 13:11Well let's look at some examples here.
  227. 13:13So I claim it's pretty trivial if N = 1 but let's do it anyway.
  228. 13:18So the game might look like this.
  229. 13:20Player 1 is going to move--here's Player 1
  230. 13:22moving--the game's only length one--so Player 1's the only
  231. 13:26player who ever gets to move. So the game might look like
  232. 13:30this. Let's put in a fifth branch,
  233. 13:32it might look like this. And at the end of this game,
  234. 13:34rather than putting payoffs let me just put the outcomes.
  235. 13:37So the outcome must either be a win, or a tie,
  236. 13:40or a loss, so suppose it looks like this.
  237. 13:43Suppose it's a win, or here we could have a tie,
  238. 13:47or here we could have a win again, or here we could have a
  239. 13:53loss, and here we could have a tie.
  240. 13:57So in this particular game I claim it's pretty clear this
  241. 14:02game has a solution. It's pretty clear what 1 should
  242. 14:06do. What should 1 do?
  243. 14:081 should pick one of her choices that leads to a win.
  244. 14:12To be careful I'll put 1 in here just to distinguish who it
  245. 14:15is who's actually winning and losing.
  246. 14:17So in this game I claim that this game has a pretty obvious
  247. 14:21solution, either Player 1 is going to choose this branch that
  248. 14:24leads to a win or this branch that leads to a win,
  249. 14:27and either way Player 1 is going to win.
  250. 14:31Is that obvious? It's so obvious,
  251. 14:33it's kind of painful. So I claim this game,
  252. 14:35we could actually replace this first node with what's going to
  253. 14:39happen which is Player 1's going to win.
  254. 14:43Is that right? That was easy.
  255. 14:45Let's look at a different example, we'll do three.
  256. 14:49So here's another possible example, and this again,
  257. 14:53Player 1 is going to move here and this time the possible
  258. 14:57outcomes are tie, or a loss, or a loss.
  259. 15:01Once again it's a one player game, this time he has three
  260. 15:05choices and the three choices lead to a tie or he loses,
  261. 15:09so I claim once again this is simple.
  262. 15:11What Player 1 should do is what? Choose the tie since there's no
  263. 15:13way of winning. But in that case he could
  264. 15:15actually force it. He could actually choose the
  265. 15:17tie in which case he's going to tie.
  266. 15:19So this game has a solution called choose the tie.
  267. 15:21And again, we could replace the first node of the game with
  268. 15:25what's actually going to happen which is a tie.
  269. 15:29Everyone happy? There's one other possibility I
  270. 15:32guess. The other possibility is that
  271. 15:35here Player 1 has a lot of choices, maybe four choices in
  272. 15:39this case, once again Player 1 is going to
  273. 15:43move but in each case--unfortunately for Player
  274. 15:481--in each case the outcome is that Player 1 loses.
  275. 15:54So this is a game in which Player 1 is going to lose no
  276. 15:56matter what they do. Once again it has a solution:
  277. 15:59the solution is Player 1 is toast and is going to lose.
  278. 16:08So I claim this has really captured all the possibilities
  279. 16:10of games of length 1. I mean you could imagine that
  280. 16:13there could be more branches on them, but basically there are
  281. 16:16these three possibilities. Either it's the case that one
  282. 16:19of those branches leads to a win, in which case the solution
  283. 16:22is Player 1 wins; or it's the case that none of
  284. 16:25the branches have wins in them, but one of them has a tie,
  285. 16:28in which Player 1 is going to tie;
  286. 16:30or it's the case that all the branches have loss in them,
  287. 16:33in which Player 1's going to lose.
  288. 16:35So I claim I'm for done for games of length one.
  289. 16:38Everyone okay? So that step is deceptively
  290. 16:42easy but there it is. All right, now we do the
  291. 16:45inductive step, the big step.
  292. 16:47What we're going to do is we're going to assume that the
  293. 16:50statement of the theorem, which I've now hidden
  294. 16:53unfortunately--let me unhide it if I can, it's not going to be
  295. 16:57easy.
  296. 17:05This now visible? So now let's assume that the
  297. 17:10statement of this theorem is true for all games length <
  298. 17:17= N, suppose that's the case. Suppose the claim is true for
  299. 17:29all games of this type, of length <= some N.
  300. 17:41What we need to show is--what we're going to try and show is
  301. 17:45therefore it will be true for all games of length N + 1.
  302. 17:50What we want to show is--we claim, therefore,
  303. 17:58it will be true for games of length N + 1,
  304. 18:07that's the key step in inductive proofs.
  305. 18:16All right, so how are we going to do that?
  306. 18:19Well let's have a look at a game of length N + 1,
  307. 18:22and obviously I can't use thousands here so let me choose
  308. 18:24from relatively small numbers, but the idea will go through.
  309. 18:28So let's have a look at a game. So here's a game in which
  310. 18:34Player 1 moves first, Player 2 moves second.
  311. 18:40Let's suppose that if Player 2 does this, then 1 only has
  312. 18:44little choice here, up here then one has a more
  313. 18:48complicated choice, and perhaps 2 could move again.
  314. 18:53So this is quite a complicated little game up here,
  315. 18:55and down here let's make it a little bit less complicated.
  316. 18:58Here the game looks like this and then comes to an end,
  317. 19:02so the tree looks like this. I haven't put the end,
  318. 19:06I haven't put the outcomes on it but the tree looks like this.
  319. 19:09So how long is this tree first of all?
  320. 19:12Well I claim that the longest path in this tree,
  321. 19:16from the beginning to the end has four steps.
  322. 19:20Let's just check. So one, two,
  323. 19:23three, four that's what I claim is the longest path.
  324. 19:27Any path going down this way only has three moves in it,
  325. 19:33so this is a game of length four.
  326. 19:36So we can apply it to our claim, let's assume that the
  327. 19:42theorem holds for all trees length three or fewer,
  328. 19:47so that N + 1 is 4 for the purpose of our example.
  329. 19:51So in this example--I don't want to put it here,
  330. 19:57let's put it here--in this example N = 3,
  331. 20:03so that N + 1 = 4. Everyone happy with this in the
  332. 20:09example? Now what I want to observe
  333. 20:12about this is the following: contained in this N + 1,
  334. 20:17or the game of length 4 are some smaller games.
  335. 20:21You could think of them as sub-games.
  336. 20:23They're games within the game, is that right?
  337. 20:26So let's have a look. I claim, in particular--draw
  338. 20:31around them in pink--there's a game here that follows Player 1
  339. 20:40choosing Up and there's a game here that follows Player 1
  340. 20:47choosing Down, is that right?
  341. 20:53Okay, so these are both games, and what do we have here?
  342. 20:58So this little game in here--the game in the top
  343. 21:02circle, the game that follows Player 1 moving up--that's a
  344. 21:06game and it has a length. So this little thing is a game
  345. 21:10and I'm going to call it a sub-game, some jargon that we'll
  346. 21:14be getting used to later on in the semester.
  347. 21:17It's a game within the game, but it's basically just a game:
  348. 21:25it's a sub-game and this is a sub-game following 1 choosing
  349. 21:32Up--let's put Up in here--following up.
  350. 21:38And I claim that this game has a length--this sub-game has a
  351. 21:41length. So we knew that we started from
  352. 21:44a game of length 4, we've taken one of the moves,
  353. 21:46and let's just make sure this is actually a game of length 3.
  354. 21:50So the game started here, this would be a game of length
  355. 21:533 because you could go one, two, three moves,
  356. 21:55is that right? So this is a game of length 3.
  357. 21:59So this is a sub-game following 1 choosing Up and it,
  358. 22:08the sub-game, has length 3.
  359. 22:13Down here, this is also a sub-game, it's a game that
  360. 22:21follows Player 1 choosing Down and this little sub-game has
  361. 22:29length--now here we have to be a little bit careful--you might
  362. 22:39think that since we started from a game of length 4,
  363. 22:48after the first move we must be in a game of length 3.
  364. 22:53But actually that's not true, and if we look carefully,
  365. 22:56we'll notice that this game down here, the game starting
  366. 22:58here actually isn't of length 3. It's of length 2.
  367. 23:02Is that right? So even though started from a
  368. 23:04game of length 4, by going this way we put
  369. 23:06ourselves into a game of length 2.
  370. 23:08Is that right? So 1,2 or 1,2--whatever--it has
  371. 23:16length 2. Okay, all right so in this
  372. 23:20example N is 3 and N + 1 is 4, and our assumption,
  373. 23:25our induction assumption is what?
  374. 23:29We've assumed that the claim of the theorem holds for all games
  375. 23:38<= N, which in this case means <= 3.
  376. 23:44So what does that tell us? That tells us,
  377. 23:47by our assumption, this game, which I've put a
  378. 23:51pink circle around on the top, this is a game of length 3,
  379. 23:56this game has a solution. It must have a solution because
  380. 24:02it's of length 3 or less. So by the induction hypothesis
  381. 24:07as it's called--by the induction hypothesis--this is a technical
  382. 24:14term, but what's the induction hypothesis?
  383. 24:19It's this thing. By the assumption that we made
  384. 24:29this game has a solution. So it's a game of length 3,3
  385. 24:38<= N in this case. So this game must have a
  386. 24:40solution. Now I don't immediately know by
  387. 24:44staring at it what it is, but let's suppose it was W,
  388. 24:50say it was W. And the game down below,
  389. 24:53this is also a game, and it's a game of length 2 but
  390. 24:572 is less than 3 as well, 2 <= 3.
  391. 25:00So this game also has a solution.
  392. 25:06This game also, by the same assumption,
  393. 25:13has a solution, so its solution is say--I don't
  394. 25:22know--maybe its L. So what does that mean to say
  395. 25:29that these games have solutions, in this case we're going to
  396. 25:33assume W is this one, and L is this one,
  397. 25:35what does it mean? It means that,
  398. 25:38just as we did with the games up there, we could put the
  399. 25:41solution at the beginning of the game.
  400. 25:44We know that if we get into this game, we're going to get
  401. 25:47the solution of this game; and we know if we get into this
  402. 25:51game, we're going to get the solution of this game.
  403. 25:54So we can replace this one with its solution which by assumption
  404. 25:58was W, and this one by its solution which by assumption was
  405. 26:03L. And here I want to be really
  406. 26:04careful, I need to keep track of which person it is it's a win or
  407. 26:08loss for. So this was a win for Player 1,
  408. 26:10hence it was a loss for Player 2, and this was a loss for
  409. 26:14Player 1, hence it was a win for Player 2.
  410. 26:18So these games, each of them have some
  411. 26:22solution, and this case I've written down the solutions as W
  412. 26:28or L. So now what could we do?
  413. 26:31Let me just bring down this board again.
  414. 26:33I can translate this game into a very simple game.
  415. 26:37I'm going to translate it up here, so this game can be
  416. 26:40translated as follows. Player 1 moves,
  417. 26:47if he goes Up then he hits a W and if he goes Down he hits a L.
  418. 27:06So in this particular example, Player 1 is effectively
  419. 27:09choosing between going Up and finding himself in a game which
  420. 27:13has a solution, and the solution is he wins it,
  421. 27:16or going Down and finding himself in a game which has a
  422. 27:20solution, and the solution is he's toast.
  423. 27:24But that's what? That's a one move game.
  424. 27:29So we know this has a solution, and in particular,
  425. 27:31he's going to choose Up. This one has a solution.
  426. 27:37This has a solution, it is a game of length 1.
  427. 27:55So what do we do? Somewhat schematically,
  428. 27:59we took a game of length N + 1, in this case that was 4;
  429. 28:04and we pointed out that once Player 1 has made her first move
  430. 28:09in this game, we are in a game,
  431. 28:12or in a sub-game if you like, that has length less than 4,
  432. 28:15it could be 3, it could be 2,
  433. 28:17whatever. Whatever sub-game we're in,
  434. 28:21by assumption, that game has a solution.
  435. 28:26So it's really effectively, Player 1 is choosing between
  436. 28:29going into a game with solution W or going into a game with
  437. 28:33solution L. And if there were 15 other
  438. 28:35sub-games here, each one would have a solution,
  439. 28:37and each one Player 1 would be able to associate that solution
  440. 28:41with what he's going to get--what she's going to get.
  441. 28:44So I claim that, if it in fact is true that each
  442. 28:49of these sub-games of length 3 or less had a solution,
  443. 28:55then the game of length 4 must have a solution,
  444. 28:59which is what? It's the solution which is:
  445. 29:03Player 1 should pick the best sub-game.
  446. 29:07Are people convinced by that step?
  447. 29:11People are looking slightly "deer in the headlamps" now,
  448. 29:15so let me just say it again. We started by assuming that all
  449. 29:20games of length 3 or less, or N or less,
  450. 29:23have a solution. We pointed out that any game
  451. 29:27that has length N + 1 can be thought of as an initial move by
  452. 29:32Player 1 followed by a game of length N or less,
  453. 29:37N or fewer I should say. Each of those games of N or
  454. 29:41fewer steps has a solution, so Player 1 is just going to
  455. 29:45choose the game that has the best solution for her and we're
  456. 29:49done. In this particular example,
  457. 29:54Player 1 is going to choose Up and therefore the solution to
  458. 30:02this parent game is Player 1 wins.
  459. 30:07Now the hard step I think in proofs by induction is realizing
  460. 30:11that you're done. So I claim we're now done,
  461. 30:15why are we done? Well we know that it was pretty
  462. 30:19easy that all games of length 1 have a solution.
  463. 30:23That was pretty trivial. And we've shown that if any
  464. 30:27game of length of N or fewer has a solution, then games of N + 1
  465. 30:32have a solution. So now let's see how we can
  466. 30:35proceed. We know that games of length 1
  467. 30:38have a solution, so let's consider games of
  468. 30:41length 2. Games of length 2,
  469. 30:43do games of length 2 have a solution?
  470. 30:45Well let's set N = 1. We know that if games of length
  471. 30:501 have a solution, then any game of length 2 could
  472. 30:52be thought of as an initial step followed by a game of length 1,
  473. 30:56but that has a solution, so therefore games of length 2
  474. 30:59have a solution. Now let's think of games with
  475. 31:01length 3, we've shown that games with length 1 have a solution
  476. 31:04and games with length 2 have a solution.
  477. 31:06Any game of length 3 can be thought of as a game in which
  478. 31:09there's an initial step followed by either a game of length 1 or
  479. 31:13a game of length 2, each of which have a solution,
  480. 31:16so once again a game of length 3 has a solution and so on.
  481. 31:20So games of induction, they work by building up on the
  482. 31:23length of the game, and we're ending up knowing
  483. 31:26that we're done. For those people who have never
  484. 31:29seen a proof by induction don't worry I'm not going to test you
  485. 31:34on a proof with induction on the exam,
  486. 31:37I just wanted you to see one once.
  487. 31:39Let's all take a deep breath and try and digest this a little
  488. 31:43bit by playing a game. I'll leave it up there so you
  489. 31:48can stare at it. We'll want it down again later.
  490. 31:57Let's try and actually play a game and see if we can actually
  491. 32:04throw any light on this. So I'm going to pick out
  492. 32:07volunteers like I did last time, but first of all,
  493. 32:10let me tell you what the game is.
  494. 32:11So once again I'm going to have rocks in this game,
  495. 32:14and once again I'm going to approximate those rocks with
  496. 32:17marks on the blackboard. So here's an example.
  497. 32:23The example is this. The game involves an array of
  498. 32:29rocks, so here the array has five rows and three columns.
  499. 32:37So the rocks are not arranged as they were before in piles,
  500. 32:41but rather in a sort of in a pretty array.
  501. 32:43I should have made it more even but this is: one,
  502. 32:45two, three, four, five rows;
  503. 32:47and one, two, three columns,
  504. 32:49at least in this example. But in general there's an array
  505. 32:59of rocks, N x M. We're going to play
  506. 33:04sequentially with the players. And the way the game is going
  507. 33:10to work is this--is when it's your turn to move,
  508. 33:17you have to point to one of these rocks and whichever rock
  509. 33:21you point to I will remove. I will delete that rock and all
  510. 33:26the rocks that lie above or to the right of it:
  511. 33:29all the rocks that lie to the northeast of it.
  512. 33:32So for example, if you pointed to this rock,
  513. 33:36then I will remove this rock and also this one,
  514. 33:41this one, and this one. If the next person comes along
  515. 33:46and chooses this one, then I will remove this one,
  516. 33:50and also that one. Okay, everyone understand?
  517. 33:53All right and the game is lost--this is important--the
  518. 34:00game is lost by the person who ends up taking the last rock.
  519. 34:08The loser is the person who ends up removing the last rock.
  520. 34:18Could I have some volunteers? Can I volunteer people then?
  521. 34:24How about the guy with the white t-shirt with the yellow on
  522. 34:28there? Okay, come on up front,
  523. 34:31and who else can I volunteer. Everyone's looking away from
  524. 34:36me, desperately looking away from me.
  525. 34:39How about the guy with the Yale sweatshirt on,
  526. 34:42the Yale football sweatshirt on, okay.
  527. 34:46So come on up. Your name is?
  528. 34:47I should get a mike, let me get a mike up here,
  529. 34:53thank you. Great, your name is?
  530. 34:55Student: Noah. Professor Ben Polak:
  531. 34:57Noah and your name is? Student: Koran.
  532. 34:58Professor Ben Polak:Say it into the mike.
  533. 34:59Student: Koran. Professor Ben Polak:
  534. 35:00Koran okay. So Noah and Koran are our
  535. 35:02players. Everyone understand the rules?
  536. 35:05Do you understand the rules? Yeah?
  537. 35:06So why don't we make Noah go first.
  538. 35:08So Noah which rock are you going to remove?
  539. 35:10Remember the last rock loses. Student: That one.
  540. 35:14Professor Ben Polak: That one.
  541. 35:15Okay, so Noah chose this one. So I'm going to remove this one
  542. 35:19and the one above it. Student: So all the
  543. 35:22rocks to the north and east are deleted, right?
  544. 35:23Professor Ben Polak: All the rocks to the north and east
  545. 35:27of it are deleted. That means you--last rock loses.
  546. 35:32Okay good. Student: That one.
  547. 35:47Professor Ben Polak: That one okay.
  548. 35:49So now we have an L shape. Student: That one.
  549. 36:00Professor Ben Polak: That one, all right.
  550. 36:05Student: That one. Professor Ben Polak:
  551. 36:06That one okay, okay.
  552. 36:07All right so we're done. Okay, everyone understand how
  553. 36:10that worked? Round of applause for our
  554. 36:14players please, thank you.
  555. 36:17Let me get two more volunteers now that everyone has seen it.
  556. 36:19These guys had the hard job, they had to figure it out cold.
  557. 36:23Two more volunteers? Oh I don't have to pick
  558. 36:26volunteers--this is Yale, somebody volunteer.
  559. 36:28Are you volunteering? Great.
  560. 36:29I have one volunteer. You can pick an opponent if you
  561. 36:35like. There you go thank you.
  562. 36:38Your name is, let's just wait until the mikes
  563. 36:43are here. So your name is?
  564. 36:45Student: Peter. Professor Ben Polak:
  565. 36:47Peter and your name is Justin. Student: Justin.
  566. 36:50Professor Ben Polak: Let me put a new array up here.
  567. 36:56So let's put a new array up here and this time let's make
  568. 36:59it--it doesn't have to be odd. So let's make it this time a
  569. 37:01little bit more complicated. So we'll have five--let's have
  570. 37:08four rows and five columns this time.
  571. 37:15Okay so last time I had five rows and three columns,
  572. 37:21and this time I have four rows and five columns.
  573. 37:27Away you go, let me move out of the way.
  574. 37:30Why don't you stand a bit nearer to the board--make it a
  575. 37:32little easier for people to see what's going on,
  576. 37:33there you go. So Peter you want to go first?
  577. 37:36Student: Sure, that one. Professor Ben Polak:
  578. 37:39That one okay. So this one goes,
  579. 37:41which means all of these go as well.
  580. 37:46Anyone got any advice from the floor?
  581. 37:48Shout things out, not too loud.
  582. 37:54Student: I'll try going here.
  583. 37:55Professor Ben Polak: There.
  584. 37:55Okay we're back to our L shape again here.
  585. 38:10Now people can see what's going on all right.
  586. 38:15Student: I'll go here and speed it up.
  587. 38:16Professor Ben Polak: All right thank you.
  588. 38:18So a round of applause again. Thank you guys.
  589. 38:26So here's what I claim about this game.
  590. 38:27First, and this isn't a formal claim, this is a lot harder than
  591. 38:30the game we played last time, right?
  592. 38:32Everyone is convinced by that all right.
  593. 38:34So here's going to be an exercise, or something that's a
  594. 38:37challenge. I may even put it formally on
  595. 38:40the problem set this week, but let me just say if I do put
  596. 38:43this on the problem set this week,
  597. 38:45I don't expect you all to solve it.
  598. 38:47So if I do put it on the problem set, it's an optional
  599. 38:49problem. But here's the challenge,
  600. 38:53the challenge is, I know from Zermelo's theorem
  601. 38:59that no matter what N is, and no matter what M is,
  602. 39:06this game has a solution. So Zermelo's theorem tells us
  603. 39:16this game has a solution. Now, notice it could have a
  604. 39:22different solution depending on the N and the M,
  605. 39:24depending on how many rows and how many columns,
  606. 39:27is that right?. So depending on N and M,
  607. 39:31each such game has a solution--is that right--which
  608. 39:38could depend on N and on M, on the number of rows and
  609. 39:45columns. So just as in Nim,
  610. 39:48it depended on how those piles started out.
  611. 39:52So what's going to be the homework assignment?
  612. 39:55Find the solution. Homework- what is the solution?
  613. 40:13So I claim, let me give you a hint, I claim it is useful to
  614. 40:19remember that there is a solution.
  615. 40:23It turns out to be useful to remember that.
  616. 40:24That wasn't much of a hint. You knew that already,
  617. 40:26but let me just emphasize that. Okay, so I want to do a bit of
  618. 40:30a transition now away from these games like chess and like
  619. 40:35checkers, and like this game with the
  620. 40:38rocks or Nim, and I want to be a little bit
  621. 40:40formal for a while. So one thing that we haven't
  622. 40:43done for a while, actually since the mid-term,
  623. 40:45is write down some formal definitions.
  624. 40:47So I'm going to do that now. I want at least one of these
  625. 40:52boards back.
  626. 41:16So as I warned very early in the class, there are some points
  627. 41:19of the day when we have to stop and do some work and the next
  628. 41:23twenty minutes or so is such a point.
  629. 41:41So what is this? This is formal stuff.
  630. 41:48The first thing I want to do is I want to give you a formal
  631. 41:51definition of something I've already mentioned today and
  632. 41:54that's the idea of perfect information.
  633. 41:57What we've been looking at, or at least since the mid-term,
  634. 42:00are games of perfect information.
  635. 42:02So a game of perfect information is one in which at
  636. 42:20every node, or at each node in the game the player whose turn
  637. 42:41it is to move at that node knows which node she is at.
  638. 43:02So it's a very simple idea. Every game we've seen since the
  639. 43:04mid-term has this property. When you're playing this game
  640. 43:08you know where you are. So you know which node you're
  641. 43:13at, you know what your choices are and what that means
  642. 43:21implicitly is she must know how she got there.
  643. 43:27So the whole history of the game is observed by everybody.
  644. 43:30When I get to move I know what you did yesterday,
  645. 43:32I know what I did the day before yesterday,
  646. 43:35and if I'm playing with a third person I know what they did the
  647. 43:38day before that. So a very simple idea but it
  648. 43:41turns out to be an idea that actually allows us to use things
  649. 43:46like backward induction very simply.
  650. 43:50Now so far all we've been doing is thinking about such games,
  651. 43:54games like perfect competition, sorry games like quantity
  652. 43:57competition between firms or games like the games where we
  653. 44:00were setting up incentives or games like Nim,
  654. 44:03and we've basically been solving these games by backward
  655. 44:05induction, rather informally. What I want to add in now is
  656. 44:09the notion of a strategy in these games.
  657. 44:11So when we had simultaneous move games, strategies were
  658. 44:14really unproblematic. It was obvious what strategies
  659. 44:17were. But when we have games which
  660. 44:19are sequential, that go on over a period of
  661. 44:22time, and information is emerging
  662. 44:24over a period of time, we need to be a little careful
  663. 44:27what we mean by a strategy. So what I want to do is I want
  664. 44:31to define a pure strategy at least as follows.
  665. 44:35So a pure strategy for Player i in a game of perfect
  666. 44:47information--so in the games we've been talking about,
  667. 45:00games which we can represent by trees is what?
  668. 45:03It's a complete plan of action. So in other words,
  669. 45:25what it does is it specifies which action I should
  670. 45:35take--let's not make it should take--let's say will
  671. 45:46take, at each of i's nodes,
  672. 45:52each of i's decision nodes. So when you first read this
  673. 46:00definition it seems completely uninteresting and unproblematic.
  674. 46:03A pure strategy for Player i just tells you in this game
  675. 46:07whenever you might be called upon to move,
  676. 46:09it tells you how you're going to move.
  677. 46:12So if you're going to move three times in the game,
  678. 46:14it tells you how you're going to move the first time;
  679. 46:16it tells you how you're going to move the second time;
  680. 46:18and it tells you how you're going to move the third time.
  681. 46:23So, so far none of this seems difficult but actually it's a
  682. 46:27bit more difficult than it looks.
  683. 46:29So let's have a look.
  684. 46:41What I want to do is I want to look at an example,
  685. 46:44and this example I'm hoping is going to illustrate some
  686. 46:46subtleties about this definition.
  687. 46:57So here's an example.
  688. 47:04In this example Player 1 moves first and they can choose in or
  689. 47:08out, or if you like let's call it up or down since that's the
  690. 47:12way we've drawn it. So they can choose down or
  691. 47:16up--and I'll use capital letters U and D.
  692. 47:20If Player chooses U then Player 2 gets to move and Player 2 can
  693. 47:29choose L or R. If Player 1 moves U followed by
  694. 47:34Player 2 choosing L, then Player 1 gets to move,
  695. 47:38in which case Player 1 could move up or down and I'll use
  696. 47:41little letters this time, u and d.
  697. 47:45Let's put some payoffs in this game.
  698. 47:48So the payoffs are 1,0 here, 0,2 here, 3,1 here and 2,4
  699. 48:00here. So on paper--it's on the
  700. 48:03board--when you first look at it, this is a perfectly simple
  701. 48:06game. It's just like many of the
  702. 48:07games we've been looking at since the mid-term.
  703. 48:09It has a tree. We could analyze it by backward
  704. 48:12induction, and in a moment we will analyze it by backward
  705. 48:15induction. But what I want to do first is
  706. 48:18I want to say what are the strategies in this game?
  707. 48:21So let's start with Player 2 since it's easier.
  708. 48:27Player 2's strategies here are what?
  709. 48:34Pretty simple: player 2 only has one decision
  710. 48:37node--here's Player 2's decision node--and the strategy has to
  711. 48:42tell Player 2 what he's going to do at that decision node.
  712. 48:47So there's only two choices, L or R.
  713. 48:49So Player 2's strategies are either L or R.
  714. 48:57Notice, however, already one slight subtlety
  715. 49:00here. Player 2 may never get to make
  716. 49:05this choice. So Player 2 is choosing L or R,
  717. 49:08but Player 2 may not ever get to make this choice.
  718. 49:11In particular, if 1 chose D it's really
  719. 49:14irrelevant whether Player 2 has chosen L or R.
  720. 49:17Nevertheless, the strategy has to specify
  721. 49:21what Player 2 would do were he called upon to make that move.
  722. 49:28Now let's look at Player 1's strategies.
  723. 49:37So what are Player 1's strategies in this game?
  724. 49:45Any takers? Anyone want to guess?
  725. 49:54So I claim it's tempting, but it turns out to be wrong,
  726. 49:59to say that Player 1 has three strategies here.
  727. 50:03It's tempting to say either Player 1 moves D,
  728. 50:08in which case we're done, or Player 1 moves U,
  729. 50:14in which case at some later date she may be called upon to
  730. 50:19choose u or d again. So it's very tempting to think
  731. 50:23that Player 1 has just three strategies here,
  732. 50:26D in which case we're done, or U followed by either u or d,
  733. 50:34if she's reached that point. But actually,
  734. 50:39if we follow this definition carefully, we notice that Player
  735. 50:431 actually has four strategies here.
  736. 50:46So let me say what they are and you'll see why it's a little
  737. 50:49odd. So here's one of the strategies
  738. 50:52we talked about, U followed by u,
  739. 50:54and here's another one we talked about,
  740. 50:56U followed by d, but I claim there are two
  741. 51:03others, D followed by u and D followed by d.
  742. 51:11So what's a little weird about this?
  743. 51:13What's weird is we know perfectly well that if Player 1
  744. 51:18chooses D she's not going to get to make the choice,
  745. 51:22the second choice u or d. But nevertheless the strategy
  746. 51:27has to tell us what she would do at every node,
  747. 51:31regardless of whether that node actually is reached by that
  748. 51:35strategy. Let me say it again,
  749. 51:38the strategy has to tell you what Player 1 would do at that
  750. 51:43node, regardless of whether that node
  751. 51:46is actually reached by playing that strategy.
  752. 51:50So a little weird. There's a bit of redundancy
  753. 51:54here. It's a bit redundant.
  754. 52:02Now why? Well we'll see why in a second.
  755. 52:05Let's first of all consider how this game will be played
  756. 52:09according to backward induction. So how do we play this game
  757. 52:13according to backward induction? Where do we start?
  758. 52:18Shouldn't be a trick question, where do we start the game
  759. 52:21according to backward induction? At the end okay.
  760. 52:25So the end here is Player 1 and Player 1 will choose here to go
  761. 52:32d, is that right? Because 3 is bigger than 2.
  762. 52:36So if we roll back to Player 2's move, Player 2 if she
  763. 52:40chooses L she knows that she'll be followed by Player 1 going d,
  764. 52:46in which case she'll get 1, but if she chooses R she'll get
  765. 52:512. So Player 2 will choose R.
  766. 52:56So Player 1 here, if she chooses U then Player 2
  767. 53:01will choose R and Player 1 will get 0, and if she chooses D
  768. 53:07she'll get 1, so Player 1 will choose D.
  769. 53:12So, backward induction suggests that Player 1 will choose D;
  770. 53:18and followed by Player 2--if Player 2 did get to move--she'd
  771. 53:22choose R; followed by Player 1--if she
  772. 53:25did get to move again--choosing d again.
  773. 53:28Notice that backward induction had to tell us what Player 2
  774. 53:35would have done had she got to move.
  775. 53:39Backward induction had to consider what Player 2 would
  776. 53:43think that Player 1 would have done were Player 1 to get to
  777. 53:47move again. So to do backward induction,
  778. 53:51Player 1 has to ask herself what Player 2 is going to do;
  779. 53:56and Player 2 has to therefore ask herself what Player 1 would
  780. 54:00have done; which means Player 1 has to ask
  781. 54:02herself what Player 2 thinks Player 1 would have done;
  782. 54:04which means we actually needed to say what Player 1 did over
  783. 54:09here. Let me say that again.
  784. 54:10So backward induction here tells us that Player 1 chooses D
  785. 54:13in which case the game is over. But to do backward induction,
  786. 54:17to think through backward induction, we really needed to
  787. 54:21consider not just what Player 2 was going to do were he to get
  788. 54:25to move, but also what Player 2 would
  789. 54:28think Player 1 would do were Player 2 to get to move and were
  790. 54:33to do choose L. So all of these redundant moves
  791. 54:37were actually part of our backward induction.
  792. 54:41We need them there so we can think about what people are
  793. 54:45thinking. So backward induction tells us
  794. 54:49that the outcome of the game is D, but it tells in terms of
  795. 54:54strategies, Player 1 chooses D and,
  796. 54:57were she to get to move again, would choose D again.
  797. 55:01And Player 2 chooses R. Now let's analyze this game a
  798. 55:12totally different way. We now know what the strategies
  799. 55:16are in the game: Player 2 has two strategies,
  800. 55:19L and R; and Player 1 has four
  801. 55:23strategies: U/u, U/d, D/u and D/d.
  802. 55:30So let's write up the matrix for this game,
  803. 55:35so here it is. It must be a 4 x 2 matrix,
  804. 55:40Player 2 is choosing between L and R and Player 1 is choosing
  805. 55:48between her four strategies Uu, Ud, Du and Dd and we can put
  806. 55:58all the payoffs in. So (Uu,L) gets us here which is
  807. 56:07(2,4). (Uu,R) gets us here which is
  808. 56:15(0,2). (Ud,L) gets us here which is
  809. 56:23(3,1). (Ud,R) gets us here again which
  810. 56:29is (0,2). And Du gets us,
  811. 56:32going right out of the game immediately, so we're going to
  812. 56:37go to (1,0). And in fact that's also true
  813. 56:42for (Du,R), and it's also true for (Dd,L) and it's also true
  814. 56:49for (D/d,R). So all of these four strategies
  815. 56:52at the bottom started off by Player 1 choosing D,
  816. 56:55in which case the game is over. So once again in this matrix
  817. 56:59you can kind of see the redundancy I was talking about.
  818. 57:02In this matrix, the third row,
  819. 57:06the Du row looks the same as the Dd row.
  820. 57:11Everyone happy with that? So when we've had matrices in
  821. 57:17the past how have we solved the game?
  822. 57:20Well we've been doing this backward induction stuff for a
  823. 57:23couple of weeks, but,
  824. 57:23prior to the mid-term--if I had given you this on the mid-term
  825. 57:27what would you have done? You'd look for a Nash
  826. 57:31Equilibrium right? So let's do that:
  827. 57:33let's look for Nash Equilibrium.
  828. 57:35So if Player 2 chooses L then Player 1's best response is Uu;
  829. 57:45and if Player 2 chooses R, then Player 1's best response
  830. 57:53is either Du or Dd. Conversely, if Player 1 chooses
  831. 57:58Uu then Player 2's best response is L.
  832. 58:02If Player 1 chooses Ud then Player 2's best response is R.
  833. 58:09If Player 1 chooses Du then Player 2 doesn't care because
  834. 58:13they're getting 0 anyway; and if Player 1 chooses Dd then
  835. 58:19again Player 2 doesn't care because they're getting 0
  836. 58:25anyway. So the Nash Equilibria in this
  837. 58:28game are what? So one of them is here,
  838. 58:33so that's one Nash Equilibrium. One of them is Dd followed by
  839. 58:44R, and that's a Nash Equilibrium we actually found by backward
  840. 58:54induction. The Nash Equilibrium (Dd,R)
  841. 58:59corresponds to the one we found by backward induction.
  842. 59:06But there's another Nash Equilibrium in this game.
  843. 59:08The other Nash Equilibrium in this game is this one.
  844. 59:14That's also a Nash Equilibrium. What does it involve?
  845. 59:17It involves Du and R--sorry Du and R.
  846. 59:35So what happened in that equilibrium?
  847. 59:38Player 1 went down which made everything else kind of
  848. 59:41irrelevant. Player 2 played R and Player 1
  849. 59:45in their plan of action was actually going to choose u.
  850. 59:52Say it again, Player 1 in fact went D,
  851. 59:55Player 2 had they got to move would have chosen R and Player 1
  852. 1:00:01had they got to move at this second time would have chosen u.
  853. 1:00:07So how can that be a Nash Equilibrium?
  854. 1:00:08It doesn't correspond to backward induction.
  855. 1:00:11In particular, Player 1 up here is choosing a
  856. 1:00:15strategy that seems silly. They're choosing u rather than
  857. 1:00:21d which gets them 2 rather than 3.
  858. 1:00:24So how could it possibly be that that's an equilibrium
  859. 1:00:28strategy? The reason is--the reason it
  860. 1:00:30can be an equilibrium strategy is it doesn't really matter what
  861. 1:00:33Player 1 chooses up here from Player 1's point of view because
  862. 1:00:37it's never going to be reached anyway.
  863. 1:00:39As long as Player 2 is going to choose R here,
  864. 1:00:43it really doesn't matter what Player 1 decides to do up there.
  865. 1:00:49From Player 1's point of view, it doesn't make a difference.
  866. 1:00:51It isn't reached anyway. So we're highlighting here a
  867. 1:00:56danger, and the danger is this. If you just mechanically find
  868. 1:01:01the Nash Equilibria in a game, you're going to find people
  869. 1:01:06choosing actions that, if they ever were called upon
  870. 1:01:12to make them, are silly.
  871. 1:01:14Say it again, if you just mechanically find
  872. 1:01:17the Nash Equilibria in the game, just as we did here,
  873. 1:01:19you're going to select some actions, in this case an action
  874. 1:01:23by Player 1, that were she called upon to
  875. 1:01:26take that action would be a silly action.
  876. 1:01:29The reason it's surviving our analysis is because in fact she
  877. 1:01:33isn't called upon to make it. Now to make that more concrete,
  878. 1:01:38let's take this to an economic example, this same idea.
  879. 1:01:57So what I want you to imagine is a market, and in this market
  880. 1:02:02there is a monopolist who controls the market,
  881. 1:02:06but there's an entrant who is thinking of entering into this
  882. 1:02:10market. So right now this market has a
  883. 1:02:14monopoly in it, and the monopolist is an
  884. 1:02:17incumbent--let's call him Inc--and an entrant who is
  885. 1:02:22trying to decide whether or not to enter the market or whether
  886. 1:02:27to stay out. If they stay out then the
  887. 1:02:31entrant gets nothing and the incumbent continues to get
  888. 1:02:35monopoly profits. So think of this as 3 million a
  889. 1:02:40year. If the entrant enters then the
  890. 1:02:43incumbent can do one of two things.
  891. 1:02:46The incumbent could choose to fight the entrant,
  892. 1:02:49by which I mean charge low prices, advertise a lot,
  893. 1:02:52try and drive him out of the market.
  894. 1:02:55He could play very competitively,
  895. 1:02:58in which case the entrant will actually make losses,
  896. 1:03:02and the incumbent will drive her profits down to zero.
  897. 1:03:08Conversely, the incumbent could choose not to fight.
  898. 1:03:13If they don't fight then they'll simply share the market
  899. 1:03:17and they'll both make, let's say Cournot profits or
  900. 1:03:20duopoly profits of a million each.
  901. 1:03:23So in this game, let's just say again,
  902. 1:03:25there's a market there. The monopolist is in the market
  903. 1:03:29and the monopolist is making 3 million a year which seems
  904. 1:03:32pretty nice for the monopolist. The entrant is trying to decide
  905. 1:03:36whether to invade this market. If she invades this market,
  906. 1:03:40if she's fought she's in trouble, but if the monopolist
  907. 1:03:44accommodates her, then they just go to duopoly
  908. 1:03:47profits and the entrant does very well, gets a million
  909. 1:03:51dollars in profit. Let's have a look at this game.
  910. 1:03:55Analyze--first of all this time, let's analyze it by Nash
  911. 1:03:58Equilibrium. So I claim in this game,
  912. 1:04:02this is pretty simple: the entrant has two strategies.
  913. 1:04:07I'll put it straight into the matrix.
  914. 1:04:08The entrant has two strategies, they're either to go in or to
  915. 1:04:19stay out; and the incumbent has two
  916. 1:04:24strategies, they are either to fight the entrant or not to
  917. 1:04:32fight. The payoffs of this game are as
  918. 1:04:34follows--let's put them in. In and fight was (-1,0),
  919. 1:04:38in and not fight was (1,1) and out led to the incumbents
  920. 1:04:44maintaining the monopoly profits.
  921. 1:04:48Let's have a look at the Nash Equilibria of this game.
  922. 1:04:52So the first thing to do is to look at the best responses for
  923. 1:04:56the entrant. So if the incumbent chooses
  924. 1:04:59fight, then the entrant's best response is to stay out.
  925. 1:05:04If the incumbent chooses not fight, then the entrant's best
  926. 1:05:11response is to enter. How about for the incumbent?
  927. 1:05:15If the entrant chooses to come in then the incumbent's best
  928. 1:05:20response is not to fight because 1 is bigger than 0.
  929. 1:05:24But if the entrant stays out it really doesn't matter what the
  930. 1:05:30incumbent does, they'll get 3 either way.
  931. 1:05:34So the Nash Equilibria here are either in followed by not
  932. 1:05:42fighting, you end up with a duopoly, or out followed by
  933. 1:05:50fighting. Of course the fight doesn't
  934. 1:05:54take place: out followed by "we would have fought had you
  935. 1:05:59entered." So these are the Nash
  936. 1:06:02Equilibria. Let's analyze this game by
  937. 1:06:04backward induction. From the incumbent's point of
  938. 1:06:08view, if the incumbent gets to move then is she going to choose
  939. 1:06:14fight or not fight? She's going to choose not
  940. 1:06:19fight, so the entrant should do what?
  941. 1:06:23Somebody? The entrant should enter,
  942. 1:06:25because if she enters she gets 1, if she stays out she gets 0.
  943. 1:06:28So backward induction just gives us this equilibrium.
  944. 1:06:41Now the question is what do we think is going on with this
  945. 1:06:44other equilibrium? Let's talk it through.
  946. 1:06:48So here you are, you're about to enter the
  947. 1:06:50market, you leave Yale, you set up your business,
  948. 1:06:52and your business is challenging some monopolist or
  949. 1:06:56quasi-monopolist like Microsoft say.,
  950. 1:06:58And you go out there and you're about to put out your new
  951. 1:07:01operating system. And you know that your new
  952. 1:07:04operating system will make plenty of money provided
  953. 1:07:07Microsoft doesn't retaliate and drop its prices by half and
  954. 1:07:12advertise you out of the market. So what does Bill Gates do?
  955. 1:07:16Bill Gates is the head of Microsoft.
  956. 1:07:17He says, wait a second before you graduate from Yale and go
  957. 1:07:21set up this company, let me just tell you I'm going
  958. 1:07:24to fight. If you enter I'm going to fight.
  959. 1:07:30And if you believe him, if you believe that he's going
  960. 1:07:34to fight, what should you do? You're not going to bother to
  961. 1:07:37enter his market. And if you believe that you're
  962. 1:07:39going to get fought by Bill Gates then you believe that if
  963. 1:07:42you enter you're going to make losses,
  964. 1:07:44so you choose to stay out. And this threat that Bill Gates
  965. 1:07:49makes here it doesn't cost him anything, provided you go out,
  966. 1:07:55he doesn't actually have to fight at all.
  967. 1:07:58That's why it is in fact an equilibrium to imagine you
  968. 1:08:02staying out believing that you're going to get fought if
  969. 1:08:06you enter, and it is a best response for
  970. 1:08:08the guy to fight knowing that you're going to stay out.
  971. 1:08:12But this doesn't sound right. Why doesn't this sound right?
  972. 1:08:17It doesn't sound right because you really shouldn't believe the
  973. 1:08:21guy who says he's going to fight you when you know that if you
  974. 1:08:25did enter fighting would cost the incumbent money.
  975. 1:08:29If you did enter, if he fights you he gets 0,
  976. 1:08:32if he doesn't fight he gets a million dollars.
  977. 1:08:36So this threat that the guy is going to fight you,
  978. 1:08:41this threat is not credible. This is an equilibrium but it
  979. 1:08:51relies on believing an incredible threat.
  980. 1:09:10It's true that if you think about entering the market that
  981. 1:09:13Microsoft is in, you're very likely to get a
  982. 1:09:15little email from Bill Gates. (But it won't be an email
  983. 1:09:19because that can be taken to Court, but some little
  984. 1:09:21threatening remark in your ear from Bill Gates.) It's true if
  985. 1:09:24you entered into the market that the people who build aircraft
  986. 1:09:28in, the head of Boeing might pay
  987. 1:09:30you a call one day or send someone round,
  988. 1:09:33but these threats are not credible threats.
  989. 1:09:36Is that right? They're not credible threats
  990. 1:09:38because we know that if you did enter, it isn't in their
  991. 1:09:42interest to fight. They're making a lot of noise
  992. 1:09:46about it but you know that if you did enter,
  993. 1:09:49backward induction tells us they're not going to fight.
  994. 1:09:53But now we're in slightly an odd situation,
  995. 1:09:57why are we in an odd situation? Two things.
  996. 1:10:01One, we seem to be finding that there are Nash Equilibria in
  997. 1:10:06games--we found one here and one up here--there are Nash
  998. 1:10:11Equilibria that are not supported by backward induction.
  999. 1:10:17That's the first reason we're a little worried here,
  1000. 1:10:21and the second reason we're worried is even the economics of
  1001. 1:10:25this doesn't quite smell right. For example,
  1002. 1:10:29if you in fact did enter--sorry,
  1003. 1:10:31if you did in fact announce you were going to operate,
  1004. 1:10:35you were going to build a new operating system and got a
  1005. 1:10:38threatening phone call from Bill Gates--there might be a reason
  1006. 1:10:42why you might actually believe that call.
  1007. 1:10:44Why might you believe that call? Can we get a mike out,
  1008. 1:10:52I'll do it. So why might you believe a call
  1009. 1:10:56from Bill Gates saying he's going to beat you up--not beat
  1010. 1:10:59you up but he's going to charge low prices if you produce an
  1011. 1:11:02operating system? Student: If you look at
  1012. 1:11:05the future revenue streams, like for the next ten years and
  1013. 1:11:07he consistently gets 1 million dollars for the next ten years,
  1014. 1:11:10he would be better off if he just drove you out of the market
  1015. 1:11:13for the first year and then get 3 million dollars for the next
  1016. 1:11:16nine years. Professor Ben Polak:
  1017. 1:11:17That wasn't quite what I wasn't thinking of.
  1018. 1:11:18Okay, it's true if we cheat a bit and make one of the--Okay,
  1019. 1:11:22so what you're saying is I could get 3 forever versus 1
  1020. 1:11:25forever, assume these are both present
  1021. 1:11:27discounted values of future cash earnings.
  1022. 1:11:29So we've done the future cash flow analysis of this.
  1023. 1:11:33So this isn't an accounting mistake, not for accounting
  1024. 1:11:37reasons. There's some other reason when
  1025. 1:11:40Gates threatens you, you might want to believe it.
  1026. 1:11:43Let's try up here first. Student: He can afford
  1027. 1:11:45to make an example of you so no other people will invade.
  1028. 1:11:48Professor Ben Polak: Right, so one thing that's in
  1029. 1:11:50Bill Gates' mind is right now, he's thinking about competing
  1030. 1:11:54with you but down the road there's a lot more of you guys
  1031. 1:11:59coming--whatever it is, 280 of you in this room and
  1032. 1:12:02there's another 280 in next year's class and so on.
  1033. 1:12:05And Bill Gates knows that each of you might come out and
  1034. 1:12:08threaten his monopoly, his Microsoft monopoly.
  1035. 1:12:11And he might think that by setting an example to one of you
  1036. 1:12:15he might be able to keep the others out.
  1037. 1:12:18And somewhere that kind of argument, the argument of making
  1038. 1:12:22an example of somebody is missing here:
  1039. 1:12:25missing completely. But it's got to be important,
  1040. 1:12:29it's got to be an important idea.
  1041. 1:12:31So we're going to come back and spend the first half of
  1042. 1:12:35Wednesday's class picking up just precisely that idea.

About this transcript

This page contains the full transcript of 15. Backward induction: chess, strategies, and credible threats by YaleCourses, generated from the public captions YouTube serves with the video. The transcript has 10,006 words across 1,042 segments, with the original timestamps preserved so you can click any line to jump to that moment in the embedded player.

What you can do with it

Use the transcript to take notes, quote the speaker, build a study guide, generate a summary with ChatGPT or Claude via the YouTube Summary tool, or export it as a timed subtitle file with YouTube to SRT. You can also re-open it in the transcriber to translate the transcript into 100+ languages.

Free YouTube transcript tool

YouTube2Text is a free YouTube transcript generator — no signup, no daily limit. Paste any YouTube link and get the full transcript instantly, with timestamps, click-to-jump, translation to 100+ languages, AI prompts for ChatGPT, Claude, and Gemini, and exports to TXT, SRT, VTT, or Markdown.