YouTube2Text

4. Foundations: Skinner — Transcript

by YaleCourses · 8,273 words · 960 segments · language en · Watch on YouTube

Full transcript

  1. 0:12Professor Paul Bloom: I actually want to begin by
  2. 0:15going back to Freud and hitting a couple of loose ends.
  3. 0:17There was a point in my lecture on Wednesday where I skipped
  4. 0:21over some parts. I said, "We don't have time for
  5. 0:24this" and I just whipped past it.
  6. 0:26And I couldn't sleep over the weekend.
  7. 0:28I've been tormented. I shouldn't have skipped that
  8. 0:31and I want to hit--Let me tell you why I skipped it.
  9. 0:35The discussion I skipped was the discussion of why we would
  10. 0:39have an unconscious at all. So, I was talking about the
  11. 0:42scientifically respectable ideas of Freud and I want to talk
  12. 0:46about some new ideas about why there could be an unconscious.
  13. 0:51Now, the reason why I skipped it is I'm not sure this is the
  14. 0:55best way to look at the question.
  15. 0:58As we will learn throughout the course, by far the vast majority
  16. 1:02of what our brains do, the vast majority of what our
  17. 1:06minds do, is unconscious and we're unaware of it.
  18. 1:09So the right question to ask may not be, "Why are some things
  19. 1:13unconscious?" but rather, why is this tiny
  20. 1:17subset of mental life--why is this conscious?
  21. 1:20On the other hand, these claims about the utility
  22. 1:23of unconsciousness, I think, are provocative and
  23. 1:26interesting. So I just wanted to quickly
  24. 1:29share them with you. So, the question is,
  25. 1:32from an evolutionary standpoint, "Why would an
  26. 1:34unconscious evolve?" And an answer that some
  27. 1:38psychologists and biologists have given is deception.
  28. 1:43So, most animals do some deception.
  29. 1:46And deception defined broadly is simply to act or be in some
  30. 1:50way that fools others into believing or thinking or
  31. 1:53responding to something that's false.
  32. 1:56There's physical examples of deception.
  33. 2:00When threatened, chimpanzees--their hair stands
  34. 2:03up on end and that makes them look bigger to fool others to
  35. 2:06thinking they're more dangerous than they are.
  36. 2:09There's an angler fish at the bottom of the ocean that has a
  37. 2:13rod sticking up from the top of its head with a lure to capture
  38. 2:16other fish – to fool them in thinking that this is something
  39. 2:20edible and then to themselves be devoured.
  40. 2:22But humans, primates in general but particularly humans,
  41. 2:27are masters of deception. We use our minds and our
  42. 2:32behaviors and our actions continually to try to trick
  43. 2:35people into believing what's not true.
  44. 2:38We try to trick people, for instance,
  45. 2:40into believing that we're tougher, smarter,
  46. 2:43sexier, more reliable, more trustworthy and so on,
  47. 2:48than we really are. And a large part of social
  48. 2:51psychology concerns the way in which we present ourselves to
  49. 2:54other people so as to make the maximally positive impression
  50. 2:57even when that impression isn't true.
  51. 3:00At the same time, though, we've also evolved very
  52. 3:05good lie detection mechanisms. So not only is there
  53. 3:09evolutionary pressure for me to lie to you, for me to persuade
  54. 3:13you for instance, that if we're going to have
  55. 3:15a--if you are threatening me don't threaten me,
  56. 3:18I am not the sort of man you could screw around with.
  57. 3:21But there's evolutionary pressure for you to look and
  58. 3:24say, "No. You are the sort of man you
  59. 3:25could screw around with. I can tell."
  60. 3:27So how do you become a good liar?
  61. 3:31And here's where the unconscious comes in.
  62. 3:34The hypothesis is: the best lies are lies we tell
  63. 3:38ourselves. You're a better liar,
  64. 3:41more generally, if you believe the lie that
  65. 3:45you're telling. This could be illustrated with
  66. 3:50a story about Alfred Hitchcock. The story goes--He hated
  67. 3:54working with child actors but he often had to.
  68. 3:58And the story goes--He was dealing with a child actor who
  69. 4:02simply could not cry. And, finally frustrated,
  70. 4:05Hitchcock went to the actor, leaned over,
  71. 4:07whispered in his ear, "Your parents have left you and
  72. 4:11they're never coming back." The kid burst into tears.
  73. 4:14Hitchcock said, "Roll ‘em" and filmed the
  74. 4:18kid. And the kid,
  75. 4:20if you were to see him, you'd say, "That's--Boy,
  76. 4:24he's--he really looks as if he's sad" because he was.
  77. 4:30If I had a competition where I'd give $100,000 to the person
  78. 4:34who looks the most as if they are in pain,
  79. 4:38it is a very good tactic to take a pen and jam it into your
  80. 4:43groin because you will look extremely persuasively as if you
  81. 4:47are in pain. If I want to persuade you that
  82. 4:51I love you, would never leave you, you can trust me with
  83. 4:55everything, it may be a superb tactic for me to believe it.
  84. 4:59And so, this account of the evolution of the unconscious is
  85. 5:05that certain motivations and goals,
  86. 5:08particularly sinister ones, are better made to be
  87. 5:12unconscious because if a person doesn't know they have them they
  88. 5:17will not give them away. And this is something I think
  89. 5:22we should return to later on when we talk about social
  90. 5:26interaction and social relationships.
  91. 5:30One other thing on Freud--just a story of the falsification of
  92. 5:34Freud. I was taking my younger child
  93. 5:37home from a play date on Sunday and he asked me out of the blue,
  94. 5:42"Why can't you marry your mother or your father?"
  95. 5:46Now, that's actually a difficult question to ask--to
  96. 5:49answer for a child, but I tried my best to give him
  97. 5:51an answer. And then I said--then I thought
  98. 5:55back on the Freud lecture and so I asked him, "If you could marry
  99. 6:00anybody you want, who would it be?"
  100. 6:03imagining he'd make explicit the Oedipal complex and name his
  101. 6:07mother. Instead, he paused for a moment
  102. 6:13and said, "I would marry a donkey and a big bag of
  103. 6:23peanuts." [laughter]
  104. 6:26Both his parents are psychologists and he hates these
  105. 6:29questions and at times he just screws around with us.
  106. 6:32[laughter] Okay. Last class I started with Freud
  107. 6:40and now I want to turn to Skinner.
  108. 6:44And the story of Skinner and science is somewhat different
  109. 6:47from the story of Freud. Freud developed and championed
  110. 6:51the theory of psychoanalysis by himself.
  111. 6:55It is as close as you could find in science to a solitary
  112. 6:59invention. Obviously, he drew upon all
  113. 7:01sorts of sources and predecessors but psychoanalysis
  114. 7:05is identified as Freud's creation.
  115. 7:07Behaviorism is different. Behaviorism is a school of
  116. 7:11thought that was there long before Skinner,
  117. 7:15championed by psychologists like John Watson,
  118. 7:19for instance. Skinner came a bit late into
  119. 7:22this but the reason why we've heard of Skinner and why Skinner
  120. 7:26is so well known is he packaged these notions.
  121. 7:29He expanded upon them; he publicized them;
  122. 7:32he developed them scientifically and presented
  123. 7:35them both to the scientific community and to the popular
  124. 7:38community and sociologically in the 1960s and 1970s.
  125. 7:42In the United States, behaviorism was incredibly well
  126. 7:45known and so was Skinner. He was the sort of person you
  127. 7:48would see on talk shows. His books were bestsellers.
  128. 7:52Now, at the core of behaviorism are three extremely radical and
  129. 7:59interesting views. The first is a strong emphasis
  130. 8:04on learning. The strong view of behaviorism
  131. 8:08is everything you know, everything you are,
  132. 8:12is the result of experience. There's no real human nature.
  133. 8:17Rather, people are infinitely malleable.
  134. 8:21There's a wonderful quote from John Watson and in this quote
  135. 8:25John Watson is paraphrasing a famous boast by the Jesuits.
  136. 8:29The Jesuits used to claim, "Give me a child until the age
  137. 8:34of seven and I'll show you the man,"
  138. 8:37that they would take a child and turn him into anything they
  139. 8:41wanted. And Watson expanded on this
  140. 8:44boast, Give me a dozen healthy
  141. 8:46infants, well-formed and my own specified world to bring them up
  142. 8:48and I'll guarantee to take any one at random and train them to
  143. 8:51become any type of specialist I might select--doctor,
  144. 8:54lawyer, artist, merchant, chief,
  145. 8:56and yes, even beggar-man and thief, regardless of his
  146. 8:59talents, penchants, tendencies,
  147. 9:02abilities, vocations and race of his ancestors.
  148. 9:05Now, you could imagine--You could see in this a tremendous
  149. 9:09appeal to this view because Watson has an extremely
  150. 9:13egalitarian view in a sense. If there's no human nature,
  151. 9:18then there's no sense in which one group of humans by dint of
  152. 9:22their race or their sex could be better than another group.
  153. 9:26And Watson was explicit. None of those facts about
  154. 9:29people will ever make any difference.
  155. 9:32What matters to what you are is what you learn and how you're
  156. 9:37treated. And so, Watson claimed he could
  157. 9:40create anybody in any way simply by treating them in a certain
  158. 9:44fashion.
  159. 9:49A second aspect of behaviorism was anti-mentalism.
  160. 9:55And what I mean by this is the behaviorists were obsessed with
  161. 9:59the idea of doing science and they felt,
  162. 10:01largely in reaction to Freud, that claims about internal
  163. 10:05mental states like desires, wishes, goals,
  164. 10:08emotions and so on, are unscientific.
  165. 10:11These invisible, vague things can never form the
  166. 10:15basis of a serious science. And so, the behaviorist
  167. 10:19manifesto would then be to develop a science without
  168. 10:23anything that's unobservable and instead use notions like
  169. 10:27stimulus and response and reinforcement and punishment and
  170. 10:31environment that refer to real world and tangible events.
  171. 10:36Finally, behaviorists believed there were no interesting
  172. 10:41differences across species. A behaviorist might admit that
  173. 10:45a human can do things that a rat or pigeon couldn't but a
  174. 10:49behaviorist might just say, "Look.
  175. 10:52Those are just general associative powers that differ"
  176. 10:55or they may even deny it. They might say,
  177. 10:58"Humans and rats aren't different at all.
  178. 11:00It's just humans tend to live in a richer environment than
  179. 11:03rats." From that standpoint,
  180. 11:05from that theoretical standpoint, comes a
  181. 11:08methodological approach which is,
  182. 11:10if they're all the same then you could study human learning
  183. 11:15by studying nonhuman animals. And that's a lot of what they
  184. 11:19did. Okay.
  185. 11:20I'm going to frame my introduction--my discussion of
  186. 11:24behaviors in terms of the three main learning principles that
  187. 11:29they argue can explain all of human mental life,
  188. 11:33all of human behavior. And then, I want to turn to
  189. 11:36objections to behaviorism but these three principles are
  190. 11:39powerful and very interesting.
  191. 11:45The first is habituation. This is the very simplest form
  192. 11:50of learning. And what this is is technically
  193. 11:53described as a decline in the tendency to respond to stimuli
  194. 11:58that are familiar due to repeated exposure.
  195. 12:02"Hey!" "Hey!"
  196. 12:09The sudden noise startles but as it--as you hear it a second
  197. 12:16time it startles less. The third time is just me being
  198. 12:20goofy. It's just--It's--You get used
  199. 12:24to things. And this, of course,
  200. 12:26is common enough in everyday life.
  201. 12:28We get used to the ticking of a clock or to noise of traffic but
  202. 12:34it's actually a very important form of learning because imagine
  203. 12:40life without it. Imagine life where you never
  204. 12:43got used to anything, where suddenly somebody steps
  205. 12:46forward and waves their hand and you'd go,
  206. 12:48"Woah," and then they wave their hand again and you'd go,
  207. 12:52"Whoah," and you keep--[laughter]
  208. 12:54And there's the loud ticking of a clock and you say,
  209. 12:57"Hmmm." And that's not the way animals
  210. 13:03or humans work. You get used to things.
  211. 13:06And it's actually critically important to get used to things
  212. 13:10because it's a useful adaptive mechanism to keep track on new
  213. 13:15events and objects. It's important to notice
  214. 13:17something when it's new because then you have to decide whether
  215. 13:20it's going to harm you, how to deal with it,
  216. 13:24to attend to it, but you can't keep on noticing
  217. 13:28it. And, in fact,
  218. 13:29you should stop noticing it after it's been in the
  219. 13:32environment for long enough. So, this counts as learning
  220. 13:36because it happens through experience.
  221. 13:38It's a way to learn through experience, to change your way
  222. 13:41of thinking through experience. And also, it's useful because
  223. 13:44harmful stimuli are noticed but when something has shown itself
  224. 13:50to be part of the environment you don't notice it anymore.
  225. 13:55The existence of habituation is important for many reasons.
  226. 13:59One thing it's important for is clever developmental
  227. 14:03psychologists have used habituation as a way to study
  228. 14:07people, creatures who can't talk like
  229. 14:10nonhuman animals, and young babies.
  230. 14:13And when I talk on Wednesday about developmental psychology
  231. 14:18I'll show different ways in which psychologists have used
  232. 14:22habituation to study the minds of young babies.
  233. 14:25The second sort of learning is known as classical conditioning.
  234. 14:31And what this is in a very general sense is the learning of
  235. 14:36an association between one stimulus and another stimulus,
  236. 14:40where stimulus is a technical term meaning events in the
  237. 14:44environment like a certain smell or sound or sight.
  238. 14:48It was thought up by Pavlov. This is Pavlov's famous dog and
  239. 14:56it's an example of scientific serendipity.
  240. 14:59Pavlov, when he started this research, had no interest at all
  241. 15:04in learning. He was interested in saliva.
  242. 15:08And to get saliva he had to have dogs.
  243. 15:11And he had to attach something to dogs so that their saliva
  244. 15:15would pour out so he could study saliva.
  245. 15:17No idea why he wanted to study saliva, but he then discovered
  246. 15:22something. What he would do is he'd put
  247. 15:24food powder in the dog's mouth to generate saliva.
  248. 15:27But Pavlov observed that when somebody entered the room who
  249. 15:33typically gave him the food powder,
  250. 15:36the dog--the food powder saliva would start to come out.
  251. 15:39And later on if you--right before or right during you give
  252. 15:44the dog some food – you ping a bell – the bell will cause the
  253. 15:50saliva to come forth. And, in fact,
  254. 15:53this is the apparatus that he used for his research.
  255. 16:00He developed the theory of classical conditioning by making
  256. 16:05a distinction between two sorts of conditioning,
  257. 16:09two sorts of stimulus response relationships.
  258. 16:13One is unconditioned. An unconditioned is when an
  259. 16:17unconditioned stimulus gives rise to an unconditioned
  260. 16:19response. And this is what you start off
  261. 16:22with. So, if somebody pokes you with
  262. 16:25a stick and you say, "Ouch," because it hurts,
  263. 16:28the poking and the "ouch" is an unconditioned stimulus causing
  264. 16:31an unconditioned response. You didn't have to learn that.
  265. 16:35When Pavlov put food powder in the dog's mouth and saliva was
  266. 16:39generated, that's an unconditioned stimulus giving
  267. 16:42rise to an unconditioned response.
  268. 16:44But what happens through learning is that another
  269. 16:48association develops – that between the conditioned stimulus
  270. 16:53and the conditioned response. So when Pavlov,
  271. 16:56for instance--Well, when Pavlov,
  272. 16:58for instance, started before conditioning
  273. 17:00there was simply an unconditioned stimulus,
  274. 17:03the food in the mouth, and an unconditioned response,
  275. 17:06saliva. The bell was nothing.
  276. 17:07The bell was a neutral stimulus. But over and over again,
  277. 17:12if you put the bell and the food together,
  278. 17:16pretty soon the bell will generate saliva.
  279. 17:20And now the bell--When--You start off with the unconditioned
  280. 17:24stimulus, unconditioned response.
  281. 17:26When the conditioned stimulus and the unconditioned stimulus
  282. 17:29are brought together over and over and over again,
  283. 17:32pretty soon the conditioned stimulus gives rise to the
  284. 17:36response. And now it's known as the
  285. 17:39conditioned stimulus giving rise to the conditioned response.
  286. 17:43This is discussed in detail in the textbook but I also--I'm
  287. 17:46going to give you--Don't panic if you don't get it quite now.
  288. 17:49I'm going to give you further and further examples.
  289. 17:52So, the idea here is, repeated pairings of the
  290. 17:55unconditioned stimulus and the conditioned stimulus will give
  291. 18:00rise to the response. And there's a difference
  292. 18:03between reinforced trials and unreinforced trials.
  293. 18:06A reinforced trial is when the conditioned stimulus and the
  294. 18:09unconditioned stimulus go together.
  295. 18:11You're--and to put it in a crude way, you're teaching the
  296. 18:16dog that the bell goes with the food.
  297. 18:18An unreinforced trial is when you get the food without the
  298. 18:25bell. You're not teaching the dog
  299. 18:27this. And, in fact,
  300. 18:29once you teach an animal something, if you stop doing the
  301. 18:32teaching the response goes away and this is known as extinction.
  302. 18:35But here's a graph. If you get--They really count
  303. 18:40the number of cubic centimeters of saliva.
  304. 18:43The dog is trained so that when the bell comes on--Actually,
  305. 18:47I misframed it. I'll try again.
  306. 18:49When the bell comes connected with food, there's a lot of
  307. 18:54saliva. An unreinforced response is
  308. 18:56when the bell goes on but there's no food.
  309. 18:59So, it's--Imagine you're the dog.
  310. 19:02So, you get food in your mouth, "bell, food,
  311. 19:06bell, food," and now "bell." But next you get "bell,
  312. 19:12bell, bell." You give it up.
  313. 19:15You stop. You stop responding to the bell.
  314. 19:21A weird thing which is discussed in the textbook is if
  315. 19:25you wait a while and then you try it again with the bell after
  316. 19:29a couple of hours, the saliva comes back.
  317. 19:33This is known as spontaneous recovery.
  318. 19:36So, this all seems a very technical phenomena related to
  319. 19:41animals and the like but it's easy to see how it generalizes
  320. 19:46and how it extends. One interesting notion is that
  321. 19:50of stimulus generalization. And stimulus generalization is
  322. 19:54the topic of one of your articles in The Norton
  323. 19:57Reader, the one by Watson,
  324. 20:00John Watson, the famous behaviorist,
  325. 20:02who reported a bizarre experiment with a baby known as
  326. 20:06Little Albert. And here's the idea.
  327. 20:09Little Albert originally liked rats.
  328. 20:12In fact, I'm going to show you a movie of Little Albert
  329. 20:14originally liking rats.
  330. 20:18See. He's okay.
  331. 20:20No problem. Now, Watson did something
  332. 20:24interesting. As Little Albert was playing
  333. 20:28with the rat, "Oh, I like rats,
  334. 20:30oh," Watson went behind the baby--this is the--it's in the
  335. 20:34chapter--and banged the metal bar right here .
  336. 20:38The baby, "Aah," screamed, started to sob.
  337. 20:41Okay. What's the unconditioned
  338. 20:47stimulus? Somebody.
  339. 20:51The loud noise, the bar, the bang.
  340. 20:53What's the unconditioned response?
  341. 20:56Crying, sadness, misery. And as a result of this,
  342. 21:03Little Albert grew afraid of the rat.
  343. 21:07So there--what would be the conditioned stimulus?
  344. 21:13The rat. What would be the conditioned
  345. 21:15response? Fear.
  346. 21:17Excellent. Moreover, this fear extended to
  347. 21:21other things. So, this is a very weird and
  348. 21:24unpersuasive clip. But the idea is--the clip is to
  349. 21:28make the point that the fear will extend to a rabbit,
  350. 21:31a white rabbit. So, the first part,
  351. 21:33Little Albert's fine with the white rabbit.
  352. 21:36The second part is after he's been conditioned and he's kind
  353. 21:39of freaked out with the white rabbit.
  354. 21:40The problem is in the second part they're throwing the rabbit
  355. 21:45at him but now he's okay.
  356. 22:05[laughter] Is the mic on? Oh.
  357. 22:08This is fine. This is one of a long list of
  358. 22:14experiments that we can't do anymore.
  359. 22:18So, classical conditioning is more than a laboratory
  360. 22:23phenomena. The findings of classical
  361. 22:27conditioning have been extended and replicated in all sorts of
  362. 22:34animals including crabs, fish, cockroaches and so on.
  363. 22:40And it's been argued to be an extension of--it's argued to
  364. 22:46underlie certain interesting aspects of human responses.
  365. 22:53So, I have some examples here. One example is fear.
  366. 22:56So, the Little Albert idea--The Little Albert experiment,
  367. 23:01provides an illustration for how phobias could emerge.
  368. 23:05Some proportion of people in this room have phobias.
  369. 23:08Imagine you're afraid of dogs. Well, a possible story for
  370. 23:13the--for why you became afraid of dogs is that one day a dog
  371. 23:18came up and he was a neutral stimulus.
  372. 23:21No problem. And all of a sudden he bit you.
  373. 23:24Now the pain of a bite, being bit, and then the pain
  374. 23:28and fear of that is an unconditioned stimulus,
  375. 23:31unconditioned response. You're just born with that,
  376. 23:34"ow." But the presence of the dog
  377. 23:36there is a conditioned stimulus and so you grew to be afraid of
  378. 23:40dogs. If you believe this,
  379. 23:43this also forms the basis for ways for a theory of how you
  380. 23:48could make phobias go away. How do you make conditioned
  381. 23:52stimulus, conditioned response things go away?
  382. 23:55Well, what you do is you extinguish them.
  383. 23:58How do you extinguish them? Well, you show the thing that
  384. 24:01would cause you to have the fear without the unconditioned
  385. 24:06stimulus. Here's an illustration.
  386. 24:09It's a joke. Sorry.
  387. 24:11He's simultaneously confronting the fear of heights,
  388. 24:15snakes, and the dark because he's trapped in that thing and
  389. 24:18the logic is--the logic of--the logic is not bad.
  390. 24:22He's stuck in there. Those are all the--his
  391. 24:24conditioned stimulus. But nothing bad happens so his
  392. 24:27fear goes away. The problem with this is while
  393. 24:31he's stuck in there he has this screaming, horrific panic attack
  394. 24:35and then it makes his fear much worse.
  395. 24:38So, what they do now though, and we'll talk about this much
  396. 24:41later in the course when we talk about clinical psychology--but
  397. 24:45one cure for phobias does draw upon,
  398. 24:47in a more intelligent way, the behaviorist literature.
  399. 24:50So, the claim about a phobia is that there's a bad association
  400. 24:55between, say dog and fear, or between airplanes or snakes
  401. 24:59and some bad response. So, what they do is what's
  402. 25:03called, "systematic desensitization," which is they
  403. 25:06expose you to what causes you the fear but they relax you at
  404. 25:10the same time so you replace the aversive classical conditioned
  405. 25:14fear with something more positive.
  406. 25:17Traditionally, they used to teach people
  407. 25:20relaxation exercises but that proves too difficult.
  408. 25:23So nowadays they just pump you full of some drug to get you
  409. 25:26really happy and so you're really stoned out of your head,
  410. 25:29you're and this isn't so bad. It's more complicated than that
  411. 25:34but the notion is you can use these associative tools perhaps
  412. 25:38to deal with questions about fear,
  413. 25:41phobias and how they go away. Hunger.
  414. 25:48We'll spend some time in this course discussing why we eat and
  415. 25:53when we eat. And one answer to why we eat
  416. 25:55and when we eat is that there's cues in the environment that are
  417. 25:58associated with eating. And these cues generate hunger.
  418. 26:02For those of you who are trying to quit smoking,
  419. 26:05you'll notice that there's time--or to quit drinking
  420. 26:09there's times of the day or certain activities that really
  421. 26:13make you want to smoke or really make you want to drink.
  422. 26:17And from a behaviorist point of view this is because of the
  423. 26:21associative history of these things.
  424. 26:24More speculatively, classical conditioning has been
  425. 26:29argued to be implicated in the formation of sexual desire,
  426. 26:34including fetishes. So a behaviorist story about
  427. 26:38fetishes, for instance, is it's straightforward
  428. 26:41classical conditioning. Just as your lover's caress
  429. 26:46brings you to orgasm, your eyes happen to fall upon a
  430. 26:52shoe. Through the simple tools of
  431. 26:55classical conditioning then, the shoe becomes a conditioned
  432. 26:59stimulus giving rise to the conditioned response of sexual
  433. 27:03pleasure. This almost certainly is not
  434. 27:06the right story but again, just as in phobias,
  435. 27:09some ideas of classical conditioning may play some role
  436. 27:13in determining what we like and what we don't like sexually.
  437. 27:17And in fact, one treatment for pedophiles
  438. 27:20and rapists involved controlled fantasies during masturbation to
  439. 27:25shift the association from domination and violence,
  440. 27:30for instance, to develop more positive
  441. 27:33associations with sexual pleasure.
  442. 27:36So the strong classical conditioning stories about
  443. 27:39fetishes and fears sound silly and extreme and they probably
  444. 27:44are but at the same time classical conditioning can be
  445. 27:47used at least to shape the focus of our desires and of our
  446. 27:51interests. Final thought actually is--Oh,
  447. 27:54yeah. Okay.
  448. 27:55So, what do we think about classical conditioning?
  449. 27:58We talked about what habituation is for.
  450. 28:00What's classical conditioning for?
  451. 28:01Well, the traditional view is it's not for anything.
  452. 28:04It's just association. So, what happens is the UCS and
  453. 28:07the CS, the bell and the food, go together because they happen
  454. 28:11at the same time. And so classical conditioning
  455. 28:14should be the strongest when these two are simultaneous and
  456. 28:19the response to one is the same as the response to the other.
  457. 28:23This is actually no longer the mainstream view.
  458. 28:27The mainstream view is now a little bit more interesting.
  459. 28:29It's that what happens in classical conditioning is
  460. 28:33preparation. What happens is you become
  461. 28:36sensitive to a cue that an event is about to happen and that
  462. 28:41allows you to prepare for the event.
  463. 28:44This makes certain predictions. It predicts that the best
  464. 28:48timing is when the conditioned stimulus, which is the signal,
  465. 28:52comes before the unconditioned stimulus, which is what you have
  466. 28:55to prepare for. And it says the conditioned
  467. 28:58response may be different from the unconditioned response.
  468. 29:02So, move away from food. Imagine a child who's being
  469. 29:06beaten by his father. And when his father raises his
  470. 29:10hand he flinches. Well, that's classical
  471. 29:13conditioning. What happened in that case is
  472. 29:16he has learned that the raising of a hand is a signal that he is
  473. 29:20about to be hit and so he responds to that signal.
  474. 29:24His flinch is not the same response that one would give if
  475. 29:29one's hit. If you're hit, you don't flinch.
  476. 29:31If you're hit, you might feel pain or bounce
  477. 29:33back or something. Flinching is preparation for
  478. 29:36being hit. And, in general,
  479. 29:38the idea of what goes on in classical conditioning is that
  480. 29:41the response is sort of a preparation.
  481. 29:44The conditioned response is a preparation for the
  482. 29:47unconditioned stimulus. Classical conditioning shows up
  483. 29:50all over the place. As a final exercise,
  484. 29:53and I had to think about it--Has anybody here seen the
  485. 29:56movie "Clockwork Orange"? A lot of you.
  486. 29:59It's kind of a shocking movie and unpleasant and very violent
  487. 30:03but at its core one of the main themes is right out of Intro
  488. 30:08Psych. It's classical conditioning.
  489. 30:10And a main character, who is a violent murderer and
  490. 30:14rapist, is brought in by some psychologists for some therapy.
  491. 30:19And the therapy he gets is classical conditioning.
  492. 30:22In particular, what happens is he is given a
  493. 30:25drug that makes him violently ill, extremely nauseous.
  494. 30:28And then his eyes are propped open and he's shown scenes of
  495. 30:32violence. As a result of this sort of
  496. 30:34conditioning, he then – when he experiences
  497. 30:38real world violence – he responds with nausea and shock;
  498. 30:42basically, training him to get away from these acts of
  499. 30:50violence. In this example--Take a moment.
  500. 30:53Don't say it aloud. Just take a moment.
  501. 30:55What's the unconditioned stimulus?
  502. 30:59Okay. Anybody, what's the
  503. 31:01unconditioned stimulus? Somebody just say it.
  504. 31:03The drug. What's the unconditioned
  505. 31:08response? Nausea.
  506. 31:10What's the conditioned stimulus? Violence.
  507. 31:14What's the conditioned response? Perfect.
  508. 31:19The third and final type of learning is known as operant
  509. 31:24conditioning or instrumental conditioning.
  510. 31:28And this is the thing, this is the theory championed
  511. 31:32and developed most extensively by Skinner.
  512. 31:36What this is is learning the relationships between what you
  513. 31:41do and how successful or unsuccessful they are,
  514. 31:45learning what works and what doesn't.
  515. 31:48It's important. This is very different from
  516. 31:50classical conditioning and one way to see how this is different
  517. 31:54is for classical conditioning you don't do anything.
  518. 31:56You could literally be strapped down and be immobile and these
  519. 32:01connections are what you appreciate and you make
  520. 32:04connections in your mind. Instrumental conditioning is
  521. 32:08voluntary. You choose to do things and by
  522. 32:12dint of your choices. Some choices become more
  523. 32:18learned than others. So, the idea itself was
  524. 32:24developed in the nicest form by Thorndike who explored how
  525. 32:29animals learn. Remember behaviorists were
  526. 32:32entirely comfortable studying animals and drawing
  527. 32:35extrapolations to other animals and to humans.
  528. 32:38So, he would put a cat in a puzzle box.
  529. 32:41And the trick to a puzzle box is there's a simple way to get
  530. 32:45out but you have to kind of pull on something,
  531. 32:48some special lever, to make it pop open.
  532. 32:51And Thorndike noted that cats do not solve this problem
  533. 32:56through insight. They don't sit in the box for a
  534. 33:00while and mull it over and then figure out how to do it.
  535. 33:04Instead, what they do is they bounce all around doing
  536. 33:07different things and gradually get better and better at it.
  537. 33:11So, what they do is, the first time they might
  538. 33:13scratch at the bars, push at the ceiling,
  539. 33:15dig at the floor, howl, etc., etc.
  540. 33:17And one of their behaviors is pressing the lever.
  541. 33:20The lever gets them out of the box, but after more and more
  542. 33:23trials they stopped scratching at the bars, pushing at the
  543. 33:27ceiling and so on. They just pressed the lever.
  544. 33:31And if you graph it, they gradually get better and
  545. 33:34better. They throw out all of these
  546. 33:37behaviors randomly. Some of them get reinforced and
  547. 33:41those are the ones that survive and others don't get reinforced
  548. 33:46and those are the ones that go extinct.
  549. 33:49And it might occur to some of you that this seems to be an
  550. 33:53analogy with the Darwinian theory of natural selection
  551. 33:57where there's a random assortment of random mutations.
  552. 34:00And sexual selections give rise to a host of organisms,
  553. 34:04some of which survive and are fit and others which aren't.
  554. 34:08And in fact, Skinner explicitly made the
  555. 34:12analogy from the natural selection of species to the
  556. 34:16natural selection of behavior. So this could be summarized as
  557. 34:21the law of effect, which is a tendency to perform
  558. 34:25– an action's increased if rewarded, weakened if it's not.
  559. 34:30And Skinner extended this more generally.
  560. 34:34So, to illustrate Skinnerian theory in operant conditioning
  561. 34:39I'll give an example of training a pig.
  562. 34:43So here is the idea. You need to train a pig and you
  563. 34:47need to do so through operant conditioning.
  564. 34:51So one of the things you want to do is--The pig is going to do
  565. 34:55some things you like and some things you don't like.
  566. 34:58And so what you want to do, basically drawing upon the law
  567. 35:03of effect, is reinforce the pig for doing good things.
  568. 35:08Suppose you want the pig to walk forward.
  569. 35:10So, you reinforce the pig for walking forward and you punish
  570. 35:14the pig for walking backward. And if you do that over the
  571. 35:18fullness of time, your reinforcement and
  572. 35:20punishment will give rise to a pig who walks forward.
  573. 35:24There's two--One technical distinction that people love to
  574. 35:28put on Intro Psych exams is that the difference between positive
  575. 35:32reinforcement and negative reinforcement.
  576. 35:35Reinforcement is something that makes the behavior increase.
  577. 35:40Negative reinforcement is very different from punishment.
  578. 35:44Negative reinforcement is just a type of reward.
  579. 35:47The difference is in positive reinforcement you do something;
  580. 35:51in negative reinforcement you take away something aversive.
  581. 35:55So, imagine the pig has a heavy collar and to reward the pig for
  582. 35:59walking forward you might remove the heavy collar.
  583. 36:02So, these are the basic techniques to train an animal.
  584. 36:07But it's kind of silly because suppose you want your pig to
  585. 36:11dance. You don't just want your pig to
  586. 36:14walk forward. You want your pig to dance.
  587. 36:17Well, you can't adopt the policy of "I'm going to wait for
  588. 36:21this pig to dance and when it does I'm going to reinforce it"
  589. 36:25because it's going to take you a very long time.
  590. 36:29Similarly, if you're dealing with immature humans and you
  591. 36:33want your child to get you a beer,
  592. 36:36you can't just sit, wait for the kid to give you a
  593. 36:39beer and uncap the bottle and say,
  594. 36:42"Excellent. Good.
  595. 36:43Hugs." You've got to work your way to
  596. 36:48it. And the act of working your way
  597. 36:50to it is known as shaping. So, here is how to get a pig to
  598. 36:55dance. You wait for the pig to do
  599. 36:58something that's halfway close to dancing, like stumbling,
  600. 37:02and you reward it. Then it does something else
  601. 37:05that's even closer to dancing and you reward it.
  602. 37:08And you keep rewarding it as it gets closer to closer.
  603. 37:12Here's how to get your child to bring you some beer.
  604. 37:16You say, "Johnny, could you go to the kitchen and
  605. 37:19get me some beer?" And he walks to the kitchen and
  606. 37:21then he forgets why he's there and you run out there.
  607. 37:24"You're such a good kid. Congratulations.
  608. 37:25Hugs." And then you get him to--and
  609. 37:28then finally you get him to also open up the refrigerator and get
  610. 37:32the beer, open the door,
  611. 37:34get the--and in that way you can train creatures to do
  612. 37:37complicated things. Skinner had many examples of
  613. 37:41this. Skinner developed,
  614. 37:43in World War II, a pigeon guided missile.
  615. 37:46It was never actually used but it was a great idea.
  616. 37:50And people, in fact--The history of the military in the
  617. 37:54United States and other countries includes a lot of
  618. 37:57attempts to get animals like pigeons or dolphins to do
  619. 38:01interesting and deadly things through various training.
  620. 38:05More recreational, Skinner was fond of teaching
  621. 38:08animals to play Ping-Pong. And again, you don't teach an
  622. 38:11animal to play Ping-Pong by waiting for it to play Ping-Pong
  623. 38:14and then rewarding it. Rather, you reward
  624. 38:19approximations to it. And basically,
  625. 38:24there are primary reinforcers. There are some things pigs
  626. 38:28naturally like, food for instance.
  627. 38:31There are some things pigs actually automatically don't
  628. 38:34like, like being hit or shocked. But in the real world when
  629. 38:38dealing with humans, but even when dealing with
  630. 38:41animals, we don't actually always use
  631. 38:43primary reinforcers or negative reinforcers.
  632. 38:46What we often use are things like--for my dog saying,
  633. 38:51"Good dog." Now, saying "Good dog" is not
  634. 38:54something your dog has been built, pre-wired,
  635. 38:58to find pleasurable. But what happens is you can do
  636. 39:02a two-step process. You can make "Good dog"
  637. 39:05positive through classical conditioning.
  638. 39:08You give the dog a treat and say, "Good dog."
  639. 39:11Now the phrase "good dog" will carry the rewarding quality.
  640. 39:16And you could use that rewarding quality in order to
  641. 39:19train it. And through this way
  642. 39:21behaviorists have developed token economies where they get
  643. 39:25nonhuman animals to do interesting things for seemingly
  644. 39:29arbitrary rewards like poker chips.
  645. 39:32And in this way you can increase the utility and ease of
  646. 39:38training. Finally, in the examples we're
  647. 39:42giving, whenever the pig does something you like you reinforce
  648. 39:47it. But that's not how real life
  649. 39:50works. Real life for both humans and
  650. 39:53animals involved cases where the reinforcement doesn't happen all
  651. 39:58the time but actually happens according to different
  652. 40:02schedules. And so, there is the
  653. 40:04distinction between fixed schedules versus ratios –
  654. 40:08variable schedules and ratio versus interval.
  655. 40:11And this is something you could print out to look at.
  656. 40:13I don't need to go over it in detail.
  657. 40:15The difference between ratio is a reward every certain number of
  658. 40:20times somebody does something. So, if every tenth time your
  659. 40:26dog brought you the newspaper you gave it hugs and treats;
  660. 40:31that's ratio. An interval is over a period of
  661. 40:35time. So, if your dog gives you--if
  662. 40:38your dog, I don't know, dances for an hour straight,
  663. 40:42that would be an interval thing.
  664. 40:45And fixed versus variable speaks to whether you give a
  665. 40:49reward on a fixed schedule, every fifth time,
  666. 40:52or variable, sometimes on the third time,
  667. 40:55sometimes on the seventh time, and so on.
  668. 40:57And these are--There are examples here and there's no
  669. 41:00need to go over them. It's easy enough to think of
  670. 41:03examples in real life. So, for example,
  671. 41:07a slot machine is variable ratio.
  672. 41:12It goes off after it's been hit a certain number of times.
  673. 41:16It doesn't matter how long it takes you for--to do it.
  674. 41:19It's the number of times you pull it down.
  675. 41:21But it's variable because it doesn't always go off on the
  676. 41:24thousandth time. You don't know.
  677. 41:26It's unpredictable. The slot machine is a good
  678. 41:30example of a phenomena known as the partial reinforcement
  679. 41:35effect. And this is kind of neat.
  680. 41:38It makes sense when you hear it but it's the sort of finding
  681. 41:42that's been validated over and over again with animals and
  682. 41:45nonhumans. Here's the idea.
  683. 41:49Suppose you want to train somebody to do something and you
  684. 41:52want the training such that they'll keep on doing it even if
  685. 41:56you're not training them anymore,
  686. 41:58which is typically what you want.
  687. 42:01If you want that, the trick is don't reinforce it
  688. 42:06all the time. Behaviors last longer if
  689. 42:10they're reinforced intermittently and this is known
  690. 42:13as "the partial reinforcement effect."
  691. 42:17Thinking of this psychologically,
  692. 42:19it's as if whenever you put something in a slot machine it
  693. 42:22gave you money, then all of a sudden it
  694. 42:25stopped. You keep on doing it a few
  695. 42:28times but then you say, "Fine.
  696. 42:30It doesn't work," but what if it gave you money one out of
  697. 42:33every hundred times? Now you keep on trying and
  698. 42:37because the reinforcement is intermittent you don't expect it
  699. 42:43as much and so your behavior will persist across often a huge
  700. 42:49amount of time. Here's a good example.
  701. 42:52What's the very worst thing to do when your kid cries to go
  702. 42:57into bed with you and you don't want him to go into bed with
  703. 43:01you? Well, one--The worst thing to
  704. 43:04do is for any--Actually, for any form of discipline with
  705. 43:08a kid is to say, "No, absolutely not.
  706. 43:10No, no, no, no." "Okay."
  707. 43:15And then later on the kid's going to say,
  708. 43:19"I want to do it again" and you say no and the kid keeps asking
  709. 43:24because you've put it, well, put it as in a
  710. 43:28psychological way, not the way the behaviorists
  711. 43:30would put it. The kid knows okay,
  712. 43:32he's not going to get it right away, he's going to keep on
  713. 43:34asking. And so typically,
  714. 43:36what you're doing inadvertently in those situations is you're
  715. 43:40exploiting the partial reinforcement effect.
  716. 43:44If I want my kid to do something, I should say yes one
  717. 43:47out of every ten times. Unfortunately,
  718. 43:50that's the evolution of nagging.
  719. 43:53Because you nag, you nag, you nag,
  720. 43:57the person says, "Fine, okay," and that
  721. 44:01reinforces it. If Skinner kept the focus on
  722. 44:05rats and pigeons and dogs, he would not have the impact
  723. 44:10that he did but he argued that you could extend all of these
  724. 44:14notions to humans and to human behavior.
  725. 44:18So for an example, he argued that the prison
  726. 44:21system needs to be reformed because instead of focusing on
  727. 44:26notions of justice and retribution what we should do is
  728. 44:30focus instead on questions of reinforcing good behaviors and
  729. 44:34punishing bad ones. He argued for the notions of
  730. 44:39operant conditioning to be extended to everyday life and
  731. 44:43argued that people's lives would become fuller and more
  732. 44:48satisfying if they were controlled in a properly
  733. 44:51behaviorist way. Any questions about behaviorism?
  734. 45:01What are your questions about behaviorism?
  735. 45:12[laughter] Yes. Student:
  736. 45:16[inaudible]--wouldn't there be extinction after a while?
  737. 45:20[inaudible] Professor Paul Bloom:
  738. 45:20Good question. The discussion was over using
  739. 45:23things like poker chips for reinforcement and the point is
  740. 45:27exactly right. Since the connection with the
  741. 45:29poker chips is established through classical conditioning,
  742. 45:32sooner or later by that logic the poker chips would lose their
  743. 45:36power to serve as reinforcers. You'd have to sort of start it
  744. 45:40up again, retrain again. If you have a dog and you say
  745. 45:44"Good dog" to reward the dog, by your logic,
  746. 45:47which is right, at some point you might as well
  747. 45:49give the dog a treat along with the "Good dog."
  748. 45:51Otherwise, "Good dog" is not going to cut it anymore.
  749. 45:59Yes. Student:
  750. 46:01[inaudible] Professor Paul Bloom:
  751. 46:04As far as I know, Skinner and Skinnerian
  752. 46:06psychologists were never directly involved in the
  753. 46:09creation of prisons. On the other hand,
  754. 46:12the psychological theory of behaviorism has had a huge
  755. 46:15impact and I think a lot of people's ways of thinking about
  756. 46:18criminal justice and criminal law has been shaped by
  757. 46:21behaviorist principles. So for instance,
  758. 46:24institutions like mental institutions and some prisons
  759. 46:28have installed token economies where there's rewards for good
  760. 46:32behavior, often poker chips of a sort.
  761. 46:34And then you could cash them in for other things.
  762. 46:36And, to some extent, these have been shaped by an
  763. 46:40adherence to behaviorist principles.
  764. 46:43Okay. So, here are the three general
  765. 46:52positions of behaviorism. (1) That there is no innate
  766. 46:57knowledge. All you need is learning.
  767. 47:00(2) That you could explain human psychology without mental
  768. 47:04notions like desires and goals. (3) And that these mechanisms
  769. 47:09apply across all domains and across all species.
  770. 47:15I think it's fair to say that right now just about everybody
  771. 47:19agrees all of these three claims are mistaken.
  772. 47:22First, we know that it's not true that everything is learned.
  773. 47:28There is considerable evidence for different forms of innate
  774. 47:31knowledge and innate desires and we'll look--and we'll talk about
  775. 47:35it in detail when we look at case studies like language
  776. 47:38learning, the development of sexual
  777. 47:40preference, the developing understanding of material
  778. 47:44objects. There's a lot of debate over
  779. 47:46how much is innate and what the character of the built-in mental
  780. 47:51systems are but there's nobody who doubts nowadays that a
  781. 47:55considerable amount for humans and other animals is built-in.
  782. 48:00Is it true that talking about mental states is unscientific?
  783. 48:04Nobody believes this anymore either.
  784. 48:09Science, particularly more advanced sciences like physics
  785. 48:12or chemistry, are all about unobservables.
  786. 48:15They're all about things you can't see.
  787. 48:18And it makes sense to explain complex and intelligent behavior
  788. 48:23in terms of internal mechanisms and internal representations.
  789. 48:28Once again, the computer revolution has served as an
  790. 48:32illustrative case study. If you have a computer that
  791. 48:36plays chess and you want to explain how the computer plays
  792. 48:39chess, it's impossible to do so
  793. 48:42without talking about the programs and mechanisms inside
  794. 48:47the computer. Is it true that animals need
  795. 48:50reinforcement and punishment to learn?
  796. 48:52No, and there's several demonstrations at the time of
  797. 48:56Skinner suggesting that they don't.
  798. 48:58This is from a classic study by Tolman where rats were taught to
  799. 49:04run a maze. And what they found was the
  800. 49:06rats did fine. They learn to run a maze faster
  801. 49:09and faster when they're regularly rewarded but they also
  802. 49:12learn to run a maze faster and faster if they are not rewarded
  803. 49:16at all. So the reward helps,
  804. 49:19but the reward is in no sense necessary.
  805. 49:24And here's a more sophisticated illustration of the same point.
  806. 49:29Professor Paul Bloom: And this is the sort of
  807. 49:32finding, an old finding from before most of you were born,
  808. 49:36that was a huge embarrassment for the Skinnerian theory,
  809. 49:40as it suggests that rats in fact had mental maps,
  810. 49:44an internal mechanism that they used to understand the world –
  811. 49:48entirely contrary to the behaviorist idea everything
  812. 49:52could be explained in terms of reinforcement and punishment.
  813. 49:56Finally, is it true that there's no animal-specific
  814. 49:59constraints for learning? And again, the answer seems to
  815. 50:03be "no." Animals, for instance,
  816. 50:05have natural responses. So, you could train a pigeon to
  817. 50:09peck for food but that's because pecking for food is a very
  818. 50:14natural response. It's very difficult to train it
  819. 50:17to peck to escape a situation. You can train it to flap its
  820. 50:22wings to escape a situation but it's very difficult to get it to
  821. 50:26flap its wings for food. And the idea is they have sort
  822. 50:29of natural responses that these learning situations might
  823. 50:32exploit and might channel, but essentially,
  824. 50:35they do have certain natural ways of acting towards the
  825. 50:39world. We know that not all stimuli
  826. 50:43and responses are created equal. So, the Gray textbook has a
  827. 50:49very nice discussion of the Garcia effect.
  828. 50:52And the Garcia effect goes like this.
  829. 50:56Does anybody here have any food aversions?
  830. 51:00I don't mean foods you don't like.
  831. 51:02I mean foods that really make you sick.
  832. 51:07Often food aversions in humans and other animals can be formed
  833. 51:12through a form of association. What happens is suppose you
  834. 51:17have the flu and you get very nauseous and then at the same
  835. 51:21point you eat some sashimi for the first time.
  836. 51:25The connection between being nauseous and eating a new food
  837. 51:28is very potent. And even if you know
  838. 51:31intellectually full well that the sashimi isn't why you became
  839. 51:36nauseous, still you'll develop an aversion to this new food.
  840. 51:42When I was younger – when I was a teenager – I drank this
  841. 51:48Greek liqueur, ouzo, with beer.
  842. 51:51I didn't have the flu at the time but I became violently ill.
  843. 51:55And as a result I cannot abide the smell of that Greek liqueur.
  844. 52:01Now, thank God it didn't develop into an aversion to beer
  845. 52:05but-- [laughter] Small miracles.
  846. 52:07But the smell is very distinctive and for me--was new
  847. 52:11to me. And so, through the Garcia
  848. 52:13effect I developed a strong aversion.
  849. 52:16What's interesting though is the aversion is special so if
  850. 52:19you take an animal and you give it a new food and then you give
  851. 52:23it a drug to make it nauseous it will avoid that food.
  852. 52:27But if you take an animal and you give it a new food and then
  853. 52:32you shock it very painfully it won't avoid the new food.
  854. 52:36And the idea is that a connection between what
  855. 52:39something tastes and getting sick is natural.
  856. 52:43We are hard wired to say, "Look. If I'm going to eat a new food
  857. 52:47and I'm going to get nauseous, I'm going to avoid that food."
  858. 52:50The Garcia effect is that this is special to taste and nausea.
  859. 52:55It doesn't extend more generally.
  860. 52:58Finally, I talked about phobias and I'll return to phobias later
  861. 53:02on in this course. But the claim that people have
  862. 53:06formed their phobias through classical conditioning is almost
  863. 53:11always wrong. Instead, it turns out that
  864. 53:13there are certain phobias that we're specially evolved to have.
  865. 53:17So, both humans and chimpanzees, for instance,
  866. 53:21are particularly prone to develop fears of snakes.
  867. 53:26And when we talk about the emotions later on in the course
  868. 53:29we'll talk about this in more detail.
  869. 53:31But what seems likely is the sort of phobias you're likely to
  870. 53:35have does not have much to do with your personal history but
  871. 53:39rather it has a lot to do with your evolutionary history.
  872. 53:43Finally, the other reading you're going to do for this
  873. 53:47part--section of the course is Chomsky's classic article,
  874. 53:51his "Review of Verbal Behavior."
  875. 53:53Chomsky is one of the most prominent intellectuals alive.
  876. 53:57He's still a professor at MIT, still publishes on language and
  877. 54:01thought, among other matters. And the excerpt you're going to
  878. 54:05read is from his "Review of Verbal Behavior."
  879. 54:07And this is one of the most influential intellectual
  880. 54:11documents ever written in psychology because it took the
  881. 54:14entire discipline of behaviorism and,
  882. 54:17more than everything else, more than any other event,
  883. 54:21could be said to have destroyed it or ended it as a dominant
  884. 54:25intellectual endeavor. And Chomsky's argument is
  885. 54:29complicated and interesting, but the main sort of argument
  886. 54:32he had to make is--goes like this.
  887. 54:35When it comes to humans, the notions of reward and
  888. 54:39punishment and so on that Skinner tried to extend to
  889. 54:44humans are so vague it's not science anymore.
  890. 54:48And remember the discussion we had with regard to Freud.
  891. 54:51What Skinner--What Chomsky is raising here is the concern of
  892. 54:55unfalsifiablity. So, here's the sort of example
  893. 54:57he would discuss. Skinner, in his book Verbal
  894. 55:00Behavior, talks about the question of why
  895. 55:02do we do things like talk to ourselves,
  896. 55:05imitate sounds, create art, give bad news to an
  897. 55:08enemy, fantasize about pleasant situations?
  898. 55:11And Skinner says that they all involve reinforcement;
  899. 55:14those are all reinforced behaviors.
  900. 55:16But Skinner doesn't literally mean that when we talk to
  901. 55:20ourselves somebody gives us food pellets.
  902. 55:24He doesn't literally mean even that when we talk to ourselves
  903. 55:26somebody pats us on the head and says, "Good man.
  904. 55:28Perfect. I'm very proud."
  905. 55:31What he means, for instance,
  906. 55:33in this case is well, talking to yourself is
  907. 55:36self-reinforcing or giving bad news to an enemy is reinforcing
  908. 55:41because it makes your enemy feel bad.
  909. 55:44Well, Chomsky says the problem is not that that's wrong.
  910. 55:48That's all true. It's just so vague as to be
  911. 55:53useless. Skinner isn't saying anything
  912. 55:55more. To say giving bad news to an
  913. 55:58enemy is reinforcing because it makes the enemy feel bad doesn't
  914. 56:02say anything different from giving bad news to an enemy
  915. 56:05feels good because we like to give bad news to an enemy.
  916. 56:09It's just putting it in more scientific terms.
  917. 56:11More generally, Chomsky suggests that the law
  918. 56:16of effect when applied to humans is either trivially true,
  919. 56:22trivially or uninterestingly true, or scientifically robust
  920. 56:28and obviously false. So, if you want to expand the
  921. 56:33notion of reward or reinforcement to anything,
  922. 56:38then it's true. So why did you come--those of
  923. 56:42you who are not freshmen--Oh, you--Why did you come?
  924. 56:46All of you, why did you come to Yale for a second semester?
  925. 56:49"Well, I repeated my action because the first semester was
  926. 56:52rewarding." Okay.
  927. 56:54What do you mean by that? Well, you don't literally mean
  928. 56:57that somebody rewarded you, gave you pellets and stuff.
  929. 57:00What you mean is you chose to come there for the second
  930. 57:03semester. And there's nothing wrong with
  931. 57:06saying that but we shouldn't confuse it with science.
  932. 57:09And more generally, the problem is you can talk
  933. 57:12about what other people do in terms of reinforcement and
  934. 57:15punishment and operant conditioning and classical
  935. 57:17conditioning. But in order to do so,
  936. 57:20you have to use terms like "punishment" and "reward" and
  937. 57:24"reinforcement" in such a vague way that in the end you're not
  938. 57:28saying anything scientific. So, behaviorism as a dominant
  939. 57:33intellectual field has faded, but it still leaves behind an
  940. 57:39important legacy and it still stands as one of the major
  941. 57:44contributions of twentieth century psychology.
  942. 57:49For one thing, it has given us a richer
  943. 57:52understanding of certain learning mechanisms,
  944. 57:54particularly with regard to nonhumans.
  945. 57:56Mechanisms like habituation, classical conditioning and
  946. 57:59operant conditioning are real; they can be scientifically
  947. 58:02studied; and they play an important role
  948. 58:04in the lives of animals and probably an important role in
  949. 58:07human lives as well. They just don't explain
  950. 58:11everything. Finally, and this is something
  951. 58:14I'm going to return to on Wednesday actually,
  952. 58:16behaviorists have provided powerful techniques for training
  953. 58:21particularly for nonverbal creatures so this extends to
  954. 58:26animal trainers. But it also extends to people
  955. 58:29who want to teach young children and babies and also want to help
  956. 58:32populations like the severely autistic or the severely
  957. 58:35retarded. Many of these behaviorist
  958. 58:37techniques have proven to be quite useful.
  959. 58:39And in that regard, as well as in other regards,
  960. 58:43it stands as an important contribution.

About this transcript

This page contains the full transcript of 4. Foundations: Skinner by YaleCourses, generated from the public captions YouTube serves with the video. The transcript has 8,273 words across 960 segments, with the original timestamps preserved so you can click any line to jump to that moment in the embedded player.

What you can do with it

Use the transcript to take notes, quote the speaker, build a study guide, generate a summary with ChatGPT or Claude via the YouTube Summary tool, or export it as a timed subtitle file with YouTube to SRT. You can also re-open it in the transcriber to choose a caption track available on the video.

Free YouTube transcript tool

YouTube2Text is a free YouTube transcript generator — no signup, no daily limit. Paste any YouTube link and get the full transcript instantly, with timestamps, click-to-jump, caption language selection, AI prompts for ChatGPT, Claude, and Gemini, and exports to TXT, SRT, VTT, or Markdown.