YouTube2Text

VR Definition, History - Part 3 — Transcript

by NPTEL-NOC IITM · 4,998 words · 742 segments · language en · Watch on YouTube

Full transcript

  1. 0:01[Music]
  2. 0:16Let's go move on. So now let's talk
  3. 0:20about an interesting question that's um
  4. 0:22that will be important uh for us in as
  5. 0:26we understand our cardboards but also
  6. 0:28it's important for movies, computer
  7. 0:29games and virtual reality. So how many
  8. 0:32frames per second is enough? In this
  9. 0:34video I have only two frames per second.
  10. 0:38So do I perceive motion? Yes. Is it
  11. 0:42continuous motion? No, I can't see
  12. 0:45frames.
  13. 0:47So the answer is then how many frames
  14. 0:50per second is enough
  15. 0:53is related to how our brain perceives
  16. 0:56motion. So that's actually related to
  17. 0:58neuroscience and we'll talk about it
  18. 1:01later in class in more details what
  19. 1:02neural structures will detect motion in
  20. 1:04our brains and how the eyes detect
  21. 1:06motions together with the brain. Uh but
  22. 1:10I have a question for you. What do you
  23. 1:12think is frame uh frame rate that is
  24. 1:16enough to perceive continuous motion now
  25. 1:18then?
  26. 1:20So we said at two frames per second you
  27. 1:23perceive motion but it's not continuous.
  28. 1:26So what would make it continuous? What's
  29. 1:28the threshold?
  30. 1:32And thank you for answering. The correct
  31. 1:34answer is not 24. Although this is a
  32. 1:36standard 24 is standard for for movie
  33. 1:39for movies in movie theaters but
  34. 1:41actually the answer is 12.
  35. 1:44So people study these concepts very
  36. 1:48carefully. How many frames per second is
  37. 1:50enough for various things. So um to
  38. 1:53perceive a motion is two frames per
  39. 1:56second. to perceive motion as
  40. 1:58continuous. So not to see individual
  41. 2:01frames. It should be the minimal of 12
  42. 2:03frames per second. Of course, the more
  43. 2:05the better, but it's the minimal of 12.
  44. 2:09And we'll learn later why exactly the in
  45. 2:12movies we have 24, not 12. Now, how many
  46. 2:15frames per second is enough then to
  47. 2:17watch movies comfortably. See that's
  48. 2:19another thing because there's other
  49. 2:21issues like jutdder or flicker that will
  50. 2:24appear even though the motion is
  51. 2:26continuous but you can see then this
  52. 2:27transition between the frames that is
  53. 2:29annoying
  54. 2:30not necessarily individual frames but
  55. 2:32the transition will be result in this
  56. 2:35flicker or jutter. So then uh in movie
  57. 2:38theaters the screens are quite far away.
  58. 2:40So 24 frames per second was set as a
  59. 2:43standard but on on TV usually most of
  60. 2:47TVs today have 60 frames per second but
  61. 2:49the content may be 24 or 30 or 60. Uh on
  62. 2:53a phone usually starting with 60 these
  63. 2:56days and in VR it's an open question.
  64. 2:58Starting with 90, that's the minimal
  65. 3:00recommendation of frame of frame rates.
  66. 3:03But we'll show you that if you raise
  67. 3:06frame rates, there still may be issues
  68. 3:08just because the screens are so much
  69. 3:11closer to our eyes. But also with the
  70. 3:13way we interact with the environments,
  71. 3:15there's tracking that has never been the
  72. 3:18issue for movie theaters or for uh 2D
  73. 3:22screens, uh computer screens or phones.
  74. 3:24So you can interact with the
  75. 3:25environment. So the environment has to
  76. 3:27react fast enough as you move your head.
  77. 3:30So that will drive this frame per second
  78. 3:33requirement in VR even higher.
  79. 3:36But it all depends so all it depends uh
  80. 3:39on this on the hardware uh
  81. 3:41specifications on distance to the screen
  82. 3:43and on perceptions or on our neural
  83. 3:45structures. And we'll talk about it more
  84. 3:47in details. But now I'll just talk I I
  85. 3:50showed this slide for you so that you
  86. 3:51know what is it that you'll expect in
  87. 3:53this course. What what questions will we
  88. 3:55answer in this course? Is there any
  89. 3:57advantage done in VR technology to bring
  90. 3:59out immersive experience of sense of
  91. 4:01touch? I think professor manan would be
  92. 4:04a very good person to ask this questions
  93. 4:06and he'll um he'll have lectures uh
  94. 4:09later towards the end of the course. So
  95. 4:13um I don't work with touch as much as
  96. 4:16they do. So please ask it later.
  97. 4:22Okay. So let's let's continue.
  98. 4:25Similar evolution of computer games may
  99. 4:27be relevant to virtual reality. And
  100. 4:29again computer games can be simple can
  101. 4:32be extremely realistic
  102. 4:35uh but they can be portable on phones
  103. 4:38again simple right. So the question is
  104. 4:41how much um
  105. 4:44how much effort do you want to put into
  106. 4:47your um into your game into a computer
  107. 4:49game and what's the goal? So if realism
  108. 4:52is gold that's great but if
  109. 4:54entertainment is gold then you can get
  110. 4:56away with very very simple solution and
  111. 4:59still u generate huge crowd right like
  112. 5:02uh angry birds or Minecraft
  113. 5:06so what is the goal is the goal
  114. 5:08entertain or capture attention in some
  115. 5:10way then you can reduce the cost of
  116. 5:13production so it's very important okay
  117. 5:17so now let's really talk about virtual
  118. 5:20reality
  119. 5:21So, so far, if you think about it, we
  120. 5:23really taught about staring at
  121. 5:25rectangles. Our phones, TVs, computer
  122. 5:27screens, they're rectangles. They're 2D
  123. 5:29rectangles. So, when did something more
  124. 5:32immersive or 3D start? Which system was
  125. 5:35the first one? So, Sensorama is maybe
  126. 5:38the first one, but we've never heard of
  127. 5:39it. It's just like a sphere spherical
  128. 5:42image. They didn't provide tracking
  129. 5:43really. Um so probably the the the first
  130. 5:48virtual reality or the big big big leap
  131. 5:52with respect to this 3D immersive
  132. 5:54environment was Ivan Sutherland's sword
  133. 5:57of Damocles. So this is considered the
  134. 6:00first functional VR headset.
  135. 6:03It was built in uh 16 1968
  136. 6:08and uh uh it already had to use the
  137. 6:10power of modern PCs at the time because
  138. 6:14uh it had tracking. So there was a big
  139. 6:17computer the um in this room the size of
  140. 6:21the wall that did all of the
  141. 6:22computations and there was tracking. So
  142. 6:24there was sensors that would sense the
  143. 6:27emotions to generate to to reproduce the
  144. 6:29environment uh appropriately on the
  145. 6:32world. So it's um it had tracking.
  146. 6:37Ivan Sutherland is considered to be the
  147. 6:38pioneer of VR because of that. But if
  148. 6:41you look at what exactly is shown, it's
  149. 6:44just more like AR. So this very simple
  150. 6:47cubes are projected on the world but
  151. 6:49they attract, right? They attract. It's
  152. 6:52a very very simple system. about the
  153. 6:54groundbreaking at the time. So starting
  154. 6:56the season and up to the '90s, there was
  155. 6:58a huge hype around VR because of all of
  156. 7:01these advances. So the first commercial
  157. 7:03products uh appeared VPL company uh
  158. 7:07popularized the gloves and headset.
  159. 7:10However, there were always problems at
  160. 7:12the time with cost, resolution, latency,
  161. 7:15and content. So something that we still
  162. 7:17talk, right? We still have problems of
  163. 7:19cost, resolution, latency, and cont. We
  164. 7:21don't have latency anymore though, but
  165. 7:22content and the headsets being heavy,
  166. 7:25bulky, and expensive. But at that first
  167. 7:28wave, they were much heavier, much much
  168. 7:30bulkier than what we have now. So then
  169. 7:34the first commercial VR game ever
  170. 7:36released was by Nintendo Virtual Boy in
  171. 7:391995.
  172. 7:41And guess what? This device together
  173. 7:43with the game,
  174. 7:45the content was red and white. So it
  175. 7:49didn't even have colors, red and white
  176. 7:51content and there was no tracking. So
  177. 7:54you had to put it on the table and and
  178. 7:55just attach your head and view the
  179. 7:58content through through the headset.
  180. 8:01So this really effectively marked the
  181. 8:03death of VR in the '90s and nobody ever
  182. 8:06wanted to touch VR until the Palmer's
  183. 8:09prototype in 2012 because the the
  184. 8:12thinking was that if Nintendo can do it,
  185. 8:14nobody can do it.
  186. 8:16Uh however there were I have to uh
  187. 8:18mention that there were military
  188. 8:20headsets that were on the order of
  189. 8:22thousand tens of thousands of dollars
  190. 8:25but uh again they were bulky and heavy
  191. 8:27and low resolution and very expensive
  192. 8:30and there were caves. So caves is very
  193. 8:32interesting thing they stayed around in
  194. 8:34academic circles. They're extremely
  195. 8:37expensive. So like a cave like this
  196. 8:38would be a million dollars to set up.
  197. 8:41Um, and it's a projection system on the
  198. 8:44walls with tracking. So, there's sensors
  199. 8:47that would track your body and upgrade
  200. 8:49the projection on the walls accordingly.
  201. 8:51And in order to have stereo, you had to
  202. 8:53have polarized glasses for that. Like
  203. 8:55you could see that this guy was wearing
  204. 8:57polarized glasses.
  205. 8:59So, uh, the question is, are we in we
  206. 9:02are in the second wave of hype in VR?
  207. 9:05And is it going to stay around? It seems
  208. 9:07like it's going to stay around with this
  209. 9:08cheaper and better, lighter and less
  210. 9:11expensive headsets,
  211. 9:13but still we we lacking content.
  212. 9:16So, okay, we are done with this um
  213. 9:20introduction lecture, but I want to talk
  214. 9:24I want to jump to the next lecture. Then
  215. 9:27I want to go
  216. 9:30let me see.
  217. 9:33So I want to
  218. 9:36since we have time I want to go in
  219. 9:38chapter two the bird's eye view and talk
  220. 9:41about the hardware and maybe start with
  221. 9:43human senses and sensors because this
  222. 9:45chapter is so long that um we'll have
  223. 9:47only two more lectures to cover it but I
  224. 9:50wanted to start today then so we will
  225. 9:53jump into chapter
  226. 9:56two but I want to ask you just some
  227. 9:59review so that to wake us up kind of for
  228. 10:02the next chapter.
  229. 10:04So realistic graphics is this is
  230. 10:05essential for immersion in VR or not.
  231. 10:12We just covered it. So
  232. 10:15release
  233. 10:17answer
  234. 10:19is realism important for immersion.
  235. 10:23So what if it's not realistic
  236. 10:25environment? What is it if it's a
  237. 10:26cartoon environment in VR or
  238. 10:30or something else? I don't know, very
  239. 10:33simple kind of or what if it's not even
  240. 10:36an environment? I'll we'll we'll show
  241. 10:37you some examples like some of you tried
  242. 10:39sites in VR that's not really any kind
  243. 10:43of realistic environment but you're
  244. 10:46you're interacting with something.
  245. 10:49So are you immersed or not?
  246. 10:56So the correct answer is false. Right?
  247. 10:58Realistic graphics is not essential for
  248. 11:02immersion. You can be immersed in a
  249. 11:04cartoon world. You can be immersed in uh
  250. 11:07unity generated world. That's not
  251. 11:09necessarily uh realistic.
  252. 11:12Right? So the correct answer is false.
  253. 11:15Very good. Now the first ever VR headset
  254. 11:18was released by Nintendo together with
  255. 11:20the game Virtual Boy. Is that true or
  256. 11:22false?
  257. 11:26It was false. Right. The first ever
  258. 11:29VR headset was uh done pro much earlier
  259. 11:34before. So Ivan Sutherland's headset you
  260. 11:37can call that maybe the first ever. It
  261. 11:40wasn't really released but there were uh
  262. 11:42other ones like VPL companies headsets.
  263. 11:46Okay. So false. Very good.
  264. 11:49I put those questions because so many
  265. 11:51students get it wrong on the exams. I
  266. 11:53think um
  267. 11:55I don't know. Just wanted to make sure
  268. 11:57that we get it right. So, as you
  269. 12:00probably can already see that without
  270. 12:02understanding human senses, it's
  271. 12:06impossible to design good and
  272. 12:08comfortable VR systems because it's very
  273. 12:10important what is it that we see, how we
  274. 12:13see it, and how the brain processes this
  275. 12:15information. Uh VR systems are supposed
  276. 12:19to trick the human senses, right? So,
  277. 12:21it's very important to know what is it
  278. 12:23that you're tricking. So, let's start
  279. 12:24with a simple question. How many senses
  280. 12:26do humans have? That's one question. So,
  281. 12:29how many senses do humans have?
  282. 12:45So, I see some of you are answering in
  283. 12:47chat. Median chat. It's harder to read
  284. 12:48there. Please join um slider.com. just
  285. 12:52uh just use this QR code and you will
  286. 12:55get to slider.com
  287. 12:57and you can answer those questions and
  288. 12:59put your questions there too in Q&A.
  289. 13:03Okay, so see I see many many is good.
  290. 13:06It's not five, it's not six.
  291. 13:09And again, this is one of the questions
  292. 13:11that some students don't get right on
  293. 13:13the exam and I want you to get it right.
  294. 13:15If you studied perceptual psychology
  295. 13:17then you know that the correct answer is
  296. 13:19not five is not six and the correct
  297. 13:21answer will be the boring answer it's
  298. 13:23more complicated than that right so the
  299. 13:25qu the answer is it's just more
  300. 13:27complicated
  301. 13:29the reason is that the senses are
  302. 13:31related the in in perceptual psychology
  303. 13:34definition are related to receptors that
  304. 13:37receive that information and there are
  305. 13:39so many there are more than 10 we'll
  306. 13:41have a whole table but let me just give
  307. 13:44this a demonstration So on this picture
  308. 13:46on the left here I picked one organ. So
  309. 13:49sense organ for each sense that is
  310. 13:52relevant to virtual reality. So here is
  311. 13:54the eye for seeing things. Ear for
  312. 13:57hearing, ear for the sense of balance.
  313. 14:00There you go. So there are receptors in
  314. 14:02our ears that will determine where we
  315. 14:04are in with respect to space to help us
  316. 14:06balance. So that's not the um one of the
  317. 14:11five senses that we usually talk about
  318. 14:13in mainstream, right? So that's why it's
  319. 14:16so it's much more complicated than that.
  320. 14:18Here for we we pick touch for the sense
  321. 14:22of touch. Sorry, we pick skin for the
  322. 14:25sense of touch but also skin can detect
  323. 14:27the sense of pressure, pain and
  324. 14:30temperature. Right? So there are many
  325. 14:32other receptors there not only for the
  326. 14:34touch. Nose is for smelling. Notice
  327. 14:36there is no tongue here for tasting
  328. 14:38because we don't do VR for tastes. Uh we
  329. 14:43there's some prototypes for VR for
  330. 14:45noses. So there's some smells together
  331. 14:47with other sensory information. But most
  332. 14:50of the things that we are really
  333. 14:51concerned is the eyes, the ear and the
  334. 14:53sense of touch in virtual reality as we
  335. 14:55can do today.
  336. 14:57So uh let's see. So these are the only
  337. 15:01ones that we know how to interface
  338. 15:03really well.
  339. 15:04But even not all of them like the sense
  340. 15:07of uh the the vestibular system we don't
  341. 15:10know how to inter interfere too much.
  342. 15:13Okay. So how do senses work? How do
  343. 15:16senses u measure things? So there as I
  344. 15:20said there are the special cells that
  345. 15:22are called receptors that do the
  346. 15:24measuring. So in the eyes for example
  347. 15:26like in this video um there is the photo
  348. 15:29receptors on the back of our retina that
  349. 15:31absorb the light
  350. 15:34and do the sensing. So here's the video
  351. 15:36that shows it how it's done. So we also
  352. 15:38have receptors in ears sound receptors
  353. 15:41and position receptors for vibar system
  354. 15:43in the ears. There are also um uh
  355. 15:47receptors on the skin. So in the ears
  356. 15:49there's little hairs actually that move
  357. 15:52and they with the bending this
  358. 15:54appropriate signal is sent to the brain.
  359. 15:56But what's important is that the signals
  360. 15:58are sent to the brain for processing. So
  361. 16:00that's very important
  362. 16:02and I now because of that now I want to
  363. 16:05compare human senses to engineered
  364. 16:08sensors.
  365. 16:09So here how we can think about it. So
  366. 16:13the divi if for the devices that humans
  367. 16:15engineer we call them sensors and if
  368. 16:18it's something that naturally evolved on
  369. 16:21our bodies then we call them senses or
  370. 16:24sense organs. So the sense organ if it's
  371. 16:26we talking about a particular part of
  372. 16:28the body or sense if we're talking about
  373. 16:30receptors. So we will actually use these
  374. 16:34two words sense human sense and sensors
  375. 16:37interchangeably because they're kind of
  376. 16:39doing the same thing for the purpose of
  377. 16:41our class. So uh and they're both used
  378. 16:44for tracking so to speak. So what is the
  379. 16:47difference now and similarities between
  380. 16:49human senses and engineered sense
  381. 16:51source? So here on the right I have some
  382. 16:53sensors like um say cameras,
  383. 16:56microphones, thermometers, right? They
  384. 16:58do some kind of measuring of the real
  385. 16:59world around them and then they send the
  386. 17:01information to the some kind of central
  387. 17:04processing unit maybe CPU. So I have a
  388. 17:06question for you.
  389. 17:08What are the similarities between the
  390. 17:10human senses and the engineered sensors?
  391. 17:14So maybe you can think of it and then
  392. 17:16I'll I'll give the definition of how
  393. 17:18we'll define those two in our class.
  394. 17:26Oh yes, I forgot to mention that we
  395. 17:28switched to another slide. So the code
  396. 17:31has changed in slider. You're right. It
  397. 17:33did change. I forgot to warn you. Right.
  398. 17:36Right. Whenever we jump from one slide
  399. 17:37to another, there will be a change in
  400. 17:39slider.com and you need to scan the the
  401. 17:42code again.
  402. 17:47Yeah. So it both sensors and senses they
  403. 17:50sense the environment or they um get
  404. 17:54that information from the environment in
  405. 17:56some way to the processing unit. So um
  406. 18:02so here's the definition then a sensor
  407. 18:04sense is a transducer that uh transforms
  408. 18:07the physical world energy whatever it's
  409. 18:10measuring into a signal of some kind and
  410. 18:13for the engineered devices the signal
  411. 18:15will be the digital signals and it's
  412. 18:17sent via uh wires to the CPU while for
  413. 18:20the human senses it's the neural signal
  414. 18:23that is sent via neurons to the brain
  415. 18:26right and what would be the examples of
  416. 18:28energy Well, whatever they're measuring,
  417. 18:30right? The light chemical reaction
  418. 18:33energy or audio waves like air pressure
  419. 18:36waves or temperature whatever whatever
  420. 18:38is measuring. So why uh why is it
  421. 18:41important? Why do we talk about sensors
  422. 18:43and sensors? Well, it's all related to
  423. 18:45tracking. So we'll talk a lot about
  424. 18:47these things here because we need to
  425. 18:50understand tracking systems. So we need
  426. 18:52to interfere with what people see, touch
  427. 18:56or whatever we are interfering with
  428. 18:58hear. Um so that will be called then
  429. 19:01tracking, eye tracking, head tracking,
  430. 19:04uh hand tracking, body tracking,
  431. 19:05whatever. So in order to have high
  432. 19:08quality tracking, we need to understand
  433. 19:12how the senses or sense organs move with
  434. 19:15respect to the world so that we send a
  435. 19:18proper signal. So say in the real world
  436. 19:20if I want to see something closer I move
  437. 19:22my head closer right or if I want to
  438. 19:24hear something better I turn my ear
  439. 19:27towards the source of the sound. So we
  440. 19:29need to figure out in how many ways this
  441. 19:32uh transformations can happen so that
  442. 19:34the virtual worlds react appropriately
  443. 19:37in realistic ways because if if they're
  444. 19:40not then it the experience will be
  445. 19:42uncomfortable cause fatigue eye strain
  446. 19:45nausea vomiting whatever. So it's very
  447. 19:47important to for tracking to understand
  448. 19:49in how many different ways. So let's see
  449. 19:53um in how many ways uh the um sense
  450. 19:57organs can move in space and these
  451. 20:00senses can move this this changes the
  452. 20:03way they can change in the world they
  453. 20:05are controlled by the brain and the
  454. 20:08number of ways in which the sense can
  455. 20:11move with respect to the world is called
  456. 20:12the number the degrees of freedom. Okay.
  457. 20:15So the space of all such changes then is
  458. 20:17called configuration space and the
  459. 20:19dimension of this configuration space is
  460. 20:22called the number of degrees of freedom
  461. 20:24for that sense. So I want to count the
  462. 20:28in how many different ways with respect
  463. 20:31to the world can our sense organs move
  464. 20:33and relevant to VR. So we'll talk about
  465. 20:36eyes and ears for now. So I have a
  466. 20:39question for you. How many degrees of
  467. 20:41freedom does the human eye have? So
  468. 20:43again in how many different ways can it
  469. 20:45move in the space? So and what is the
  470. 20:49dimension of that space of motions? So
  471. 20:51for human eye
  472. 20:543 9 2 6 and I'm asking you the questions
  473. 20:59to think about it and then of course
  474. 21:00we're going to answer this question. So
  475. 21:02what about the human hand?
  476. 21:05How in how many different ways?
  477. 21:08How many different ways can can we touch
  478. 21:11things and feel something different you
  479. 21:13know so how in how many different ways
  480. 21:16can we move our hand so that the
  481. 21:18sensation is different because if you're
  482. 21:20creating VR for hand then the world
  483. 21:22should react to all these changes and
  484. 21:24give you different stimulus so it's much
  485. 21:27much yeah who said 360 exactly it's more
  486. 21:30like hundreds of degrees of freedom
  487. 21:33oh very good so we have some haptics
  488. 21:35experts here very good many. So the good
  489. 21:38answer is many. Okay.
  490. 21:44So how do you perceive time? We will not
  491. 21:47talk actually you know what maybe we'll
  492. 21:49have a little bit of that but time is a
  493. 21:52tricky thing because I don't think we
  494. 21:54really truly know how we perceive time
  495. 21:56but I can give you I will give you time
  496. 21:58illusions in the future. So there's a
  497. 22:00lot of thing tricky things about time.
  498. 22:02Some things we just completely some
  499. 22:05things that happen we completely erase
  500. 22:07from our memory. So we'll show you.
  501. 22:11Okay. Engineered sensor electronic.
  502. 22:14Yeah. It's electric signal that is sent
  503. 22:16via brains. Yep. Um
  504. 22:19okay. So
  505. 22:25we'll start with the ear. So now we'll
  506. 22:27answer this questions. We'll start with
  507. 22:28the ear. So in how many different ways
  508. 22:31we can place the human ear in the world
  509. 22:34so that we hear things differently and I
  510. 22:37wanted you to think of a single source
  511. 22:38of sound and how could I position my ear
  512. 22:42to hear it differently and I saw that
  513. 22:44you showed you answered in many
  514. 22:46different ways but let's finalize the
  515. 22:47answer and I put a video of a cat here
  516. 22:51because cat and other animals can bend
  517. 22:54which way their ears are pointing which
  518. 22:56will change the sound how it sounds And
  519. 22:59we humans we can't our ears are rigidly
  520. 23:02attached to the head and therefore the
  521. 23:05way uh you try sound for humans is
  522. 23:08different than it would be for cats and
  523. 23:10that's a a serious distinction. So oh
  524. 23:14yeah I didn't ask you. So how many
  525. 23:15degrees of freedom do you think the
  526. 23:17human ear has? So that's different from
  527. 23:20eyes.
  528. 23:25Okay. So let's let's now answer our ear.
  529. 23:30So there is head position right as I
  530. 23:33move my head in three different ways
  531. 23:35along three different axis um then along
  532. 23:38X Y and Z that will be three degrees of
  533. 23:41freedom and then I can rotate my head
  534. 23:43around the same axis. So the total
  535. 23:46number of degrees of freedom for ear is
  536. 23:49six. So that's very good. And um now
  537. 23:53let's do I. So for eyes, there's
  538. 23:56suddenly a change. The eyes can rotate
  539. 23:59in eye sockets. So that's kind of like
  540. 24:01the cat ears can rotate in their
  541. 24:04sockets, but our ears can't rotate in
  542. 24:07sockets, but the eyes can. Therefore,
  543. 24:10there is the usual the same for as for
  544. 24:14the ear. There is head position, head
  545. 24:15orientation for eye uh degrees of
  546. 24:19freedom. But then eyes can rotate in the
  547. 24:21obvious two directions in the direction
  548. 24:24of a yes up and down or sideways for no
  549. 24:28right but there is also the third
  550. 24:32rotation so I put two plus here this
  551. 24:36that is torsional and it's demonstrated
  552. 24:39and what 154
  553. 24:42here so there is a torsional component
  554. 24:45of the eyes rotating in their sockets
  555. 24:49Do you see that? So as we do this kind
  556. 24:52of motions, our eyes rotate torsionally
  557. 24:55which means that we see the world
  558. 24:57differently. So think about it. What
  559. 25:01does it mean, right? Do we have that
  560. 25:03kind of interface in our VR devices
  561. 25:06because the real world would respond and
  562. 25:08would be projected differently on our
  563. 25:10retinas as our eyes rotate tortionally.
  564. 25:14But do we provide that in VR devices?
  565. 25:17Not really. Right.
  566. 25:22Okay.
  567. 25:25Yeah.
  568. 25:29Well, yeah. I guess I I I'm most excited
  569. 25:32about next generation VR headsets where
  570. 25:35it will be this um retinal
  571. 25:39uh retinal displays. They're much more
  572. 25:41exciting to me. And um yeah, so I'm much
  573. 25:46more interested in advanced optics, but
  574. 25:49we'll see what happens. Apparently in
  575. 25:502027, there will be a lot of new
  576. 25:52headsets that will have that technology,
  577. 25:54good technology, not like Holo Lens 2,
  578. 25:56which is already kind of there, but not
  579. 25:58as exciting yet. Okay. So now, uh let's
  580. 26:03then count all of the degrees of freedom
  581. 26:05for the eyes. As I said already, head
  582. 26:07position three, head orientation three,
  583. 26:10rotations of eyes in sockets, that's
  584. 26:13two. And this is per eye. So each eye
  585. 26:16will have two more for yes and no, but
  586. 26:18also torsional maybe. So 2 point
  587. 26:20something. Then eyes can dilate. So
  588. 26:23there's additional internal changes that
  589. 26:25the eye can undergo such as pupil
  590. 26:29dilation and accommodation.
  591. 26:32And um dilation is something that you
  592. 26:34get to experience during the eye exam.
  593. 26:36So that just how much light the eye
  594. 26:38allows. But then accommodation is
  595. 26:41something very important.
  596. 26:43So uh we can refocus on objects as they
  597. 26:46get closer or further away. And what
  598. 26:49happens is that the silary muscles
  599. 26:51inside of the eyes, they squeeze the
  600. 26:53lens effectively increasing the diaper
  601. 26:56or the magnification power of our lens
  602. 26:58inside of the eyes. So we can see things
  603. 27:02um clear at different depths at
  604. 27:04different focal def depths.
  605. 27:08Um that is effectively another degree of
  606. 27:10freedom and uh as we get older we lose
  607. 27:13this uh power of the muscles. Uh so then
  608. 27:16we need reading glasses and but for
  609. 27:19example very very young children they
  610. 27:21can see things much much closer than
  611. 27:23young adults like you guys.
  612. 27:26But anyway, so if you add this all up,
  613. 27:28you you get about 10 total degrees of
  614. 27:31freedom. But how many um degrees of
  615. 27:34freedom does the Oculus Quest or
  616. 27:36Cardboard have or they how many they
  617. 27:38provide? How many they track? Right? So
  618. 27:40that's the question. How many degrees of
  619. 27:42freedom does the Oculus Quest 2 have?
  620. 27:48Six. Right? It says the degrees of
  621. 27:50freedom headset.
  622. 27:54So that's very good.
  623. 27:56it says so it only provides
  624. 27:59um head rotation and head position up
  625. 28:03down sideways or rotation of the head
  626. 28:05that's the only things that are tracked
  627. 28:08if you move your eyes around uh there is
  628. 28:10no eye tracking in Oculus Quest 2 what
  629. 28:13about VR cardboard and viewer that we
  630. 28:15will be using in this class how many
  631. 28:18degrees of freedom uh can be tracked I I
  632. 28:22degrees of freedom can be tracked in VR
  633. 28:24cardboard board only three right there
  634. 28:27is no six
  635. 28:29only three and the three degrees of
  636. 28:31freedom that can be trapped in
  637. 28:33cardboards are just orientation so if
  638. 28:35you go up and down the world will not
  639. 28:37change if you move sideways the world
  640. 28:39will not change there will be no
  641. 28:40parallels as you move sideways or
  642. 28:42forward
  643. 28:44uh our phones cannot do tracking without
  644. 28:47additional camera um so without
  645. 28:50additional sensors essentially so the
  646. 28:52only the IMU sensors that or on any
  647. 28:55phone will only provide three degrees of
  648. 28:57freedom tracking which we don't have.
  649. 28:59Okay, so let me summarize. This is the
  650. 29:01last slide. So the definition of degrees
  651. 29:04of freedom of senses and how it's
  652. 29:06connected to virtual reality. So here's
  653. 29:09the definition. In how many
  654. 29:12degrees of freedom is in how many ways
  655. 29:14can the brain control the sense organ to
  656. 29:16experience the world differently. Right?
  657. 29:20And the space of all such configurations
  658. 29:23is called configuration space and the
  659. 29:25dimension of it is degrees of freedom.
  660. 29:27And it's essential for understanding
  661. 29:29tracking or designing tracking systems
  662. 29:31that we will design in this class. So we
  663. 29:33will need this for um for designing
  664. 29:37tracking systems. Okay.
  665. 29:40So next time we'll start with hardware.
  666. 29:43We'll continue with hardware. Sorry.
  667. 29:44We'll uh go into what is the hardware
  668. 29:47that we have in common uh headsets. But
  669. 29:50now I'll take maybe questions and we can
  670. 29:53finish.
  671. 29:55So is vision pro the latest VR? No,
  672. 29:58there's uh other things that vision pro
  673. 30:01is not even a good one. So uh I think
  674. 30:04Quest 3 is it out? I'm not sure but
  675. 30:06that's the one that we're excited. It's
  676. 30:08like a low a cheaper high-end HMD that
  677. 30:12is coming out that is everybody's
  678. 30:13exciting about Ready Player One movie
  679. 30:16possible. Uh not yet. What is Quest 2?
  680. 30:20Uh Quest 2 is a high-end HMD that we do
  681. 30:23not have in this class. But in
  682. 30:24traditional courses that I teach at
  683. 30:26University of Olu, we usually distribute
  684. 30:28those to students.
  685. 30:31What is vection?
  686. 30:33Vet is the illusion of motion when there
  687. 30:37is no motion. So when you're in VR and
  688. 30:39there is a lot of optic flow if you feel
  689. 30:42suddenly like oh I'm moving
  690. 30:44um it's not necessarily that it will
  691. 30:46make you vomit right away. So vection
  692. 30:48and nausea are not necessarily the same
  693. 30:49concepts but it's this illusion of
  694. 30:52motion like when you don't move in your
  695. 30:54chair but you feel like you're moving in
  696. 30:56virtual space that's the that's fashion.
  697. 30:59Can you explain how to measure degrees
  698. 31:01of freedom? You need to figure out
  699. 31:02what's the configuration space. So where
  700. 31:04can in how many different ways and where
  701. 31:08can say the eye move and uh looking at
  702. 31:12that space you can compute its
  703. 31:15dimension. We maybe we'll go more
  704. 31:17through this. Okay. So
  705. 31:22or you know what let's open a discussion
  706. 31:24on discord as well. So that will be
  707. 31:26good. It's a little bit of a
  708. 31:28mathematical notion. So you really need
  709. 31:30to think of a space of all
  710. 31:32configurations of some object
  711. 31:37configuration space. So you can Google
  712. 31:38what a configuration space is and how to
  713. 31:40define it for different objects and then
  714. 31:44that is the answer. Do you have examples
  715. 31:47of non-invasive BCI using VR
  716. 31:51interface
  717. 31:54brain computer interface? Is that I'm
  718. 31:57not sure. I'm guessing this term and
  719. 32:01non-invasive
  720. 32:03brain computer interface.
  721. 32:05Oh, yeah. Yeah. Yeah. Of course. Yeah.
  722. 32:08No, I don't know any any of those. I
  723. 32:11clearly it's not my area.
  724. 32:14But
  725. 32:16a good question. We can we can look up
  726. 32:18together. I can ask my colleagues. I
  727. 32:20don't think so. I think they need to put
  728. 32:22the electrodes inside. Oh, but although
  729. 32:25now I think they maybe there are some
  730. 32:27electrodes that can be like in EG caps
  731. 32:29that can measure a lot more of brain
  732. 32:31activity. But no, I I really don't
  733. 32:33that's not my field. So uh but I
  734. 32:36definitely can ask and we can Google
  735. 32:38together. It's 7:15. Yes, it's time to
  736. 32:41finish. So we are done.
  737. 32:44Please I'll try to again I'll try to
  738. 32:47answer all the questions later after
  739. 32:48lecture. I'll go through this unanswered
  740. 32:50questions and put them on Discord. So
  741. 32:53goodbye.
  742. 32:56[Music]

About this transcript

This page contains the full transcript of VR Definition, History - Part 3 by NPTEL-NOC IITM, generated from the public captions YouTube serves with the video. The transcript has 4,998 words across 742 segments, with the original timestamps preserved so you can click any line to jump to that moment in the embedded player.

What you can do with it

Use the transcript to take notes, quote the speaker, build a study guide, generate a summary with ChatGPT or Claude via the YouTube Summary tool, or export it as a timed subtitle file with YouTube to SRT. You can also re-open it in the transcriber to translate the transcript into 100+ languages.

Free YouTube transcript tool

YouTube2Text is a free YouTube transcript generator — no signup, no daily limit. Paste any YouTube link and get the full transcript instantly, with timestamps, click-to-jump, translation to 100+ languages, AI prompts for ChatGPT, Claude, and Gemini, and exports to TXT, SRT, VTT, or Markdown.