VR Definition, History - Part 2 — Transcript

Full transcript

1. 0:01[Music]
2. 0:17So cool. Let's go further. So now I'll
3. 0:20go through applications of VR. Modern
4. 0:24applications of VR. Remember we do not
5. 0:26have killer app yet. But there are
6. 0:28applications. There are lots of
7. 0:29applications and
8. 0:32many people like these applications and
9. 0:34they're passionate about them but
10. 0:36they're not
11. 0:38uh so popular that everybody knows about
12. 0:40them or every not everybody's excited
13. 0:43about them either. So here's uh one
14. 0:45thing is that um
15. 0:48socializing virtual places right? So
16. 0:50there's a lot of virtual spaces out
17. 0:52there already where you can hang out and
18. 0:55do various things like virtual
19. 0:57conferences or you can even get married
20. 1:00in VR such as this wedding uh virtual
21. 1:03wedding to an anime character in Japan
22. 1:07or uh there are even uh virtual funerals
23. 1:09like this one. So someone arranged a
24. 1:12funeral for himself I believe um and it
25. 1:16was conducted in virtual reality
26. 1:19and of course the metaverse. So
27. 1:21metaverse is supposed to be what we will
28. 1:23be doing uh all the time uh according to
29. 1:26Mark Zuckerberg. So metaverse will be
30. 1:28also a social virtual space when it's uh
31. 1:32available to us.
32. 1:35Uh architecture and real estate has many
33. 1:37applications in virtual reality. So
34. 1:39there are lots of virtual tours out
35. 1:41there that um real estate agents post
36. 1:44for you to explore like this one. So
37. 1:47this is kind of cool. Many of you maybe
38. 1:49already tried it. Then you can go in
39. 1:51this um and explore it in in your
40. 1:54viewers as well if it's on YouTube for
41. 1:56example. And now you know how to do that
42. 1:57because with homework one you can
43. 1:59calibrate your viewers and have pleasant
44. 2:01experiences like this.
45. 2:04So another interesting application is
46. 2:06movies and this is something
47. 2:08interesting. So, I actually want to go
48. 2:10through this video.
49. 2:14But it really is a cool experience and
50. 2:16it was fun to do on the original Quest,
51. 2:18but there was complaints with resolution
52. 2:20issues, it not being really that clear,
53. 2:22it not being a great experience, the
54. 2:24comfort, all of that. Today, we're
55. 2:26talking about the options you have for
56. 2:28the Quest 2, how you can watch movies,
57. 2:30and whether it's actually worth watching
58. 2:32movies on the Quest 2. before I get into
59. 2:34the quality.
60. 2:36So what is this
61. 2:38uh VR movies? So essentially you can
62. 2:41leverage any kind of streaming app like
63. 2:43Netflix or whatever you're using and
64. 2:46watch it in this VR theater, right?
65. 2:50Watching cinema
66. 2:52question. So the only difference of
67. 2:55viewing this streaming services in VR is
68. 2:58that there's lower resolution for what
69. 3:00you're viewing, but you have your
70. 3:01virtual cinema or virtual theater. So
71. 3:04you can invite your friends and you can
72. 3:05all hang out in this VR theater. So why
73. 3:07is it cool? Um I never got it, but I
74. 3:10know a lot of people who are passionate
75. 3:12about it and they really like this
76. 3:14application. And this VR cinema has been
77. 3:17around since 2012, so as early as Oculus
78. 3:20early days. Um, so it's supposed to be a
79. 3:23very exciting thing. So, you're welcome
80. 3:25to try one of these and see if you like
81. 3:27it or not. I don't think it's a killer
82. 3:29app, but it's one of those um on the
83. 3:32list of good ones.
84. 3:35Okay.
85. 3:41Now, another application is experiencing
86. 3:44panoramas. So, one example of such
87. 3:46application is called Earth VR. So, and
88. 3:50and uh yet another one is this
89. 3:52atmosphere. So, let's go in there. So,
90. 3:54that's an application
91. 3:58um that um or this is the site that
92. 4:01collected a lot of three 360 panoramic
93. 4:05movies. So, you can view them like this,
94. 4:07but you can also view them in your VR
95. 4:10goggles. And here I want to show you
96. 4:12this demonstration uh for the purposes
97. 4:15of homework one.
98. 4:18uh if you can what is a panorama? So
99. 4:20panorama is nothing more than a
100. 4:23projection of the 3D world on a 2D
101. 4:25sphere right and let me demonstrate it
102. 4:28maybe exit VR first and show you what
103. 4:32are these panoramas. So here is a 360
104. 4:34view but you can see it in the flat
105. 4:36view.
106. 4:38So you can uh cut out the sphere and
107. 4:42just put all of the image there or as a
108. 4:45planet like this
109. 4:49but it's nothing else in the end but
110. 4:53uh let's see from 360 view it's nothing
111. 4:56else but a spherical 2D image that is
112. 4:59the whole world is projected on the
113. 5:02sphere and it becomes 2D information
114. 5:04there is no real 3D information so this
115. 5:07is Why? It's surprising because
116. 5:09panoramas were originally created with
117. 5:12other purposes, not for VR.
118. 5:15They don't have proper 3D information.
119. 5:18They're flat. But surprisingly, they
120. 5:21have enough information to give you an
121. 5:23illusion of immersion in a 3D space if
122. 5:26you view them in a headset. However, in
123. 5:28order to view them in the headset, what
124. 5:30you would have to do
125. 5:32is you would have to uh-oh, where is it?
126. 5:35You would have touh split the screen. So
127. 5:37if this was your phone screen, you would
128. 5:39have to split it into two. And then what
129. 5:42what else you would have to do? You
130. 5:44would have to
131. 5:47um carefully take into account the
132. 5:49lenses in your viewer because they will
133. 5:51distort the light. So if you just put
134. 5:54this two images in front of your eyes
135. 5:56and then view them through the lenses,
136. 5:59then the straight lines will not appear
137. 6:01straight anymore. So the image will be
138. 6:02distorted. So you have to predistort the
139. 6:05image on your uh phone so that after
140. 6:08going through the lens you perceive it
141. 6:11as normal so that straight lines appear
142. 6:14straight. So it's very perception
143. 6:16related. It's also related to the techn
144. 6:18technical aspects of your headset. So
145. 6:21how far are the lenses from the phone?
146. 6:24What are those lenses? What is the
147. 6:25magnification of those lenses? So
148. 6:27depending on all of those things there
149. 6:30will be different distortion
150. 6:31predistortion parameters.
151. 6:34Okay. So uh so that's that's cool and
152. 6:37that's one of the applications of
153. 6:39virtual reality to view then these
154. 6:40panoramic experiences in VR to feel more
155. 6:44immersed into them. However, there are
156. 6:47big problems because um the UI with this
157. 6:50what do you do in this panoramas? You
158. 6:52cannot really jump from place to place.
159. 6:54You cannot walk in them. There's not
160. 6:55enough information. So, and the
161. 6:57resolution is not so good yet. So, um
162. 7:00many things to consider. But in Homework
163. 7:022, we provided a lot of panoramic
164. 7:04experiences for you to to try and see if
165. 7:07you like them. In fact, anything that
166. 7:09we'll do with low-end cardboards will be
167. 7:12kind of like panoramas because what you
168. 7:15really see is just
169. 7:18just a sphere around you. There is um no
170. 7:21more uh information than what you see.
171. 7:24there is no way to interact with the
172. 7:26world in more ways. So uh so think about
173. 7:29it even if it's if the these experiences
174. 7:31are pre created in unity they're not
175. 7:34really panoramic images that were taken
176. 7:36by cameras still there is a very there's
177. 7:40limited number of degrees of freedom in
178. 7:42which you can interact with the world
179. 7:44and that's something to
180. 7:48okay
181. 7:50so another application would be uh to
182. 7:55now put this 60 cameras
183. 7:59onto a robot or on something that's
184. 8:01moving.
185. 8:04Somebody is not muted. Please mute
186. 8:07yourself. Okay.
187. 8:11So, uh, if you put this panoramic
188. 8:13cameras on, uh, on another human, say
189. 8:16you're on a bike and you put a camera on
190. 8:18your helmet or or you put a camera on a
191. 8:21drone or on another robot, then you can
192. 8:26um, collect all of this 360 videos and
193. 8:30people in VR can view them. So, that's
194. 8:33called teleresence. There's of course a
195. 8:36limit limited amount of um, interaction
196. 8:38that you can have with this content
197. 8:39again. So you're just a passive viewer.
198. 8:42Uh however, it it's still pretty
199. 8:44amazing. That's a a good application
200. 8:48and a lot of uh companies are trying to
201. 8:50develop this.
202. 8:52Of course, there an application another
203. 8:54obvious application is firsterson
204. 8:56shooter games in VR. However, it has
205. 8:59limited success because if you compare
206. 9:01players who use VR with players who just
207. 9:04do it on their computers, then people in
208. 9:06VR have disadvantages. for example, they
209. 9:09can get sick from faction and they move
210. 9:13slower. Our bodies move slower than if
211. 9:16you control your character with the um
212. 9:18with the joystick or whatever with uh
213. 9:21keyboard and mouse. So therefore, many
214. 9:24many gamers still prefer playing on
215. 9:28traditional 2D screens instead.
216. 9:32Okay. So, here's a fun game. A new kind
217. 9:36of interaction that you can create in
218. 9:38virtual reality is different from we did
219. 9:40with uh in traditional games on our 2D
220. 9:42screens. So, imagine you're an elephant
221. 9:45in virtual reality and all you can do is
222. 9:47move your trunk to break break things.
223. 9:50This is a very very old game
224. 9:53and it was created I think in 2012 as
225. 9:55you can see. Um however
226. 9:59uh it's it was very entertaining. uh but
227. 10:02I showed it to you just the reason I
228. 10:05showed this example is how you can think
229. 10:07out of the box and create new kind of
230. 10:09interactions with the world but also
231. 10:11because it was a newer game there was a
232. 10:13very bad flaw that we didn't notice when
233. 10:16we are in VR but however if you look at
234. 10:18the screen phone in one of the frames I
235. 10:22ask you can you notice an obvious visual
236. 10:25flaw of this VR experience
237. 10:31what's drawn with it. Look, look very
238. 10:34carefully what your left eye will see in
239. 10:37comparison to your right eye
240. 10:40and think about how would it look like
241. 10:43when you view it in a viewer. Would it
242. 10:46be comfortable? And would you even
243. 10:48notice this problem?
244. 10:52So, let's see if you answered.
245. 10:56The curvature is okay because this is
246. 10:58the distortion that we're talking about.
247. 11:00Yeah, look at this. The backgrounds
248. 11:02don't match. Like the sky is pink and
249. 11:06not pink in left and right eye. What
250. 11:08does it mean? It never does it happen in
251. 11:09real world. Hm. Does it ever happen in
252. 11:12real world? So this is exactly the
253. 11:15questions that we'll be asking and
254. 11:17talking about during the uh this course.
255. 11:19The perception of things that can go
256. 11:22wrong in virtual reality. You have so
257. 11:24much control about what you show to the
258. 11:26left and right eye.
259. 11:30Um what happens if something goes wrong
260. 11:32in the systems?
261. 11:35Um so it's related to comfort of course
262. 11:37and things do go wrong. Okay. So the
263. 11:39colors don't match. Yeah. Very good. Uh
264. 11:43another application uh via roller
265. 11:45coasters. In your homework two we will
266. 11:48give you a roller coaster example. So
267. 11:49this is a 360 video. You can just
268. 11:52immediately put this YouTube video in a
269. 11:55a VR um settings and view it. This is
270. 11:59your homework two video. It would not it
271. 12:03I wouldn't do it in VR because I feel
272. 12:05sick right away from this kind of
273. 12:06experiences. Um you don't have to in
274. 12:09either. So you please report that you
275. 12:12couldn't complete it if you feel sick.
276. 12:14We don't want you to get sick. However,
277. 12:16many people like it. So it's thrill
278. 12:18seekers in VR.
279. 12:20Some of the best experiences come from
280. 12:24artists.
281. 12:26Uh so how would it feel if you had a
282. 12:29simulation of a guillotine in VR? That
283. 12:32is you see what happens
284. 12:36when your head is chopped off and
285. 12:39rolling around and you see the world
286. 12:41through that perspective. So that's
287. 12:43interesting I guess. Um so think again
288. 12:47we want you to think about things that
289. 12:50can be done in VR that we couldn't do it
290. 12:52on traditional screens.
291. 12:55Um think about killer app that is
292. 12:57possible maybe we'll make a step to in
293. 13:01in that direction in this course and
294. 13:04definitely thinking like this out of the
295. 13:06box would help.
296. 13:09Okay. Uh another
297. 13:11experience is um so this is very similar
298. 13:15to um teleresence except that in
299. 13:19teleresence it's really hard to control
300. 13:21robots when you're wearing the VR
301. 13:22headset. Here imagine that you put a 360
302. 13:26camera on an artist that will mimic your
303. 13:30motions.
304. 13:32So this is exactly this experiments it
305. 13:35then you have this possibility of
306. 13:38raising empathy
307. 13:40by showing how the world looks like from
308. 13:42somebody else's perspective. So imagine
309. 13:44that you can view the world as if you
310. 13:46were different gender, different race or
311. 13:49any kind of different physical
312. 13:51characteristics, right? So you see how
313. 13:54people treat you then or um maybe some
314. 13:56other aspects of life. So that's really
315. 13:59amazing, really interesting application
316. 14:02of virtual reality. Another obvious
317. 14:04application of course that I didn't put
318. 14:06is in science, but I guess I put it in
319. 14:08those um videos of uh neuroscience
320. 14:12videos with uh fruit flies and mice. But
321. 14:16um perceptual psychologists really like
322. 14:18using VR for their experiments nowadays.
323. 14:23Okay, so this is one of the best
324. 14:24experiences. Another application is
325. 14:26called Birdley. This is a VR system that
326. 14:29provides so much um sensory feedback to
327. 14:33you that it allows you to feel like
328. 14:35you're fly a bird flying in the sky um
329. 14:39while um by providing not only visual uh
330. 14:44feedback but also
331. 14:46uh you can flap your wings. There is air
332. 14:50flowing in your face. So it's very very
333. 14:53immersive and people report that it's
334. 14:55really amazing and they never got sick.
335. 14:59Okay. So let's take a break and take
336. 15:02some questions.
337. 15:03How can I verify that my accurately
338. 15:05recorded? Um so please ask it on I
339. 15:09actually don't know about attendance.
340. 15:10This is the question to the IT team
341. 15:12address TAS. This is a good question for
342. 15:15the discord.
343. 15:18Can someone still join this class
344. 15:19please? Uh again, please hunt at NPEL.
345. 15:23That would be really cool. Yeah, I think
346. 15:25people can still join if they purchase
347. 15:28their cardboards right away because
348. 15:29that's really crucial otherwise they'll
349. 15:31lose point for their uh for their
350. 15:32homeworks.
351. 15:35Uh so most of the phones will have the
352. 15:38proper IMUs installed. So everything
353. 15:39will be will be good. How however we
354. 15:43cannot possibly test it on all phones
355. 15:45but most of the phones will be just fine
356. 15:48because um I use a pretty standard and
357. 15:51they will work uh right
358. 15:55so no need of vision to define virtual
359. 15:57reality right no there is no vision just
360. 16:00I mean this is one of the senses that
361. 16:03will sense the virtual environment so
362. 16:06vision is just one of the sensory
363. 16:08stimulation
364. 16:10um parts of the system.
365. 16:14It's it's available on YouTube now. Can
366. 16:18you explain degree of freedom? Uh there
367. 16:20will be slides for that. So degrees of
368. 16:21freedom will be explained. Has been any
369. 16:24courses
370. 16:26brain damage through VR? No. Uh I will
371. 16:30give you a reference sometime in the
372. 16:32future where uh there were studies
373. 16:34showing that VR in moderate quantity is
374. 16:37safe for adults. So it has never been
375. 16:41proven for children. So there's always
376. 16:43this
377. 16:45precautions
378. 16:47or warnings about use of VR in children
379. 16:50just because experiments haven't been
380. 16:51done with them.
381. 16:56Okay. Okay. So let's move on. So now I
382. 17:00this is just for fun. This slide is just
383. 17:02for fun. So on intentionally I put some
384. 17:05examples that are right on the border of
385. 17:06our definition of virtual reality. So
386. 17:09obviously VR experience with something
387. 17:11like high-end HMD Oculus Quest 2 that's
388. 17:14a VR system it has to be right but um
389. 17:19would you call VR talking on the phone?
390. 17:21So think of some conversation that you
391. 17:23had with somebody on the phone that you
392. 17:25felt so immersed in the conversation
393. 17:28that you forgot where you were or you
394. 17:29forgot afterwards whether it happened in
395. 17:31real life or not. So again I don't know
396. 17:34if these experiences here in the middle
397. 17:38they VR or not VR but if you think about
398. 17:41it it will help you understand our
399. 17:42definition of virtual reality. So maybe
400. 17:44a good exercise.
401. 17:46Also, if we start talking about the
402. 17:48history of VR, I'm not sure paintings
403. 17:51would be the VR already. Can we call it
404. 17:54a can we call it VR systems? If a
405. 17:57painting is so immersive that you feel
406. 17:59like you're almost like it. I'm not
407. 18:00sure. Again, maybe we would have to
408. 18:02investigate this uh neural structures in
409. 18:04the brains, but we can't really do that.
410. 18:06So, it's not really clear, which is
411. 18:09fine. Yeah. Military and police
412. 18:10training. That's one of the
413. 18:12applications. Very good. Yeah. Uh also
414. 18:15prototyping. So there are many other
415. 18:16applications that I admitted. But um VR
416. 18:20can be used in many many many different
417. 18:22fields.
418. 18:25But maybe if we talk about the history
419. 18:27of VR when VR started maybe movies is
420. 18:30something relevant.
421. 18:32Uh because movies evolved over the years
422. 18:36so much that they become more and more
423. 18:38immersive, right? And also the
424. 18:40technology of movies is relevant to us
425. 18:41because they use what's called uh this
426. 18:44phenomenon of stuboscopic apparent
427. 18:46motion and screens that are also used
428. 18:49for virtual reality. So this is the
429. 18:51first film that has been ever made in
430. 18:541878 by Edward Mubbridge and it's simply
431. 18:57a movie made by flipping through the 12
432. 19:03um frames, right? But it gives um this
433. 19:09illusion of motion when you view it
434. 19:12consequently right and this straoscope
435. 19:16what's called stroscopic apparent motion
436. 19:18or this phenomenon is the basis for all
437. 19:20of the screens that we use today phones
438. 19:22TVs computer monitors right so all you
439. 19:25need is this 12 pictures per second and
440. 19:27the motion will appear
441. 19:30continuous rather than you see
442. 19:32individual pictures and to record is 24
443. 19:36cameras. I think this one is 24. I know
444. 19:3812, but 12 would be enough. So, for this
445. 19:41movie, yeah, it's 24. Actually, it's 16.
446. 19:44So, I don't know. I need to look it up
447. 19:46again, but it doesn't matter. So, these
448. 19:48cameras were set up conse consequently.
449. 19:52And they were triggered when the horse
450. 19:55was um was running and flipping the
451. 19:59wires. And then to view it they had
452. 20:01something like record player to and a
453. 20:03projector to view this first movie. So
454. 20:06then over the next 150 years movies have
455. 20:09became um much different right and they
456. 20:13made a huge leap. So for example look at
457. 20:15this movie from 1895.
458. 20:18It doesn't look impressive to us anymore
459. 20:20but this was revolutionary at the time.
460. 20:22So people would scream in terror and run
461. 20:24to the end of the theater because they
462. 20:26were scared by
463. 20:28this
464. 20:30train that is approaching on on this
465. 20:32station. But for us, I've never seen
466. 20:36students screaming or being scared of it
467. 20:39because we mostly are used to movies so
468. 20:41much that we are actually good at
469. 20:44criticizing them. So we say, "Okay, this
470. 20:47movie is blurry, it's shaky, it's low
471. 20:49resolution, it's black and white.
472. 20:52So after being exposed to movies, we can
473. 20:54compare which experience is better,
474. 20:56which is worse, right? But this is not
475. 20:57the case for VR yet. So we need to
476. 21:00determine what is good VR, what is bad
477. 21:02VR. We're not there yet. We probably
478. 21:04don't have a great VR yet at all to
479. 21:06compare.
480. 21:08Uh so here's a say extremely realistic
481. 21:12movie from 2013, Gravity. And I didn't
482. 21:15put the clip because then YouTube will
483. 21:18insert commercial. Although this vid I
484. 21:21think this content on YouTube will be
485. 21:23still will
486. 21:25it has some monetized content I guess.
487. 21:27So probably there will be ads in this
488. 21:30video uh but not in later lectures
489. 21:33because I inserted so many different
490. 21:35clips in this video. So anyway we look
491. 21:38at gravity and you say okay cool so what
492. 21:40maybe there will be even more immersive
493. 21:41movies in the end right we don't care.
494. 21:44So a very important question that I want
495. 21:45to raise is that though and it's
496. 21:47relevant to our course and especially
497. 21:49the course with the cardboard that we
498. 21:51are now. So the question is are extreme
499. 21:55high levels of realism necessary
500. 21:58to keep people entertained right. So um
501. 22:02for both paintings and movies uh we seem
502. 22:06to agree to accept much lower quality of
503. 22:10or realism much lower realism in
504. 22:12exchange for what in entertainment right
505. 22:14so one motivation is entertainment so if
506. 22:16you leave a lot to imagination our brain
507. 22:18will fill in the details we don't need
508. 22:20maybe that much details as long as we
509. 22:22are entertained so this is similar to
510. 22:24say impression impressionist paintings
511. 22:27right but also for cartoons and
512. 22:29animations so Another
513. 22:32uh motivation for lower quality or lower
514. 22:36realism is portability and cost. So look
515. 22:39at this um picture where families in the
516. 22:431950s would gather around their blurry
517. 22:46tiny black and white screens, the tube
518. 22:48TVs, right? Because those tube TVs had
519. 22:52free broadcasts in their homes. So cheap
520. 22:56and portable, right? Even though already
521. 22:59at those times there were this amazingly
522. 23:01advanced theaters with high resolution
523. 23:03color panoramic 3D movies. So they even
524. 23:06had vibrations in their seats, right? So
525. 23:10um so people would change that quality
526. 23:12for portability and cost. Nowadays
527. 23:15almost everybody has a a cell phone in
528. 23:19their pockets. But what do we sacrifice
529. 23:22by viewing content on this on our cell
530. 23:25phones? What do we sacrifice? So we also
531. 23:27sacrifice a lot. It's also a smaller
532. 23:29image, right? And also we sacrifice the
533. 23:32quality of internet connection, but we
534. 23:34do it because in general humans seem to
535. 23:37like things that are cheap and portable.
536. 23:40And that's the motivation, one of the
537. 23:41motivations for our course in cardboard
538. 23:43that's cheap and portable. Before when I
539. 23:46run my courses on with the high-end
540. 23:48HMBBS,
541. 23:50I could not show projects uh to to
542. 23:53anybody else in my family or my friends.
543. 23:56students couldn't really show their
544. 23:57projects. Now, in this course, when we
545. 24:00create projects, you'll be able to share
546. 24:01it with anybody. You'll have it in your
547. 24:03pocket. So, uh that's kind of amazing.
548. 24:05We like this kind of things. We like
549. 24:07cheap and portable things.
550. 24:11[Music]