New Absolute King of 3D & Blender - GPT-6 Astra — Transcript

Full transcript

1. 0:00GPT -6 Astra is
2. 0:02insane.
3. 0:03I'm seriously, it's absolutely
4. 0:05mind blowing.
5. 0:06We was just recently
6. 0:07discussing Fable 5, Metis
7. 0:095, and now GPT
8. 0:10-6 surpasses it significantly.
9. 0:13We have crazy good
10. 0:14computer use and something
11. 0:15no one was expecting.
12. 0:17OpenAI shows trailer when
13. 0:19chat GPT works in
14. 0:20Blender and it's insanely
15. 0:22good.
16. 0:23I did some tests
17. 0:23guys and I guarantee
18. 0:24it will blow you
19. 0:25away.
20. 0:26Less talking, let me
21. 0:27show you.
22. 0:27And I want to
23. 0:28start with something that
24. 0:29I was actually working
25. 0:30on and it was
26. 0:32character like Animal.
27. 0:33And I was actually
28. 0:35building my own game
29. 0:36and I needed it
30. 0:37to rig it.
31. 0:37And I was thinking,
32. 0:38OK, maybe that's a
33. 0:39good chance to test
34. 0:40it out.
35. 0:40And what happened next,
36. 0:41I was not prepared
37. 0:42for.
38. 0:43But for a bit
39. 0:44comparison, let me first
40. 0:45show how Fable 5
41. 0:46.1 did that.
42. 0:47I'm going to give
43. 0:48all the APIs and
44. 0:49stuff.
45. 0:49I can explain setup
46. 0:50just in a bit.
47. 0:51And the task is
48. 0:52simple.
49. 0:52Generate a character, rig
50. 0:54it in animate.
51. 0:55Animation like simple walking
52. 0:57cycle, maybe this animation.
53. 0:58Here's the Fable 5
54. 1:00.1 result.
55. 1:01And it was actually
56. 1:02not bad.
57. 1:02You can see here's
58. 1:04how it looks and
59. 1:04we can actually see
60. 1:05the animation.
61. 1:06First of all, I
62. 1:07was surprised that weights
63. 1:08are not really broken.
64. 1:10But you can see
65. 1:11like a little bit
66. 1:11here, there like feels
67. 1:13a little bit rigid,
68. 1:14but not bad, not
69. 1:15bad.
70. 1:15And here's how GPT
71. 1:16-6 did it.
72. 1:17Dang, look, I mean,
73. 1:20boom.
74. 1:20It also added like
75. 1:21this animation.
76. 1:22Well, this animation is
77. 1:23not that cool, but
78. 1:25walking animation, I was
79. 1:26like, dang, what?
80. 1:27And there is no
81. 1:28problem with weights.
82. 1:29I don't even know
83. 1:30how it actually managed
84. 1:31to do that.
85. 1:32And what was surprising
86. 1:33me, I was not
87. 1:34really asking to add
88. 1:35rig and it actually
89. 1:37created control rig.
90. 1:38I mean, simple.
91. 1:39And it actually added
92. 1:40like inverse kinematics here.
93. 1:43Dang, like I was
94. 1:44no way, no way.
95. 1:45I mean, it's so
96. 1:46much that I will
97. 1:47be able to test.
98. 1:48And I mean, I
99. 1:49was actually working with
100. 1:51the animation and stuff.
101. 1:52So just look at
102. 1:53that.
103. 1:53I mean, that's a
104. 1:54simple control rig and
105. 1:55I was not even
106. 1:56asking about it.
107. 1:57And later, GPT also
108. 1:58did some renders.
109. 1:59I mean, it's crazy.
110. 2:00But what you're going
111. 2:01to see next, guys,
112. 2:02I was not prepared.
113. 2:03But first, let me
114. 2:04quickly explain my setup,
115. 2:06how we're going to
116. 2:07do the test.
117. 2:07So I have Codex
118. 2:08CLI.
119. 2:09That's much more convenient.
120. 2:10And we're going to
121. 2:11do test with quite
122. 2:12cool Blender plugin by
123. 2:14Hicksfield.
124. 2:15This way, we're going
125. 2:16to get really, really
126. 2:17far compared to computer
127. 2:18use.
128. 2:18I mean, you probably
129. 2:19saw the trailer from
130. 2:20OpenAI where they show
131. 2:22like,
132. 2:22you know, like, do
133. 2:23this, do that.
134. 2:23And it indeed can
135. 2:25do that.
136. 2:25But but hear me
137. 2:26out.
138. 2:27I set the plugin.
139. 2:27I gave it a
140. 2:28test.
141. 2:29And guys, it was
142. 2:30saving a file for
143. 2:3210 minutes.
144. 2:33You can see the
145. 2:34time lapse on your
146. 2:35screen, how it does
147. 2:36it like it takes
148. 2:37eternity.
149. 2:38So the task was
150. 2:39like to create a
151. 2:40samurai from the image.
152. 2:42And then like, I
153. 2:43mean, that was taking
154. 2:44like so long in
155. 2:45one hour.
156. 2:46It was able to
157. 2:46do this like this
158. 2:48because it was clicking
159. 2:49and stuff.
160. 2:50So computer use is
161. 2:51cool, but it's so,
162. 2:53so slow.
163. 2:54And I mean, if
164. 2:55you provide it with
165. 2:55MCPs that expose all
166. 2:57the engine functionality,
167. 2:58it will do way
168. 2:59more than that, which
169. 3:00I'm going to show
170. 3:01you.
171. 3:01And here's, by the
172. 3:02way, how GPT did
173. 3:03the samurai with MCP.
174. 3:05Well, building characters from
175. 3:06primitives is not really
176. 3:08working well in general.
177. 3:09Right. So we're going
178. 3:10to wait until GPT
179. 3:12learn how to work
180. 3:13with polygons and stuff.
181. 3:14But for now, we
182. 3:15have amazing 3D AI
183. 3:16that can generate really,
184. 3:17really good polygonal mesh.
185. 3:19And we can actually
186. 3:20provide all access to
187. 3:21GPT.
188. 3:22This new Hicksville plugin
189. 3:23is actually free and
190. 3:25it provides a lot
191. 3:26of tools for the
192. 3:28agent.
193. 3:28You can plug it
194. 3:29like with anything, like
195. 3:30with Claude, with GPT.
196. 3:32It's very easy to
197. 3:32install.
198. 3:33I'm going to drop
199. 3:33the link and I
200. 3:34combine it with Hicksville
201. 3:35CLI as well,
202. 3:36because now my codex
203. 3:38has access to 3D
204. 3:40AI, image generation AI,
205. 3:41and plenty of other
206. 3:43options that it can
207. 3:44trigger from Hicksville.
208. 3:45And if you want
209. 3:46to use 3D, 2D
210. 3:48video generation, you're going
211. 3:49to need to log
212. 3:50into your account
213. 3:51or you can use
214. 3:52it for free as
215. 3:52an MCP.
216. 3:53Now, next test and
217. 3:54here we're going to
218. 3:55see a huge difference
219. 3:56between Fable 5 .1
220. 3:57and GPT 6.
221. 3:59Idea is very simple.
222. 4:00I have my creature.
223. 4:01How about we build
224. 4:02some location?
225. 4:03Let's start with simple
226. 4:04location.
227. 4:04And I'm going to
228. 4:05be generous and I'm
229. 4:06going to allow it
230. 4:07to use any other
231. 4:08APIs to test Fable
232. 4:105 .1.
233. 4:10Now, I was actually
234. 4:11using the Hicksville plugin.
235. 4:13You can access it
236. 4:14right here and GPT
237. 4:156 will be also
238. 4:16available here in plugin
239. 4:18directly,
240. 4:18which is cool, but
241. 4:19of course it's optional.
242. 4:20OK, work is done
243. 4:21and here is the
244. 4:22result.
245. 4:23So Fable 5 actually
246. 4:24generated few objects and
247. 4:26it actually reminds the
248. 4:28scene.
249. 4:28It's not like far
250. 4:29in shape, but it
251. 4:30looks like very rigid,
252. 4:32right?
253. 4:32And it's still impressive,
254. 4:34but not as impressive
255. 4:36as GPT 6.
256. 4:37So let me finally
257. 4:38show it to you.
258. 4:39And just so you
259. 4:40believe that was indeed
260. 4:41one prompt, I have
261. 4:42complete time lapse.
262. 4:44So here's how GPT
263. 4:45does it.
264. 4:45And I actually really
265. 4:46like this approach.
266. 4:47It does some blocking
267. 4:48and start gradually generate
268. 4:50some objects somewhere.
269. 4:51It did it procedurally
270. 4:53somewhere.
271. 4:53It generate objects actually
272. 4:55for this whole scene.
273. 4:56It generated just few
274. 4:58objects.
275. 4:59It generated main islands
276. 5:01and this shrine itself
277. 5:02and position.
278. 5:03All the backgrounds was
279. 5:05procedurally generated.
280. 5:06There are flames. They
281. 5:07are animated.
282. 5:08Also procedurally done and
283. 5:10this amazing video.
284. 5:11I mean, I was
285. 5:12actually blown away when
286. 5:13I saw that this
287. 5:14look really, really good.
288. 5:15And, you know, I'm
289. 5:16the guy who actually
290. 5:17see this firsthand.
291. 5:18And this jump in
292. 5:20quality is insane.
293. 5:22Now, let me show
294. 5:23you one more test.
295. 5:24Here's the reference image.
296. 5:25And the task is
297. 5:27to create all of
298. 5:28this procedurally.
299. 5:29So in this case,
300. 5:30we're not allowing it
301. 5:31to use any 3D
302. 5:32AI or generating images.
303. 5:34Just do everything procedurally.
304. 5:36So we're going to
305. 5:36see how it does.
306. 5:37Also, again, I recorded
307. 5:38complete time lapse and
308. 5:40you can see the
309. 5:41approach, right?
310. 5:41It starts with primitives,
311. 5:43then it adds more
312. 5:43and more and more
313. 5:44details.
314. 5:44And you can see
315. 5:45like how it already
316. 5:46looks so cool.
317. 5:48Right. And it also
318. 5:49did such a great
319. 5:50job setting up the
320. 5:51light in the scene.
321. 5:53I mean, the render
322. 5:54is set quite professionally
323. 5:56and also look how
324. 5:57it
325. 5:57organized the project, like
326. 5:59and prepared, like everything,
327. 6:00like put the reference
328. 6:01that we use, it
329. 6:02generated the videos.
330. 6:04It all took like
331. 6:05one hour.
332. 6:05You can see all
333. 6:06the renders that it
334. 6:07created even on multiple
335. 6:08stages.
336. 6:08So you can track
337. 6:09the progress only by
338. 6:11here.
339. 6:11And here's the final
340. 6:12result.
341. 6:12I mean, that is
342. 6:13insane.
343. 6:14As a 3D artist,
344. 6:15I'm shocked and scared.
345. 6:17Not going to lie
346. 6:17because only three months
347. 6:19ago, I was making
348. 6:20video testing
349. 6:21Claude Opus 4 .7,
350. 6:234 .8 and GPT
351. 6:25-5 in Blender.
352. 6:26And they were struggling
353. 6:27to place objects with
354. 6:29right rotation, you know,
355. 6:31not to say about
356. 6:31everything else.
357. 6:32So like just placing
358. 6:34ready objects around was
359. 6:36a huge problem for
360. 6:37them,
361. 6:37both for Claude and
362. 6:39GPT.
363. 6:40And now it not
364. 6:40only places them right,
365. 6:42but also creates them
366. 6:43from primitives like crazy.
367. 6:45Some of you guys
368. 6:46always ask about the
369. 6:47mesh and this is
370. 6:49like most
371. 6:49reasonable use of polygons
372. 6:52I ever seen in
373. 6:53my life.
374. 6:53Look, everything is built
375. 6:55from primitives as much
376. 6:57as it can be.
377. 6:57Like the whole scene
378. 6:59is just 140 triangles,
379. 7:01which is extremely low.
380. 7:02It's like 70K faces.
381. 7:05And look, every text
382. 7:06here makes sense.
383. 7:07No gibberish.
384. 7:08But yeah, I mean,
385. 7:09like it's insane.
386. 7:10But let's take it
387. 7:11even further.
388. 7:11On X, I saw
389. 7:12crazy examples, how someone
390. 7:14do complex objects from
391. 7:16blueprints.
392. 7:17And I thought we
393. 7:17also going to need
394. 7:18to test it.
395. 7:19So here's the car
396. 7:20that I going to
397. 7:21ask again, built from
398. 7:22primitives
399. 7:23as close as it
400. 7:24can be.
401. 7:24And by the way,
402. 7:25guys, if you still
403. 7:25not follow me on
404. 7:26X,
405. 7:27this is best time
406. 7:27to change it.
407. 7:28You're going to be
408. 7:29first to know any
409. 7:30updates related to 3D
410. 7:31AI because putting videos
411. 7:33on YouTube takes much
412. 7:34more time.
413. 7:35Here I also recorded
414. 7:36the process, not from
415. 7:37very beginning.
416. 7:38So it already created
417. 7:39these tires.
418. 7:40And again, like those
419. 7:41are primitives.
420. 7:42It was looking so
421. 7:43good.
422. 7:43So the workflow of
423. 7:44GPT is the same.
424. 7:46It starts with blocking
425. 7:47and then upgrade and
426. 7:48upgrade.
427. 7:48And I also asked
428. 7:49to create this assembly
429. 7:51animation, like from pieces
430. 7:52around.
431. 7:53So it puts all
432. 7:54things together.
433. 7:55And guys, you can
434. 7:56see the results.
435. 7:57It's absolutely mind blowing.
436. 7:58And again, it's really
437. 7:59sets the render really
438. 8:01nice.
439. 8:01And this assembly animation
440. 8:03is something insane.
441. 8:04I mean, of course,
442. 8:05when you start looking
443. 8:06into details,
444. 8:07it's not exactly same
445. 8:08card.
446. 8:08There are a lot
447. 8:09of discrepancy that you
448. 8:10can find.
449. 8:11I was not doing
450. 8:12any behind the scene
451. 8:13tweaking on top.
452. 8:14It's all was created
453. 8:15in one prompt.
454. 8:16I actually feel that
455. 8:18GPT 6 works longer
456. 8:20than Fable.
457. 8:21But the interesting thing
458. 8:22that I made so
459. 8:23many tests already today
460. 8:25and it is way
461. 8:26less expensive that Fable.
462. 8:27Like Fable 5 .1,
463. 8:29you can do one
464. 8:29task
465. 8:30and all your limits
466. 8:30disappear on Max Plan.
467. 8:32Here I did more
468. 8:33than 10 tests and
469. 8:34I spent only 7
470. 8:35% of my weekly
471. 8:36limits.
472. 8:37I also use Max
473. 8:38Plan on GPT because
474. 8:39I feel like I'm
475. 8:40going to switch to
476. 8:40GPT for a while.
477. 8:41And I remember I
478. 8:42saw this crazy showcases
479. 8:44on X and I
480. 8:44was thinking,
481. 8:45maybe that's like few
482. 8:46prompts, maybe something prepared.
483. 8:48No, that's indeed how
484. 8:50it does.
485. 8:50And this particular case
486. 8:51was created with Hicksfield
487. 8:53MCP
488. 8:53because it exposes a
489. 8:54lot of 3D AI
490. 8:55APIs.
491. 8:56Like there's plenty of
492. 8:57things like it generates
493. 8:59a lot
494. 8:59and it uses in
495. 9:00a smart way, which
496. 9:01is cool.
497. 9:02Like Hicksfield MCP has
498. 9:03pretty much all the
499. 9:04APIs related to 3D,
500. 9:06to animation and to
501. 9:08image like this all
502. 9:09image models in one
503. 9:10place.
504. 9:11So just so you
505. 9:12know how it's done,
506. 9:12it's definitely not procedural.
507. 9:14It generates some objects
508. 9:15with 3D AI and
509. 9:16place it in scene
510. 9:17nicely.
511. 9:18And speaking of that,
512. 9:19next test will be
513. 9:20related a little bit
514. 9:21to 3D blocking and
515. 9:22making video of it.
516. 9:23And it actually takes
517. 9:25it to another level,
518. 9:26guys.
519. 9:26So I have this
520. 9:27idea like there will
521. 9:28be dynamic race
522. 9:29because I saw lots
523. 9:31of these examples and
524. 9:32like it's too dynamic.
525. 9:34Like usually 3D AI
526. 9:35is not capable to
527. 9:36do that,
528. 9:36because always there is
529. 9:37someone behind the scene
530. 9:38actually adjusting all these
531. 9:40things.
532. 9:40So I actually use
533. 9:41this plugin with GPT
534. 9:43and man,
535. 9:43it actually created the
536. 9:45complete track with a
537. 9:46lot of objects.
538. 9:47I mean, as a
539. 9:48play blast.
540. 9:49So the play blast
541. 9:50is used later for
542. 9:51the video to generate.
543. 9:52And you can see
544. 9:53it on the screen.
545. 9:54And it also set
546. 9:55crazy dynamic camera animation.
547. 9:58In this case, it
548. 9:58was more than one
549. 10:00prompt just to make
550. 10:01sure actually getting there.
551. 10:02But 95 % of
552. 10:03that was made by
553. 10:05AI.
554. 10:05And here what you
555. 10:06see is a play
556. 10:06blast.
557. 10:07And the first thing
558. 10:07you can notice is
559. 10:08like how dynamic this
560. 10:09scene is.
561. 10:10Yeah, I mean, it's
562. 10:10very simple primitives and
563. 10:12stuff, but that's the
564. 10:13whole point.
565. 10:13Now, here's what is
566. 10:14going to happen.
567. 10:14It would take this
568. 10:15play blast and put
569. 10:17in C Dense 2
570. 10:18.5 and Hicksville
571. 10:20and just look at
572. 10:21this result.
573. 10:21It's absolutely crazy.
574. 10:23I mean, AI filmmaking
575. 10:24is real and you
576. 10:26can actually direct it.
577. 10:27I mean, you can
578. 10:28control it like, look,
579. 10:29this was done in
580. 10:31like few hours.
581. 10:32I mean, directing the
582. 10:34scene, play blast, the
583. 10:35environment and then rendering
584. 10:36at once
585. 10:37with C Dense 2
586. 10:37.5. So what I
587. 10:38was talking about, not
588. 10:39only 3D artists are
589. 10:41doomed,
590. 10:42but filmmakers as well.
591. 10:44But honestly, AI video
592. 10:45is on the stage
593. 10:46already for a while,
594. 10:48and it's quite,
595. 10:49but I mean, there's
596. 10:50not much things that
597. 10:52are really enjoyable, right?
598. 10:54Or image generation is
599. 10:55absolutely on the highest
600. 10:56level right now,
601. 10:57but still there's few
602. 10:58good ideas.
603. 11:00So true artists will
604. 11:01remain anyway.
605. 11:02At least I believe
606. 11:03in that.
607. 11:03If you guys disagree,
608. 11:05let's discuss that in
609. 11:06the comments.
610. 11:06Here's one more example
611. 11:08setting the crazy camera
612. 11:10animation.
613. 11:11And the idea was
614. 11:12like really funny.
615. 11:12Like we have a
616. 11:13bee and you know,
617. 11:14like in some movie
618. 11:15openings,
619. 11:15there is something happening
620. 11:17like small insects going
621. 11:19to like two holes,
622. 11:20etc.
623. 11:20And I just want
624. 11:21to test how good
625. 11:22it will handle like
626. 11:23this motions,
627. 11:24like follow up motions,
628. 11:26the dynamics, etc.
629. 11:27And yeah, that was
630. 11:28actually really cool.
631. 11:28And again, combining that
632. 11:29with C Dense 2
633. 11:30.5, like just insane.
634. 11:32And the amount of
635. 11:33cases where you can
636. 11:34use that is absolutely
637. 11:35insane.
638. 11:36I'm going to be
639. 11:36making another video testing
640. 11:38GPT -6 in game
641. 11:39engines,
642. 11:40such as Unity Unreal
643. 11:41Engine.
644. 11:41So subscribe to not
645. 11:42miss that one.
646. 11:43But I also tested
647. 11:44how good it will
648. 11:45handle the logics, etc.
649. 11:46and ask it, for
650. 11:47example, to create me
651. 11:49an add -on for
652. 11:50Blender that will create
653. 11:51LC
654. 11:52Soins. I mean, you
655. 11:53all know this guy
656. 11:54and I want to
657. 11:55create LED Soins
658. 11:57configurator right in Blender
659. 11:58and just look what
660. 12:00it created for me.
661. 12:01I was like expecting
662. 12:02maybe like this much
663. 12:04parameters, right?
664. 12:05But look, it created
665. 12:06me a whole bunch
666. 12:07of stuff like for,
667. 12:08I don't know,
668. 12:08I can do really
669. 12:09anything.
670. 12:10So here's how it
671. 12:11works.
672. 12:11Like there are three
673. 12:12presets right now.
674. 12:13Like you can say,
675. 12:14set this preset.
676. 12:15OK, like this preset.
677. 12:17There's also this preset
678. 12:18and this preset.
679. 12:20There are plenty of
680. 12:21settings that you can
681. 12:22tweak.
682. 12:22You can even upload
683. 12:23your own logo.
684. 12:24Oh, this one, I
685. 12:25don't think work.
686. 12:26OK, let's do this.
687. 12:27You can preview it
688. 12:28as LED.
689. 12:29And I mean, like
690. 12:29I didn't even check
691. 12:31all the parameters.
692. 12:32I mean, that looks
693. 12:33so impressive.
694. 12:34This one actually looked
695. 12:35cool.
696. 12:35And I also spot
697. 12:36in this preset, it
698. 12:37was actually calculating connectors.
699. 12:39Look how it connects
700. 12:41through the glass.
701. 12:42I mean, that's just
702. 12:43insane.
703. 12:44I mean, wow.
704. 12:45Just think about what
705. 12:46crazy things you can
706. 12:47do with it.
707. 12:48While I was working
708. 12:49on Blender test, my
709. 12:50friend actually took it
710. 12:51a little bit
711. 12:52further and created like
712. 12:543G application to create
713. 12:56sprites for games.
714. 12:58It took like one
715. 12:59hour and just look
716. 13:00how crazy it can
717. 13:01be like this.
718. 13:02It's absolutely next level
719. 13:03of understanding 3D.
720. 13:05I mean, this case,
721. 13:06again, shows really well
722. 13:07that it understands how
723. 13:09to set
724. 13:09the logic around it
725. 13:10to get some reasonable
726. 13:11results.
727. 13:12So here the idea
728. 13:13is that you load
729. 13:13a 3D object and
730. 13:14it creates you a
731. 13:15sequence of sprites.
732. 13:17Just like that.
733. 13:18Usually you actually have
734. 13:19to go and pay
735. 13:19for a subscription on
736. 13:21some website to get
737. 13:22access to this feature.
738. 13:23And now whenever you
739. 13:24need it, you just
740. 13:25wipe code it like
741. 13:26in one hour and
742. 13:27tune
743. 13:27it as you need
744. 13:28or how about creating
745. 13:29web application that will
746. 13:31show us
747. 13:32prediction on climate change
748. 13:34around the earth.
749. 13:35And all this data
750. 13:37GPT found from some
751. 13:39open sources, like from
752. 13:41open APIs, etc.
753. 13:43And just look at
754. 13:44this.
755. 13:44I mean, I don't
756. 13:45know.
757. 13:45I've been showing like
758. 13:46tasks like this with
759. 13:47Fable 5 also.
760. 13:49And I don't know.
761. 13:50It doesn't feel like
762. 13:51a small jump, like
763. 13:52small improvement.
764. 13:53It's like significant jump.
765. 13:54Anyway, application in games.
766. 13:56I'm doing crazy tests
767. 13:57right now.
768. 13:58Can I show them
769. 13:58to you very, very
770. 13:59soon?
771. 14:00Don't forget to follow
772. 14:00an X to see
773. 14:01them first and subscribe
774. 14:03to see them
775. 14:03on YouTube very soon.
776. 14:05That was Steph.
777. 14:05Like and subscribe and
778. 14:07see you the next
779. 14:07one.