YouTube2Text

Claude Code Took Over Blender and Created This... — Transcript

by Stefan 3D AI · 3,386 words · 915 segments · language en · Watch on YouTube

Full transcript

  1. 0:00I equipped my Claude
  2. 0:01Cote with blender skill.
  3. 0:03Also I gave him
  4. 0:04access to best APIs
  5. 0:06such as 3d generation,
  6. 0:08image generation, computer vision
  7. 0:10and much more, enabled
  8. 0:12bypass permission mode and
  9. 0:13told him to do
  10. 0:14one task to create
  11. 0:16me this location in
  12. 0:173d.
  13. 0:18I let this guy
  14. 0:19cook as much as
  15. 0:20he can and what
  16. 0:21happened is not what
  17. 0:23you expected guys.
  18. 0:24I gonna reveal to
  19. 0:25you soon but first
  20. 0:26why Claude Cote.
  21. 0:27Claude himself is absolute
  22. 0:29beast in coding and
  23. 0:30blender behind the scene
  24. 0:32is basically python scripts
  25. 0:33and we also got
  26. 0:35an amazing blender mcp
  27. 0:37recently.
  28. 0:37But Claude Cote allow
  29. 0:38you to scale it
  30. 0:39even further and remove
  31. 0:41all of that headache
  32. 0:42with ui setting up
  33. 0:44skills and stuff.
  34. 0:45You can simply run
  35. 0:46Claude with dangerously skip
  36. 0:47permission and let this
  37. 0:49guy cook which we're
  38. 0:50gonna do in this
  39. 0:51video.
  40. 0:51I gonna show you
  41. 0:52some cool really usable
  42. 0:53examples.
  43. 0:54So first how do
  44. 0:55you install it.
  45. 0:56What you see on
  46. 0:56my screen is blender
  47. 0:585.1 open.
  48. 1:00So that's basically the
  49. 1:01latest version that we
  50. 1:02need.
  51. 1:02We need blender and
  52. 1:03official blender mcp.
  53. 1:05Again this is like
  54. 1:06a new official mcp
  55. 1:07which is released just
  56. 1:09recently.
  57. 1:09Do not mess it
  58. 1:10up with the community
  59. 1:12developed mcp.
  60. 1:13All links to full
  61. 1:14tutorial with all skills
  62. 1:16and stuff will be
  63. 1:17in the description guys
  64. 1:18absolutely for free.
  65. 1:19So here we need
  66. 1:20to install the add
  67. 1:22-on and activate it
  68. 1:23in blender.
  69. 1:23That's extremely simple we
  70. 1:25can even just drag
  71. 1:26and drop this guy
  72. 1:27and drop him to
  73. 1:28the blender like this.
  74. 1:29My extension is already
  75. 1:30installed but to verify
  76. 1:32that it installed you're
  77. 1:33gonna go to edit
  78. 1:34preferences.
  79. 1:35Then in add-ons
  80. 1:36you're gonna see this
  81. 1:37mcp.
  82. 1:38So what you need
  83. 1:38to make sure that
  84. 1:39the server is running
  85. 1:41and the auto start
  86. 1:42is set to active.
  87. 1:43So whenever you will
  88. 1:44run the blender the
  89. 1:46mcp will be automatically
  90. 1:47start.
  91. 1:48Very convenient you do
  92. 1:49it once and forget.
  93. 1:50The second part is
  94. 1:51cloud code.
  95. 1:52So I believe guys
  96. 1:53you know how to
  97. 1:53install cloud code.
  98. 1:54I'm gonna skip that
  99. 1:55part but here is
  100. 1:56how you connect it
  101. 1:57to the blender and
  102. 1:58all the skills.
  103. 1:59The cursor now is
  104. 2:00in empty folder and
  105. 2:02I'm gonna go and
  106. 2:03open a terminal.
  107. 2:04So in my terminal
  108. 2:05I'm gonna start it
  109. 2:06with dangerously skip permission
  110. 2:08guys because I don't
  111. 2:09want it to ask
  112. 2:10any stuff.
  113. 2:11I'm gonna give him
  114. 2:12a task and I'm
  115. 2:12gonna just wait until
  116. 2:13it's done.
  117. 2:14Disclaimer I do not
  118. 2:15recommend to do that
  119. 2:16but I will do
  120. 2:17that anyway.
  121. 2:18If you're not sure
  122. 2:19about the risk maybe
  123. 2:20start with cloud and
  124. 2:21approve actions manually.
  125. 2:23You'll get the same
  126. 2:23results but in second
  127. 2:24case you're gonna need
  128. 2:25to approve actions.
  129. 2:27Now I'm gonna need
  130. 2:28to install blender mcp
  131. 2:29server.
  132. 2:30How it's done super
  133. 2:31easy.
  134. 2:32I prepared that md
  135. 2:33file with instruction that
  136. 2:35you can drag and
  137. 2:35drop into the folder
  138. 2:36with the cloud and
  139. 2:38it will be installing
  140. 2:39everything manually.
  141. 2:40Let's do that here
  142. 2:41you can see the
  143. 2:42instruction and this instruction
  144. 2:43also includes full ai
  145. 2:45which is optional but
  146. 2:47if you want it
  147. 2:48to be connected to
  148. 2:49the best apis such
  149. 2:50as image generation 3d
  150. 2:52generation vision model segmentation
  151. 2:54all that stuff on
  152. 2:55full ai but you
  153. 2:56have to replenish credits
  154. 2:58first.
  155. 2:59I'm gonna do that
  156. 2:59for you guys but
  157. 3:00note this is optional.
  158. 3:02Okay so now we're
  159. 3:02gonna just drop this
  160. 3:03file to cloud and
  161. 3:05say install all stuff
  162. 3:07and we just need
  163. 3:08to wait.
  164. 3:09All right it's done
  165. 3:10and here we can
  166. 3:11see the output.
  167. 3:12So it actually suggests
  168. 3:13to install the add
  169. 3:15-on if you didn't
  170. 3:16we just did and
  171. 3:17then we do have
  172. 3:18a full ai key
  173. 3:19again it's optional.
  174. 3:20So you're gonna go
  175. 3:21in .inf that's a
  176. 3:23protected file and you're
  177. 3:24gonna place it here.
  178. 3:25So that's how it
  179. 3:26will be accessed by
  180. 3:27cloud code.
  181. 3:28This is the best
  182. 3:29practice to keep your
  183. 3:30keys only in .inf
  184. 3:32file.
  185. 3:32Now after mcp are
  186. 3:34created you need to
  187. 3:36restart the cloud session
  188. 3:37once to get it
  189. 3:39to see blender.
  190. 3:40Let's do that i'm
  191. 3:41gonna kill previous terminal
  192. 3:42and open it again
  193. 3:43with the continue command
  194. 3:45that will actually get
  195. 3:46me back to my
  196. 3:47previous session.
  197. 3:48All right so we
  198. 3:48are back and we
  199. 3:49restarted.
  200. 3:50Now let's test the
  201. 3:51connection simple command to
  202. 3:52check if it can
  203. 3:53see my scene and
  204. 3:55yes we are connected
  205. 3:56and we can see
  206. 3:56some stuff.
  207. 3:57So that was all
  208. 3:58set up if you
  209. 3:59add full ai key
  210. 4:00and it will also
  211. 4:01have the access to
  212. 4:02full ai apis.
  213. 4:03Now let's do some
  214. 4:04serious tests.
  215. 4:05The first test will
  216. 4:06be to do an
  217. 4:07animation of a character
  218. 4:09that will be split
  219. 4:10in parts.
  220. 4:11The first test will
  221. 4:12be to create animation.
  222. 4:14Animation of a character
  223. 4:15that will be an
  224. 4:17angel.
  225. 4:17So here is my
  226. 4:18character.
  227. 4:18I actually created it
  228. 4:20in triple then split
  229. 4:21into the parts in
  230. 4:22union and then texture
  231. 4:24it again in triple.
  232. 4:25So you'll see the
  233. 4:26whole the process and
  234. 4:27the idea is simple.
  235. 4:32We're simulate how it
  236. 4:34drops on the floor
  237. 4:35so the parts are
  238. 4:37scattered naturally.
  239. 4:38So we need him
  240. 4:39to run simulation.
  241. 4:40The second part of
  242. 4:41the thing is to
  243. 4:42do animation but not
  244. 4:43just simple assembly animation
  245. 4:45but as it like
  246. 4:46a tornado animation.
  247. 4:47So are you ready
  248. 4:48to look at this
  249. 4:49guy cooking?
  250. 4:50I am.
  251. 4:50Also I prepared all
  252. 4:51the prompts.
  253. 4:52They are here.
  254. 4:53The complete prompt on
  255. 4:54the screen you can
  256. 4:55pause to take a
  257. 4:56look but I also
  258. 4:57created it with cloud
  259. 4:58code and reviewed it
  260. 4:59a little bit.
  261. 5:00Okay so let's run
  262. 5:02and guys I already
  263. 5:03created one video about
  264. 5:04it.
  265. 5:04I was showing you
  266. 5:05how to do it
  267. 5:05on the cloud desktop
  268. 5:06and I also showed
  269. 5:08quite a lot of
  270. 5:08cool cases.
  271. 5:09There we were doing
  272. 5:10like keyboard animation but
  273. 5:12it was simple and
  274. 5:13I really wanted to
  275. 5:14try something more.
  276. 5:15Again I read all
  277. 5:16your comments and I
  278. 5:18decided like to give
  279. 5:19it like another try
  280. 5:20and make it more
  281. 5:21complicated.
  282. 5:21See like how far
  283. 5:23I can actually push
  284. 5:23it and all examples
  285. 5:25in this video will
  286. 5:25be way more difficult
  287. 5:27than there.
  288. 5:27But if you use
  289. 5:28cloud desktop also take
  290. 5:29a look on that
  291. 5:30video.
  292. 5:30The first attempt was
  293. 5:31not successful because it
  294. 5:33actually not simulated the
  295. 5:35falling apart but the
  296. 5:37tornado animation was more
  297. 5:39or less.
  298. 5:39So I actually provided
  299. 5:40with the feedback and
  300. 5:42it started to do
  301. 5:43the next round but
  302. 5:44now the animation was
  303. 5:46sort of like fragmented
  304. 5:47also not good.
  305. 5:48So I gave it
  306. 5:49like one more feedback
  307. 5:50to see if it
  308. 5:51actually can fix it
  309. 5:52and here you see
  310. 5:53it actually start cooking
  311. 5:54again.
  312. 5:55It was thinking for
  313. 5:56a long time but
  314. 5:57not spending that much
  315. 5:59tokens.
  316. 6:00So I don't know
  317. 6:00like it was actually
  318. 6:01evaluating quite a lot
  319. 6:03of stuff and then
  320. 6:04actually I got very
  321. 6:05interesting results.
  322. 6:06But I was not
  323. 6:07happy because it was
  324. 6:08like very slow tornado
  325. 6:10assembly and after just
  326. 6:12two more iteration one
  327. 6:14to fix the animation
  328. 6:15consistency and another to
  329. 6:17add one more extra
  330. 6:18spin in the very
  331. 6:19final we have this
  332. 6:21beautiful animation.
  333. 6:22And I think it's
  334. 6:23actually look very nice.
  335. 6:25So there was a
  336. 6:26proper simulation from assembly
  337. 6:28so it like scattered
  338. 6:29parts like it falls
  339. 6:30apart and here you
  340. 6:31can see the results.
  341. 6:32This required total five
  342. 6:33iteration initial prompt and
  343. 6:35four revision and we
  344. 6:37got those results.
  345. 6:38To be honest I
  346. 6:39would not be able
  347. 6:39to do that manually.
  348. 6:41It's not the perfect
  349. 6:42animation still but the
  350. 6:43fact it was done
  351. 6:44so fast is actually
  352. 6:46fascinating.
  353. 6:46Now let me show
  354. 6:47you one more example
  355. 6:49and this is how
  356. 6:50I actually using my
  357. 6:51work.
  358. 6:51This is about geometry
  359. 6:52nodes and by far
  360. 6:54I think this is
  361. 6:55like the most useful
  362. 6:56case so far.
  363. 6:57So geometry nodes is
  364. 6:59anything like that you
  365. 7:00can add to any
  366. 7:01object and stuff and
  367. 7:03I already showed like
  368. 7:04in my previous video
  369. 7:05how we scattered objects
  370. 7:07around the plane.
  371. 7:09So we saved enormous
  372. 7:10amount of time like
  373. 7:11positioning them and that
  374. 7:13was super fun and
  375. 7:14easy and I actually
  376. 7:15did it in one
  377. 7:16prompt.
  378. 7:16Now let's try to
  379. 7:17push it a little
  380. 7:18bit further.
  381. 7:18I do have this
  382. 7:19scene and there is
  383. 7:20a water surface.
  384. 7:22It's not animated it's
  385. 7:23just a plane and
  386. 7:24here is the prompt
  387. 7:25that you will see
  388. 7:26on the screen.
  389. 7:27The idea is to
  390. 7:28animate it so it
  391. 7:30will be animated as
  392. 7:31a bubbles and I
  393. 7:33also want geometry nodes
  394. 7:34where I see parameters
  395. 7:35so I can control
  396. 7:36how big the bubbles
  397. 7:37is like how frequent
  398. 7:39and stuff.
  399. 7:39Let's get to it.
  400. 7:41So this one was
  401. 7:42easier at the beginning
  402. 7:43but when it created
  403. 7:45me the first version
  404. 7:46it was too big
  405. 7:47and too pixelated.
  406. 7:48Here you can see
  407. 7:49the results.
  408. 7:50Okay and yeah I
  409. 7:51mean the bubbles was
  410. 7:52extremely big so it
  411. 7:54was not taking into
  412. 7:55account the world scale
  413. 7:56but it was impressive
  414. 7:57that it actually did
  415. 7:58like almost perfectly like
  416. 7:59in terms of like
  417. 8:00the task except the
  418. 8:01sizes.
  419. 8:02Okay so I actually
  420. 8:03provided the feedback that
  421. 8:04we need more resolution
  422. 8:05and bubbles should be
  423. 8:06like three times smaller
  424. 8:07and then it starts
  425. 8:08to do debugging.
  426. 8:10It was actually very
  427. 8:10fun to watch because
  428. 8:12it was enabling disabling
  429. 8:13the rendered hiding objects
  430. 8:15to see the water
  431. 8:16because it was covered
  432. 8:17by other objects.
  433. 8:18It did not delete
  434. 8:20anything at all.
  435. 8:21Everything's safe, no problems
  436. 8:23so far guys and
  437. 8:24I tested like quite
  438. 8:25a lot in the
  439. 8:26recent days and nothing
  440. 8:28was deleted.
  441. 8:29And here you can
  442. 8:29see that the results
  443. 8:30starting to get better
  444. 8:32and better and better
  445. 8:33and finally with a
  446. 8:35few tips from me
  447. 8:36I was able to
  448. 8:37get quite interesting result.
  449. 8:38Here in the end
  450. 8:39I had to simplify
  451. 8:40shading so you can
  452. 8:42see it better because
  453. 8:42my scene was initially
  454. 8:44set for cycles render
  455. 8:45and yeah here we
  456. 8:46go.
  457. 8:47So the animation run
  458. 8:48and we can control
  459. 8:49the parameters like the
  460. 8:50bubbles strength, the frequency
  461. 8:52and the spread speed
  462. 8:53and in this mode
  463. 8:54you can see it
  464. 8:55more obvious.
  465. 8:56I think that's very
  466. 8:57cool guys right.
  467. 8:58Look I did not
  468. 9:00touch anything, any geometry
  469. 9:02node.
  470. 9:02I don't even know
  471. 9:03like how it created
  472. 9:04that.
  473. 9:04Two prompts and I
  474. 9:05have this amazing result.
  475. 9:06So what about that
  476. 9:07island that our cloth
  477. 9:08cookie.
  478. 9:09So first of all
  479. 9:10how did I come
  480. 9:10up with that test.
  481. 9:12Well actually I tried
  482. 9:13something like this before
  483. 9:14but recently I saw
  484. 9:16some guy build up
  485. 9:17the tool called image
  486. 9:19blast.
  487. 9:19That's basically a skill
  488. 9:20for cloth code again
  489. 9:22that uses world marble
  490. 9:24and full AI with
  491. 9:25Hoonion to create these
  492. 9:27amazing worlds.
  493. 9:28Look and I was
  494. 9:28like oh that's cool
  495. 9:30and I actually tried
  496. 9:31out.
  497. 9:31The setup is actually
  498. 9:32very similar and I
  499. 9:33actually forked it a
  500. 9:34little bit to do
  501. 9:35my test.
  502. 9:36So here's how it
  503. 9:36works.
  504. 9:37So you basically clone
  505. 9:38that image blast.
  506. 9:39The link will be
  507. 9:40somewhere in the description
  508. 9:41and you need to
  509. 9:41provide it with two
  510. 9:42keys.
  511. 9:43Full AI API that
  512. 9:44will be used to
  513. 9:45create 3d objects inside
  514. 9:46the scene and world
  515. 9:48marble to create that
  516. 9:50scene.
  517. 9:50World labs is about
  518. 9:52to create 3d ghosts
  519. 9:53and splats and recently
  520. 9:54they added something cool
  521. 9:55that they can actually
  522. 9:56create a collider, the
  523. 9:57real mesh and that
  524. 9:59is actually what that
  525. 10:00image blast about.
  526. 10:01Anyway here's how it
  527. 10:02works.
  528. 10:03It uses quite a
  529. 10:04lot of credits right.
  530. 10:05So each world generation
  531. 10:07might cost you up
  532. 10:08to five dollar right.
  533. 10:10So you don't need
  534. 10:11to test it out.
  535. 10:12I'm gonna test it
  536. 10:13and here's the result
  537. 10:14and it really works.
  538. 10:15It creates the world
  539. 10:15with world labs and
  540. 10:17also it opens a
  541. 10:18viewer in web and
  542. 10:20here's the thing it
  543. 10:21only works in web
  544. 10:22because there's a spark
  545. 10:23gs that runs this
  546. 10:25splats and to render
  547. 10:27it nicely in blender
  548. 10:28it's a bit more
  549. 10:29difficult.
  550. 10:29So just like to
  551. 10:30cut the whole part.
  552. 10:31Okay and after a
  553. 10:33few minutes it generated
  554. 10:34me the world and
  555. 10:35I was able to
  556. 10:36preview it in blender
  557. 10:38and yeah it looked
  558. 10:39nice but the coolest
  559. 10:40thing is again like
  560. 10:42when you create worlds
  561. 10:43with another objects in
  562. 10:44it and here's one
  563. 10:45more test.
  564. 10:46I created this japan
  565. 10:47style and you can
  566. 10:48see the objects and
  567. 10:49the objects actually sort
  568. 10:50of interact with the
  569. 10:51environment.
  570. 10:52So behind the scene
  571. 10:53there is like a
  572. 10:54lighter but yeah in
  573. 10:55fact this is just
  574. 10:56a goose and splat.
  575. 10:58It can look impressive
  576. 10:59but in fact that's
  577. 11:00just as splats.
  578. 11:01So I decided build
  579. 11:02up my own version.
  580. 11:04I will try to
  581. 11:04do something like that
  582. 11:05in blender and here's
  583. 11:07the result.
  584. 11:07Well it's not what
  585. 11:09I expected really.
  586. 11:11I was experimenting a
  587. 11:12lot guys.
  588. 11:13I was like I
  589. 11:14don't know I spent
  590. 11:14like maybe like two
  591. 11:15days trying to give
  592. 11:17it like all possible
  593. 11:18tools like some 3d
  594. 11:19for segmentation top view
  595. 11:21and stuff but it
  596. 11:22seems like cloud vision
  597. 11:24is terrible.
  598. 11:25It's so nice for
  599. 11:26coding and all these
  600. 11:28operations and stuff like
  601. 11:29writing code but with
  602. 11:31the vision so like
  603. 11:32I was trying to
  604. 11:33say like okay do
  605. 11:34the revision like do
  606. 11:35it again like move
  607. 11:36objects around and stuff.
  608. 11:37It's just I don't
  609. 11:38want.
  610. 11:38I can actually drop
  611. 11:39on the github what
  612. 11:40I coded so far.
  613. 11:42If some of you
  614. 11:42can improve this it
  615. 11:44will be cool to
  616. 11:45see but the bad
  617. 11:45thing is that each
  618. 11:47world generation like this
  619. 11:49cost me quite a
  620. 11:49lot.
  621. 11:50So I was using
  622. 11:51triple and average I
  623. 11:52was paying eight bucks
  624. 11:53to create all the
  625. 11:55objects and place them
  626. 11:56around.
  627. 11:56I also connected patina
  628. 11:58so you can see
  629. 11:58the water material it's
  630. 12:00like a patina model
  631. 12:01but this is the
  632. 12:02best result I could
  633. 12:03get.
  634. 12:03I also tried with
  635. 12:04another location which is
  636. 12:05like ice location similar
  637. 12:07concept and it was
  638. 12:09disappointing like it could
  639. 12:10not even place the
  640. 12:11object sometimes like I
  641. 12:13mean some objects they
  642. 12:14were rotated 90 degree
  643. 12:15I don't know why.
  644. 12:16I think triple generates
  645. 12:17it okay nicely but
  646. 12:19yeah so here's the
  647. 12:20final result.
  648. 12:21It's definitely not what
  649. 12:22I expect and I
  650. 12:23tried quite a lot.
  651. 12:24I gave him like
  652. 12:25so much credits like
  653. 12:26how much tokens I
  654. 12:27burned you better don't
  655. 12:28know and guys after
  656. 12:29I recorded the video
  657. 12:31actually I decided to
  658. 12:32give it a try
  659. 12:33with codecs.
  660. 12:34The good thing the
  661. 12:35same folder with same
  662. 12:36skills work with codec.
  663. 12:38I asked codecs to
  664. 12:39get acknowledged about all
  665. 12:41of this and make
  666. 12:43those skills codecs.
  667. 12:45So basically skills.agents
  668. 12:46files right.
  669. 12:47Not a big thing
  670. 12:48it actually worked well
  671. 12:50so guys if you
  672. 12:51use codecs you can
  673. 12:53pretty much use the
  674. 12:54same setup right.
  675. 12:55You can use my
  676. 12:56same files to install
  677. 12:58the mcp here or
  678. 12:59blah blah blah.
  679. 13:00This pretty much works
  680. 13:01it will just take
  681. 13:02a bit more time
  682. 13:04but codecs will guide
  683. 13:05you through it and
  684. 13:06what about the results.
  685. 13:08To be honest I
  686. 13:10think it's slightly better
  687. 13:12and I liked how
  688. 13:13it actually went through
  689. 13:15the process.
  690. 13:16Why I actually wanted
  691. 13:18to do that is
  692. 13:19that codecs has way
  693. 13:21better vision model and
  694. 13:22it was sort of
  695. 13:23like these modalities are
  696. 13:25inside the core model
  697. 13:26and what I can
  698. 13:27say that the scale
  699. 13:29of the ice it
  700. 13:30was generated with patina
  701. 13:31and the scale is
  702. 13:34it's a bit of
  703. 13:35mess here but it
  704. 13:36added like a mapping
  705. 13:37and it added the
  706. 13:38mapping and did the
  707. 13:39right scale which is
  708. 13:41great and objects positioned
  709. 13:43nicely.
  710. 13:43I actually set the
  711. 13:44logic and you can
  712. 13:45see in even small
  713. 13:46pieces boom boom boom
  714. 13:47they are on the
  715. 13:48ground.
  716. 13:49Codecs actually did it
  717. 13:50slightly better well not
  718. 13:52significant as you can
  719. 13:53see this is still
  720. 13:54not usable just if
  721. 13:56you wondered like how
  722. 13:57codecs will do that
  723. 13:58here you see the
  724. 13:59result and I will
  725. 13:59drop this project on
  726. 14:01the git with all
  727. 14:02the skills that I
  728. 14:03used to create this.
  729. 14:05You can check it
  730. 14:05yourself it's quite expensive
  731. 14:07to experiment almost eight
  732. 14:09dollars this is for
  733. 14:10generate 3d models call
  734. 14:12image generation different passes
  735. 14:14and generate like patina
  736. 14:16pbr materials and stuff
  737. 14:18and if you have
  738. 14:19ideas how to improve
  739. 14:19that you can also
  740. 14:20take a look.
  741. 14:21But we are not
  742. 14:22done testing so here's
  743. 14:23one more complex test
  744. 14:25we're gonna try to
  745. 14:27retarget animation.
  746. 14:28So I created this
  747. 14:29character in triple so
  748. 14:30we're gonna go to
  749. 14:31akarig and rig the
  750. 14:32character there.
  751. 14:34Akarig is free by
  752. 14:34the way and it
  753. 14:36does quite nice rig.
  754. 14:37You can preview the
  755. 14:38animation here and it
  756. 14:39looks not that bad
  757. 14:40actually I really start
  758. 14:41using akarig quite a
  759. 14:42lot but there is
  760. 14:43a downside right the
  761. 14:44akarig animations are mostly
  762. 14:46paid.
  763. 14:47So I was thinking
  764. 14:48like what if I
  765. 14:48write my retargeter and
  766. 14:51I will just take
  767. 14:52mixamo animation and apply
  768. 14:53it for my akarig
  769. 14:55character.
  770. 14:55I mean easy money
  771. 14:56save right.
  772. 14:57So let's bring my
  773. 14:57character to blender and
  774. 14:59I also go to
  775. 15:00mixamo and here I
  776. 15:01found like this animation
  777. 15:02will of course twerk
  778. 15:03dance why not right
  779. 15:05and we're gonna download
  780. 15:06it as fbx and
  781. 15:07here you can see
  782. 15:08the mannequin from mixamo
  783. 15:09and our character.
  784. 15:10So it is actually
  785. 15:11challenging task these skeletons
  786. 15:13are not the same
  787. 15:14you can see there's
  788. 15:15difference in bones as
  789. 15:17character creator skeleton has
  790. 15:19more bones mixamo has
  791. 15:21less bones and also
  792. 15:22there is quite different
  793. 15:23rotation and this by
  794. 15:25far was most challenging
  795. 15:26task.
  796. 15:27The prompt will be
  797. 15:27on the screen and
  798. 15:28also like some backstage
  799. 15:29story is that first
  800. 15:31I did a very
  801. 15:32wrong prompt I said
  802. 15:34like they do have
  803. 15:35the same rest pose.
  804. 15:36The rest pose is
  805. 15:37the original pose but
  806. 15:39I was mistaking because
  807. 15:41character creator exported t
  808. 15:42-pose as animation frame.
  809. 15:44So I spent like
  810. 15:45an hour and eventually
  811. 15:47Claude just said to
  812. 15:48me wait but the
  813. 15:49rest pose is not
  814. 15:50as you said and
  815. 15:51that was so funny
  816. 15:52because I just realized
  817. 15:53oh my days right
  818. 15:54he's right and I
  819. 15:55had to rewrite the
  820. 15:56prompt and start it
  821. 15:57over.
  822. 15:58So here is the
  823. 15:58second attempt and it
  824. 16:01did quite a lot
  825. 16:02it was double checking
  826. 16:03himself he was doing
  827. 16:04like some poses retarget
  828. 16:06and stuff there was
  829. 16:07problems with the arms
  830. 16:09and stuff and it
  831. 16:11was trying to fix
  832. 16:12himself.
  833. 16:12I provided the feedback
  834. 16:14sometimes mainly there was
  835. 16:16the issue with the
  836. 16:17hands and actually one
  837. 16:19time blender just crashed
  838. 16:20but I don't know
  839. 16:21how but whenever I
  840. 16:22opened the blender it
  841. 16:23was restoring it the
  842. 16:24same moment I just
  843. 16:26told Claude that whatever
  844. 16:27you do is crashing
  845. 16:28blender here as you
  846. 16:29can see the prompt
  847. 16:30and it stopped doing
  848. 16:32it then he realized
  849. 16:33that he broke the
  850. 16:34model and reverted it
  851. 16:35to some working condition.
  852. 16:37Okay so here's the
  853. 16:37final result so overall
  854. 16:39it actually managed to
  855. 16:41do 90% of
  856. 16:42it right so except
  857. 16:44the arms something with
  858. 16:46the shoulder there's a
  859. 16:47difference in the bone
  860. 16:48as I said like
  861. 16:49and the wrist right
  862. 16:51the wrists are completely
  863. 16:53something like the fingers
  864. 16:54are mirrored or something
  865. 16:56but all the rest
  866. 16:57like such as leg
  867. 16:58and body and head
  868. 16:59actually retargeted very nice
  869. 17:02right here you can
  870. 17:03see the skeletons they
  871. 17:04are quite different right
  872. 17:05so even like in
  873. 17:06arms I tried to
  874. 17:07fix it a lot
  875. 17:08it wasn't able to
  876. 17:09do it maybe we
  877. 17:11need Claude's 4.95
  878. 17:14or mid test model
  879. 17:15he will definitely manage
  880. 17:17to do that but
  881. 17:18my idea was like
  882. 17:19if I made it
  883. 17:20work then the next
  884. 17:21thing I tell Claude
  885. 17:22is to create me
  886. 17:23an add-on so
  887. 17:23I can select two
  888. 17:24skeletons and retarget the
  889. 17:26animation because I already
  890. 17:27see like that it
  891. 17:28works but speaking of
  892. 17:30add-ons that can
  893. 17:30be actually very useful
  894. 17:32and I saw some
  895. 17:33guy on LinkedIn showing
  896. 17:34how he created an
  897. 17:35add-on for blender
  898. 17:36that actually tracks his
  899. 17:38head and create that
  900. 17:40parallax effect he also
  901. 17:41using the same setup
  902. 17:42here you can see
  903. 17:43what he created quite
  904. 17:45fun and drop the
  905. 17:46comment guys what you
  906. 17:47created or how you
  907. 17:48tested it I'm super
  908. 17:49excited about this now
  909. 17:50I doing a lot
  910. 17:51of tests it will
  911. 17:52be cool to learn
  912. 17:53more that was stuff
  913. 17:54like and subscribe and
  914. 17:55I see you in
  915. 17:56the next video

About this transcript

This page contains the full transcript of Claude Code Took Over Blender and Created This... by Stefan 3D AI, generated from the public captions YouTube serves with the video. The transcript has 3,386 words across 915 segments, with the original timestamps preserved so you can click any line to jump to that moment in the embedded player.

What you can do with it

Use the transcript to take notes, quote the speaker, build a study guide, generate a summary with ChatGPT or Claude via the YouTube Summary tool, or export it as a timed subtitle file with YouTube to SRT. You can also re-open it in the transcriber to translate the transcript into 100+ languages.

Free YouTube transcript tool

YouTube2Text is a free YouTube transcript generator — no signup, no daily limit. Paste any YouTube link and get the full transcript instantly, with timestamps, click-to-jump, translation to 100+ languages, AI prompts for ChatGPT, Claude, and Gemini, and exports to TXT, SRT, VTT, or Markdown.