YouTube2Text

Design Engineering Night 10: Don’t ask AI to design for you with Alex Barashkov — Transcript

by Granola · 2,872 words · 483 segments · language en · Watch on YouTube

Full transcript

  1. 0:01So, hello everyone. I'm Alex
  2. 0:04and I run branding design agency called
  3. 0:07Pixel Point.
  4. 0:08We use AI a lot in our design processes.
  5. 0:13And I think we know quite well its
  6. 0:14strengths and weaknesses. And in my view
  7. 0:17right now
  8. 0:19is that AI is much better in building
  9. 0:22environments for you where you can
  10. 0:24design better and faster, rather than
  11. 0:27entirely designing for you. For that
  12. 0:29reason I
  13. 0:31called my today's talk, "Don't ask AI to
  14. 0:34design for you."
  15. 0:37Oh, give me a second.
  16. 0:38Ask it to build you a tool.
  17. 0:41So, for over a year
  18. 0:42we've been uh building lots of different
  19. 0:45custom design applications for the
  20. 0:47projects we've been working on.
  21. 0:49>> [snorts]
  22. 0:51>> And we built apps for brand, web,
  23. 0:54product, 3D, and motion design.
  24. 0:57Here are a few examples of what we have
  25. 1:00created with the help of apps that we
  26. 1:03built with AI.
  27. 1:05For example, uh
  28. 1:08we created an app that helped us to
  29. 1:10design a brand signature visual.
  30. 1:14Another app helped us to explore faster
  31. 1:17brand's visual direction.
  32. 1:19For Recraft, uh we created multiple
  33. 1:23applications that helped us to explore
  34. 1:26and experiment faster with WebGL and
  35. 1:28shaders and animations right on the
  36. 1:31landing page uh for their new model
  37. 1:34release.
  38. 1:35For neon.com,
  39. 1:37uh we built plenty of different
  40. 1:39applications. We built one to scale up
  41. 1:42the production of marketing assets.
  42. 1:44Another one we built to create the
  43. 1:46graphic uh for the video on the home
  44. 1:48page. And we did some applications for
  45. 1:52managing and maintaining uh design
  46. 1:54system and editing the there. and uh
  47. 1:57another one basically for
  48. 2:00just visually checking it's a micro tool
  49. 2:04different UI component states right in
  50. 2:06the product.
  51. 2:08So, today I want to explain why you
  52. 2:11might want to build your own custom
  53. 2:13design applications. Uh, show you in
  54. 2:16detail what can you do with them and of
  55. 2:19course how can you get started with
  56. 2:21that.
  57. 2:23I think there are three main reasons why
  58. 2:25you want to build uh, your custom design
  59. 2:29software. The first one is create what
  60. 2:31existing software is not built for.
  61. 2:34Uh, the second reason is explore ideas
  62. 2:37more efficiently and the third one is
  63. 2:39make your design repeatable and
  64. 2:41accessible.
  65. 2:43I think it's much easier to explain on
  66. 2:45real examples.
  67. 2:46So, here we go.
  68. 2:48During our work on new brand identity
  69. 2:51project for Polar Signals, we had a an
  70. 2:53idea uh, of using flame graphs as a main
  71. 2:58brand signature visual.
  72. 3:00And of course during the design process
  73. 3:02you typically start from gathering some
  74. 3:04references and inspiration and just
  75. 3:08having a rough idea in your head.
  76. 3:10But then you have to design it somehow
  77. 3:13and uh,
  78. 3:15obviously for us
  79. 3:17manual drawing like bunch of rectangles
  80. 3:20and experimenting with different
  81. 3:22gradients, color mixing and the shape of
  82. 3:24the chart in Figma
  83. 3:27will not be very efficient if we do it
  84. 3:29there.
  85. 3:30So, instead we decided to build an
  86. 3:33application that would allow us to do
  87. 3:34that.
  88. 3:36So, we build an app and there how it
  89. 3:39looks.
  90. 3:40Uh, it's a final state of it and as you
  91. 3:42can see here there are a bunch of
  92. 3:44different controls and parameters that
  93. 3:46you can play with. You can change the
  94. 3:48size of bars, you can change color, you
  95. 3:51can change the way how gradient works.
  96. 3:53Uh you can change of course the shape of
  97. 3:55that pattern and even try multiple
  98. 3:58versions of layout. So, uh the big
  99. 4:02advantage of such approach is that
  100. 4:04instead of blindly prompting AI and
  101. 4:07hoping for the best that it will
  102. 4:09eventually decide something that you
  103. 4:11imagine, uh you can actually create an
  104. 4:14environment which will help you to make
  105. 4:16decisions on your own
  106. 4:18and make it faster.
  107. 4:21Uh yeah, and create some beautiful
  108. 4:23things there.
  109. 4:24So, and you're not just stopping there
  110. 4:27because it's an app, by tweaking
  111. 4:29multiple parameters once you finished
  112. 4:31with it, uh you can basically generate
  113. 4:34dozens of different variation of that
  114. 4:36patterns and start scaling it up and
  115. 4:39using it in variety of different like
  116. 4:42marketing materials or web app.
  117. 4:45Another example is
  118. 4:48again from our branding world. Uh
  119. 4:51one of our clients wanted to have their
  120. 4:53new brand identity be inspired by a
  121. 4:56light, uh by a visual of a light that is
  122. 4:59coming through the glass and creating
  123. 5:01all sorts of fractions, aberrations, and
  124. 5:03halation effects. And also they liked a
  125. 5:06lot the graphic on the Stripe web page
  126. 5:09and wanted to have something similar.
  127. 5:11So, we again started from gathering some
  128. 5:12references and inspirations and again it
  129. 5:16was quite obvious that designing it in
  130. 5:18Figma will be insanely inefficient
  131. 5:21because we wanted to have it animated,
  132. 5:24maybe even interactive. We wanted to
  133. 5:25have it in code and basically Figma
  134. 5:28doesn't allow it to do that.
  135. 5:30So, we created another application
  136. 5:33that made it happen. So, that one has
  137. 5:36probably 30 to 40 different controls and
  138. 5:39parameters that you can experiment with
  139. 5:42and you can adjust pretty much
  140. 5:44everything. Uh the size of that thing,
  141. 5:47tilt, rotation, you can play with some
  142. 5:50configuration for animation and timings.
  143. 5:54Uh, you can of course apply some visual
  144. 5:56effects to it like grain, halation, blur
  145. 5:59effects. And once you find the
  146. 6:01combination that works, you can again
  147. 6:04scale it up and uh
  148. 6:07do like multiple of those versions and
  149. 6:10bring it to the home page, bring it to
  150. 6:12some marketing materials.
  151. 6:14Uh, and yeah, and really easy to scale.
  152. 6:17So, uh another example uh can illustrate
  153. 6:21how can you build your own design
  154. 6:23applications, but for different purpose,
  155. 6:25for scaling up uh
  156. 6:27production of
  157. 6:29uh
  158. 6:30brand assets. So, for many years we've
  159. 6:33been designing different covers and
  160. 6:36marketing materials for our clients.
  161. 6:39And typically those materials have some
  162. 6:43unique combination of uh colors,
  163. 6:45typography, techniques, layout
  164. 6:48compositions, and some image stylization
  165. 6:51effects.
  166. 6:52And
  167. 6:53uh it was quite painful to manage it in
  168. 6:55Figma. Uh, every asset was created there
  169. 6:59by designers manually. Uh, and often
  170. 7:02like not often, but sometimes we were
  171. 7:04actually exporting this to Canva even
  172. 7:07because uh
  173. 7:08like to make it easier for the clients
  174. 7:11to maintain some at least assets on
  175. 7:13their own. But right now, you can create
  176. 7:16applications with AI and help your team
  177. 7:19to manage your marketing assets in much
  178. 7:22easier way. Uh, there are few examples
  179. 7:25from Neon Database and Anki project. And
  180. 7:28you can see here that you can select
  181. 7:30multiple templates. You can of course
  182. 7:32type your title, description, or
  183. 7:34whatever else. And in Neon you even have
  184. 7:37a dedicated application that allow you
  185. 7:39to much faster to apply certain certain
  186. 7:42image processing pipeline to get that
  187. 7:45look and brand feel that they have.
  188. 7:48So, uh
  189. 7:50what else?
  190. 7:51Another example, if you're more into
  191. 7:53product, uh that probably will be for
  192. 7:55you. Uh
  193. 7:57for Neon, we created a app that helps us
  194. 7:59manage their new design system directly
  195. 8:02in code. So, there is no middleman,
  196. 8:04there is no Figma. You can uh visualize
  197. 8:07all of the components that you have
  198. 8:09inside your product in the environment
  199. 8:11that you want and fully control. And the
  200. 8:15main advantage here is that it runs
  201. 8:17exactly in the same code base. It runs
  202. 8:19on the exactly same stack as your
  203. 8:21production build. So, uh
  204. 8:24and by spicing up a little bit with
  205. 8:26additional utilities, you can get an
  206. 8:29easy management of your color tokens, uh
  207. 8:31typography styles, and themes. For
  208. 8:33example, in that specific application,
  209. 8:35we have a color tokens page where you
  210. 8:38can basically edit or add
  211. 8:40any new color token. And once you press
  212. 8:42save, it immediately saves that value
  213. 8:45into a configuration file that the front
  214. 8:48end it uses. So, like no middleman, no
  215. 8:52additional requests to AI to apply that
  216. 8:54style to something, or no even any
  217. 8:56additional synchronization engine
  218. 8:58between, let's say, Figma and your code.
  219. 9:01Uh so, uh
  220. 9:03that one app, uh I think it's my
  221. 9:05favorite way right now to
  222. 9:07mm visually test UI components uh in the
  223. 9:10product. It's another app that we built.
  224. 9:13It's a micro app, actually, that we
  225. 9:14built again for Neon.
  226. 9:16And it's basically just a sidebar that
  227. 9:19displays for you in the product all sets
  228. 9:21of components that you have within your
  229. 9:23product page and with different
  230. 9:25variations of uh like properties that
  231. 9:28can be there. So, and just by hovering
  232. 9:31on it, browsing through all of them, you
  233. 9:33can really easily identify
  234. 9:36what works and what doesn't, and improve
  235. 9:38if there is a need for that.
  236. 9:41So,
  237. 9:42I think it's time to talk about how can
  238. 9:44you build your own design applications.
  239. 9:48Of course, uh the most simplest way is
  240. 9:49that you can go and ask AI to do that.
  241. 9:53And your prompt would look something
  242. 9:55like that. Build me an app to apply an
  243. 9:58ASCII effect to an uploaded image. And
  244. 10:01after 20 or 30 minutes of work, AI agent
  245. 10:05will probably return with something like
  246. 10:07that.
  247. 10:08And [snorts]
  248. 10:09it doesn't look nice, really.
  249. 10:12And it doesn't work good, either.
  250. 10:15>> [snorts]
  251. 10:15>> So, I think after seeing something like
  252. 10:17that, there are two ways. You either
  253. 10:19will uh keep iterating until you get to
  254. 10:21a decent shape, or you will never ask AI
  255. 10:25again to do something.
  256. 10:26Uh
  257. 10:27so, uh and it's not just an issue in UI
  258. 10:30that it looks terrible, of course, but
  259. 10:32you will get I like many other issues as
  260. 10:35well. Let's say exporting functionality
  261. 10:37won't work correctly. Uh controls can
  262. 10:40lack. The performance of the app itself
  263. 10:42can be really not good. And uh the image
  264. 10:45that it will be drawing or with the
  265. 10:46style effect that you want will be
  266. 10:48slightly blurry because AI just didn't
  267. 10:50consider that you like working from
  268. 10:52reading on display.
  269. 10:53And uh
  270. 10:55the main thing here is that before you
  271. 10:57even started building or like designing
  272. 10:59something inside that app,
  273. 11:02you have to spend a lot of time actually
  274. 11:05polishing and making your work split
  275. 11:08workspace behave correctly.
  276. 11:11Uh which leads us to our next point that
  277. 11:13most of design application consists of
  278. 11:15two main pieces, uh the workspace and
  279. 11:18design output. By workspace, I mean
  280. 11:22canvas, controls, toolbars, timeline,
  281. 11:25keyframes, layers. And by design output,
  282. 11:29I mean uh uh the place where you create
  283. 11:32something on your own by utilizing those
  284. 11:35things from the workspace that you have
  285. 11:37created.
  286. 11:38And if you take a look on the Figma
  287. 11:40examples,
  288. 11:41the workspace in Figma is basically your
  289. 11:44like layers panel, properties panel,
  290. 11:46toolbar,
  291. 11:48and the design output is that canvas on
  292. 11:51which you're trying to draw something.
  293. 11:55So,
  294. 11:56if you just will follow that approach
  295. 11:59simply trying to prompt AI to build you
  296. 12:02an app, uh you probably will end up with
  297. 12:05something like this.
  298. 12:06Uh you will spend 50% of your time
  299. 12:08managing and maintaining your workspace
  300. 12:10and the remaining 50% of your time
  301. 12:12you'll be actually working on the design
  302. 12:14itself, which it doesn't look good. And
  303. 12:17so, can we improve that?
  304. 12:20And can spend less time on the
  305. 12:21workspace?
  306. 12:22The answer is yes, and there are
  307. 12:24multiple options for that. You can start
  308. 12:26with a Figma sketches
  309. 12:28uh or more detailed prompts. It will
  310. 12:30definitely improve the quality of an
  311. 12:32output, but you will anyway have to
  312. 12:34spend some time preparing those sketches
  313. 12:37and creating that perfect prompt,
  314. 12:40uh but I doubt that it will anyway
  315. 12:42one-shot anything for you.
  316. 12:44Uh so, another approach is use UI
  317. 12:46libraries like Tweek Pane or Dial Kit.
  318. 12:50Uh those are both really great options.
  319. 12:52Uh those UI libraries that bring you a
  320. 12:54set of really well-made and well-looking
  321. 12:57uh controls.
  322. 12:59And I think the best use of them if you
  323. 13:02have already existing web app and you
  324. 13:04want to experiment on some animations or
  325. 13:07graphics that already lives within that
  326. 13:09application,
  327. 13:10you can
  328. 13:12add any of those tools and create a
  329. 13:14small widget with controls that will
  330. 13:16allow you to quickly experiment with
  331. 13:18some sliders on it. Uh however, those
  332. 13:20are just UI libraries, and as we already
  333. 13:23talked about, the workspace is much more
  334. 13:25than just controls.
  335. 13:26So, uh
  336. 13:28alternative way is to use Toolcraft.
  337. 13:32Uh Toolcraft is uh open source, 100%
  338. 13:35free, uh
  339. 13:37MIT license starter kit, UI library, and
  340. 13:41AI harness for building your own custom
  341. 13:44design applications.
  342. 13:46Uh we built Toolcraft uh for ourselves
  343. 13:49at Pixelpoint
  344. 13:50because
  345. 13:52uh after realizing that
  346. 13:54we spend a lot of time over and over
  347. 13:55again on fixing the same issues that AI
  348. 13:58is coming back to us with.
  349. 14:00Uh
  350. 14:01so,
  351. 14:02Toolcraft is starter kit.
  352. 14:04And uh by that I mean that once you
  353. 14:07create a new application starting with
  354. 14:09Toolcraft, it brings the whole code
  355. 14:11source inside your folder, and
  356. 14:13uh in that folder you get the full
  357. 14:15architecture, different modules for
  358. 14:18canvas behavior, uh timeline components,
  359. 14:20keyframes, layers, whatever else, and
  360. 14:24it's based on React, 10 Stack Router,
  361. 14:25TypeScript, Tailwind CSS, and Base UI.
  362. 14:30Uh but it's not just starter kit, it's
  363. 14:31actually also UI library, and we have a
  364. 14:33massive set of different controls that
  365. 14:35you could imagine and probably would
  366. 14:38need in your design workflows. We have
  367. 14:40sliders, we have curves, we have
  368. 14:43uh radio buttons, drop-downs, of course,
  369. 14:45we have some phone pickers, image
  370. 14:47uploading functionality, and much, much
  371. 14:50more. So, but it's also AI harness. By
  372. 14:53that I mean that once you create an
  373. 14:54application with Toolcraft, it also
  374. 14:56brings to you set of skills and rules
  375. 14:58specifically designed to AI to make the
  376. 15:00experience of working on your design
  377. 15:02applications much smoother.
  378. 15:05Uh so, we bring to you um
  379. 15:08skills for planning, debugging, testing,
  380. 15:11uh
  381. 15:12performance optimizations, and uh UI
  382. 15:14checks.
  383. 15:15So, and with all of that in place, uh we
  384. 15:18finally can
  385. 15:20uh instead of spending 50% of the time
  386. 15:22on maintaining the workspace, we can
  387. 15:24start actually spending most of our time
  388. 15:28for working on the design itself, which
  389. 15:31is, I think, really great result.
  390. 15:33And, uh,
  391. 15:34to show you how you can get started with
  392. 15:36Toolcraft, you can simply type that NPX
  393. 15:39pixel point Toolcraft create command in
  394. 15:41your terminal. And after following few
  395. 15:43very simple questions,
  396. 15:45uh, you will get the full starter kit
  397. 15:47inside your folder that you were writing
  398. 15:50it from.
  399. 15:51And then you can bring that folder to
  400. 15:52your agent. It works with any agent,
  401. 15:55cursor, cloud, codex, whatever else.
  402. 15:57And, uh, then from that point, uh, you
  403. 16:01no longer need
  404. 16:03to focus on, uh, actually explaining to
  405. 16:07AI how your workspace should work, what
  406. 16:10the buttons should be there, and how
  407. 16:12they should look, or sketching anything
  408. 16:14in Figma.
  409. 16:15You can actually start with a very
  410. 16:16simple prompt like that, as you can see
  411. 16:19here. I want to build an app that
  412. 16:21generates a 3D globe for landing page,
  413. 16:22use a black background, and 90 20 pixel
  414. 16:25white canvas. Like, really like simple
  415. 16:27prompt as a starting point. And, uh,
  416. 16:29this example from what we have built,
  417. 16:32uh, for Neon homepage, for testimonial
  418. 16:34section. It's an animated globe with
  419. 16:37some logos on it. And within
  420. 16:40approximately 30 to maybe 40 different
  421. 16:43prompts, yeah, I have it somewhere in
  422. 16:45the Twitter,
  423. 16:46uh,
  424. 16:47we got to the really good looking
  425. 16:49result.
  426. 16:50And, uh,
  427. 16:51that's another example again from Neon.
  428. 16:54So, again, the main point, you don't no
  429. 16:57longer start from explaining or creating
  430. 16:59a really massive prompt to get a really
  431. 17:01decent environment you can work in. You
  432. 17:03start with a really simple one, just
  433. 17:04explaining the basic and focusing on
  434. 17:06what you actually want to design with
  435. 17:07that app that you're going to create.
  436. 17:09So,
  437. 17:11and then again, like after 65 prompts in
  438. 17:13that case,
  439. 17:14uh, we got to the point that we got this
  440. 17:17really wonderful graphic and our style
  441. 17:19for that iceberg and animation of it.
  442. 17:22And it's there are so many different
  443. 17:24parameters that you can tweak in order
  444. 17:26to get it to the look and feel you like.
  445. 17:29So,
  446. 17:30typically we spend between 2 hours to 2
  447. 17:33days on every app that we build.
  448. 17:37And the important thing here is that
  449. 17:40maybe not obvious that
  450. 17:43you don't spend that 2 days entirely on
  451. 17:45actually prompting constantly your AI
  452. 17:48agent to do such applications. The main
  453. 17:51point here is that you time to time
  454. 17:53returning to agent prompting some ideas
  455. 17:55that you have in mind. And then after
  456. 17:57let's say 2 days, you have a perfect
  457. 17:59environment in which you actually can
  458. 18:01create things really quickly. And
  459. 18:03another thing is that while AI agent is
  460. 18:05working on the apps or sometimes even
  461. 18:08multiple ones,
  462. 18:09you can work on parallel, let's say in
  463. 18:12Figma, to actually draw something by
  464. 18:14yourself.
  465. 18:16I think it's also important to mention
  466. 18:18that you should not of course build your
  467. 18:20own applications, design application for
  468. 18:22every little design task. If something
  469. 18:25takes 10 minutes in Figma, just do it in
  470. 18:27Figma.
  471. 18:29But of course like right now
  472. 18:31if you approach any task that requires
  473. 18:34slightly different like approach or have
  474. 18:37a different set of requirements and
  475. 18:38there's no existing software that can
  476. 18:39solve your need, you can now build your
  477. 18:42own tool with the help of AI by
  478. 18:45following some of those tips from that
  479. 18:47presentation.
  480. 18:49So, don't ask AI to design for you.
  481. 18:52Ask it to build you a tool.
  482. 18:55Thank you. That's it.
  483. 18:57>> [applause]

About this transcript

This page contains the full transcript of Design Engineering Night 10: Don’t ask AI to design for you with Alex Barashkov by Granola, generated from the public captions YouTube serves with the video. The transcript has 2,872 words across 483 segments, with the original timestamps preserved so you can click any line to jump to that moment in the embedded player.

What you can do with it

Use the transcript to take notes, quote the speaker, build a study guide, generate a summary with ChatGPT or Claude via the YouTube Summary tool, or export it as a timed subtitle file with YouTube to SRT. You can also re-open it in the transcriber to choose a caption track available on the video.

Free YouTube transcript tool

YouTube2Text is a free YouTube transcript generator — no signup, no daily limit. Paste any YouTube link and get the full transcript instantly, with timestamps, click-to-jump, caption language selection, AI prompts for ChatGPT, Claude, and Gemini, and exports to TXT, SRT, VTT, or Markdown.