YouTube2Text

FORGET Loop Engineering. Agentic Engineering is about THIS — Transcript

by IndyDevDan · 6,447 words · 948 segments · language en · Watch on YouTube

Full transcript

  1. 0:00It's time for us to talk about loop
  2. 0:02engineering. I was hoping this would
  3. 0:03just blow over after a couple weeks. I
  4. 0:05was hoping a cracked engineer would call
  5. 0:07this stupid phrase what it really is,
  6. 0:09but no one has. So, I'll do it myself.
  7. 0:13Forget about loop engineering. It's the
  8. 0:15wrong way to think about building
  9. 0:17valuable software with agents at scale
  10. 0:20consistently. Loop engineering is a
  11. 0:22terrible rebrand of the software
  12. 0:25development life cycle. It's as unclear
  13. 0:28as it is hype-filled. In this video, we
  14. 0:31simplify loop engineering and call it
  15. 0:33what it really is. If you understand
  16. 0:35this concept properly, we're going to
  17. 0:37break down in this video, [music]
  18. 0:39you'll accelerate far ahead of the AI
  19. 0:42industry. Clarity and simplicity of
  20. 0:45information gives you [music] speed and
  21. 0:48performance in your work. It's much more
  22. 0:50valuable and helpful to think about
  23. 0:53building with [music] agents as if
  24. 0:55you're building developer workflows
  25. 0:57inside your software factory. Your props
  26. 1:00[music] go into your software factory. A
  27. 1:03specific workflow runs. Each workflow
  28. 1:05[music] is a combination of code plus
  29. 1:08agents and then your results [music]
  30. 1:10come out. Forget about loop engineering.
  31. 1:13Focus your valuable engineering time and
  32. 1:16tokens on building AI developer
  33. 1:19workflows.
  34. 1:25So, first off, who am I to go up against
  35. 1:28big ideas from AI engineers like Boris
  36. 1:31Churnney from Anthropic and Peter
  37. 1:33Steinberg, now from OpenAI? If you
  38. 1:35already know who I am and the work I've
  39. 1:37done, or you don't care, skip to this
  40. 1:39timestamp. My name is Dan Eisler aka
  41. 1:41Indie Dev Dan. I'm a software engineer
  42. 1:43with over 15 years of EXP. I started out
  43. 1:46building Adobe Flash games with Action
  44. 1:48Script 2 and three with my brothers. I
  45. 1:50interned at Blizzard and then I quickly
  46. 1:52moved into the finance and accounting
  47. 1:54space programming in C, TypeScript,
  48. 1:57Python, God awful React and God bless
  49. 2:00Evanu for creating Vue. I was AI coding
  50. 2:03before anyone had a name for it with
  51. 2:05tools like Ader and classic models like
  52. 2:08GPT3.5 Turbo, GPT4, and Sonnet 3. Tools
  53. 2:12and models you've probably never heard
  54. 2:14of or used. I own the domain name
  55. 2:17agenticengineer.com
  56. 2:18where thousands of engineers you've
  57. 2:20heard of from companies you know have
  58. 2:22improved their agentic engineering
  59. 2:24thanks to information products I've
  60. 2:26built by hand. But anyone can pick up a
  61. 2:29domain name and create a course though,
  62. 2:31right? Sure. I also have an irrefutable
  63. 2:33trail of code and content for engineers
  64. 2:37on GitHub and this YouTube channel every
  65. 2:40single week for years now. You can see
  66. 2:42myself and engineers that follow this
  67. 2:44channel consistently ahead of the curve
  68. 2:47of the AI industry. I don't just farm
  69. 2:49news for views like every other tech
  70. 2:52content creator. On this channel, we
  71. 2:54think, plan, and build. Every few
  72. 2:56months, it's important for me to sit
  73. 2:58down and say this. I'm not a content
  74. 3:01creator. I'm a software engineer that
  75. 3:03does content creation on the side. Why?
  76. 3:06Because this technology is too valuable
  77. 3:09to fall into the hands of a lucky few.
  78. 3:11And yes, I sell courses. And yes, I
  79. 3:14benefit from it. Big whoop. Don't do
  80. 3:16anything you're great at for free.
  81. 3:17Welcome to capitalism. Enough about me.
  82. 3:19I don't show up here every single Monday
  83. 3:21to gloat and talk about myself. I show
  84. 3:23up here to give engineers like you an
  85. 3:25advantage you can use to accelerate your
  86. 3:28career, your work, your business, your
  87. 3:30engineering in the age of AI, no hype.
  88. 3:33So, forget about loop engineering and
  89. 3:36focus on this instead. There are now
  90. 3:39three actors of value creation for
  91. 3:42engineering work. The engineers like you
  92. 3:44and I, there are the agents and there's
  93. 3:46the code. Knowing when and where to
  94. 3:49place each of these is the name of the
  95. 3:52game of agentic engineering. And you
  96. 3:54might be thinking, where is he going
  97. 3:55with this? How does this relate to loop
  98. 3:57engineering and developer workflows?
  99. 3:59Stick with me here. We're going to work
  100. 4:00up to it. If you master the
  101. 4:01fundamentals, you'll master the
  102. 4:03compositions. Everyone in their AI
  103. 4:05psychosis seems to forget code is fast,
  104. 4:09always runs the same way unless you tell
  105. 4:11it not to. And guess what? It costs
  106. 4:13nothing. There are no token costs
  107. 4:15associated with code. the thing that
  108. 4:17truly moves at light speed. There's a
  109. 4:19hidden cost to implementing every single
  110. 4:21one of these actors of value creation.
  111. 4:25Everyone's talking about agents. We're
  112. 4:27all well aware of the cost of engineers,
  113. 4:29but code is the unsung hero of all of
  114. 4:32this. Consistent value creation creates
  115. 4:34consistent business value. And out of
  116. 4:36these three, code is the most reliable
  117. 4:39by miles followed by engineers [music]
  118. 4:42and then agents. So let's start with the
  119. 4:44most basic developer workflow.
  120. 4:50An engineer prompts an LLM and the
  121. 4:53engineer reviews the result. This is the
  122. 4:55simple foundation that makes up every
  123. 4:58single loop, every single workflow,
  124. 5:01every single piece of work moving
  125. 5:03forward. Now, of course, we're not just
  126. 5:05using the LLM anymore. In this central
  127. 5:07node, we have an agent. Insert your
  128. 5:10favorite agent. Insert your favorite
  129. 5:11model. It doesn't matter anymore. It's
  130. 5:14about the workflow that you and I
  131. 5:16execute every single day. Great. Let's
  132. 5:19scale it up. Now, we have code, agents,
  133. 5:22and engineers all involved in the
  134. 5:24process. We're building up to more and
  135. 5:27more advanced developer workflows.
  136. 5:29You'll notice something really important
  137. 5:31here. We now have code. In this case,
  138. 5:33we're just running a llinter. We have a
  139. 5:35condition. If the llinter fails, the
  140. 5:37results go back into our build agent. If
  141. 5:40they're successful, it passes. This
  142. 5:42condition and this routing back to our
  143. 5:45build agent creates our first loop.
  144. 5:47Hence the term loop engineering. But
  145. 5:50loop engineering is too simple. It's too
  146. 5:52inaccurate. And there's a lot more to
  147. 5:54this story. So what comes next? How can
  148. 5:56we continue to enhance our developer
  149. 5:58workflow to get better results? We can
  150. 6:00of course add more deterministic code.
  151. 6:03Now we have multiple pass fill
  152. 6:04statements routing back into our build
  153. 6:06agent. Your codeex, your cloud code,
  154. 6:08your pi coding agent, whatever your
  155. 6:10agent harness is. This is the foundation
  156. 6:12of what it means to build with agents.
  157. 6:14Now you have three actors in this.
  158. 6:17Engineers, agents, and raw code. You
  159. 6:20have to leverage them all in the right
  160. 6:22location at the right time. Here we're
  161. 6:24adding a code formatter. It doesn't
  162. 6:25matter what language you're in. linting
  163. 6:27your code, formatting your code, type
  164. 6:29check your code, and then keep scaling
  165. 6:31up the validation loops to run back into
  166. 6:35your agents. Once again, you'll see here
  167. 6:37these conditions is what makes up what
  168. 6:40is called the loop. But there's a lot
  169. 6:42more going on here. This is really a
  170. 6:44workflow of how information travels
  171. 6:47within a system. Okay, keep scaling it
  172. 6:50up. What comes next? We can add more
  173. 6:53code. A very valuable piece of code here
  174. 6:55is testing your code. So test. Now we
  175. 6:58take all these results, feed it back
  176. 7:00into our build agent over and over and
  177. 7:02over until the results all pass. And
  178. 7:05that gives us our final engineering
  179. 7:07review. You'll notice a pattern here.
  180. 7:09You and I always show up at the ends.
  181. 7:12These are the two constraints of a
  182. 7:13gentic engineering. Prompting, also
  183. 7:16known as planning, and reviewing, also
  184. 7:18known as validation. If you're a gent
  185. 7:20engineering at scale properly, you're
  186. 7:22showing up at the beginning and the end
  187. 7:25with a few exceptions. Your AI developer
  188. 7:27workflows start simple like this, but
  189. 7:29they should continue to grow. Real
  190. 7:31engineering work looks a lot more
  191. 7:33complex than this, [music] right? What
  192. 7:35do we do next?
  193. 7:40We can scale all of our testing, all of
  194. 7:43our validation, all of our linting, all
  195. 7:45of our type checking into a single test
  196. 7:47agent. So now we're scaling our compute
  197. 7:50to scale our impact. We're adding
  198. 7:52compute to add confidence. Now you can
  199. 7:54imagine we've handed this test agent all
  200. 7:57the things we want to do to test. And if
  201. 7:59something goes wrong, we send the
  202. 8:01context back to the build agent. If it
  203. 8:03passes, the engineer reviews and then we
  204. 8:06can ship the deliverable. We can ship
  205. 8:08the code. All right. So notice a couple
  206. 8:09themes working here. As you scale up
  207. 8:11your developer workflows, you add agents
  208. 8:14and you add code. But what you don't
  209. 8:16want to add is more engineering effort
  210. 8:18outside of building the system that
  211. 8:21builds the system. Let's keep scaling
  212. 8:22this up. Let's add planning to the
  213. 8:25workflow. You're very familiar with
  214. 8:26these ideas, right? We're building
  215. 8:28workflows. These are all steps that you
  216. 8:31and I, the engineer, used to take and
  217. 8:33used to execute ourself, right? We would
  218. 8:36plan work, we would build the work, we
  219. 8:38would test the work, we would then have
  220. 8:40another engineer review the work, and
  221. 8:41then we would finally ship it into
  222. 8:43production. All right? It's a developer
  223. 8:45workflow and all we've done here is
  224. 8:47added AI to it. The loops is just one
  225. 8:50piece of it. You can call it loop
  226. 8:52engineering but it's inaccurate and it's
  227. 8:54not encapsulating the whole picture. If
  228. 8:55we have loop engineering, we need to
  229. 8:57have condition engineering and then we
  230. 8:58need to have function engineering and
  231. 9:00then we need to have a word plus
  232. 9:02engineering for every type of control
  233. 9:03flow inside of the software development
  234. 9:05life cycle which is going to go on
  235. 9:07forever. Okay. So a very popular pattern
  236. 9:10is to push each one of your agents into
  237. 9:13their own work tree. This creates
  238. 9:14isolation. This creates parallelism.
  239. 9:16This lets you do more work in parallel.
  240. 9:19And there's a nice side effect here
  241. 9:21where the agents don't trip over each
  242. 9:22other. So, guess what we're going to do?
  243. 9:24We're going to write another prompt. And
  244. 9:26this time, we're going to write a prompt
  245. 9:28into a piece of code that's going to
  246. 9:31build our work trees. All right. So,
  247. 9:33here we have a deterministic piece of
  248. 9:34code that's going to kick off multiple
  249. 9:37work trees based on the prompt. And then
  250. 9:38we're going to execute several different
  251. 9:41agents running in line. So we have once
  252. 9:44again scaled our compute to scale our
  253. 9:47impact. We have multiple work trees
  254. 9:49running our plan, build, test, review,
  255. 9:52merge, ship pipeline, our developer
  256. 9:56workflow. The workflow you and I used to
  257. 9:58go through as engineers building by
  258. 10:02hand. Now we have AI, hence AI developer
  259. 10:05workflows. And this is really important
  260. 10:07to think through. This is where you
  261. 10:09should focus in your engineering time.
  262. 10:11How can I combine the three actors of
  263. 10:14value creation, engineers, agents, and
  264. 10:17code to create workflows that execute
  265. 10:20large amounts of work on my behalf, on
  266. 10:23behalf of my company, on behalf of your
  267. 10:25users and products? That's the name of
  268. 10:27the game. Okay, so great, we have work
  269. 10:29trees. Work trees are um like I like to
  270. 10:32say, a great place to start, not a great
  271. 10:34place to end. There are a lot of
  272. 10:35problems with work trees. We can do one
  273. 10:37better by giving our agents each their
  274. 10:40own sandbox. Okay? So instead of
  275. 10:42spinning up work trees, we're now giving
  276. 10:44every single agent their own computer,
  277. 10:47right? Their own agent sandbox to
  278. 10:49operate. Because once you do this, you
  279. 10:51have full isolation. You yourself can
  280. 10:54jump into the sandbox to look at the
  281. 10:56work, look at the result, look at the
  282. 10:58web page, look at the tests, look at the
  283. 11:00application, whatever you need to do, do
  284. 11:02your review. And then of course once all
  285. 11:04the work comes back in you merge and you
  286. 11:06ship. So once again notice the three
  287. 11:09actors of value creation working
  288. 11:11together. And notice how your ability to
  289. 11:14create these AI developer workflows is
  290. 11:16your ability to scale your impact with
  291. 11:19agents. It's designing these AI
  292. 11:22developer workflows that is the most
  293. 11:24value accreative thing an engineer can
  294. 11:26do. Hence the term I like to say on the
  295. 11:29channel all the time. You want to be
  296. 11:30building the system that builds the
  297. 11:33system. Okay? As you can see here,
  298. 11:35you'll start to see similarities in
  299. 11:37these workflows with a lot of work
  300. 11:39you've seen, a lot of work that you've
  301. 11:40done, and hopefully work that you're
  302. 11:42building into your teams, your
  303. 11:44co-workers, your business, your tools
  304. 11:46themselves. Okay? We're just getting
  305. 11:48started, [laughter] right? Uh real work
  306. 11:51gets more and more complex. And this is
  307. 11:53the art and science of agentic
  308. 11:56engineering. So, let's keep scaling it.
  309. 12:02A very common thing to do as you
  310. 12:04continue to progress is to set up a
  311. 12:07conbon board, some type of ticket
  312. 12:09system. Input comes from all over your
  313. 12:12organization, right? It comes from
  314. 12:13support, it comes from product, and it
  315. 12:14comes from engineers, right? So now
  316. 12:16things get interesting because now we
  317. 12:17have a new unit, a new wrapper around
  318. 12:20our code, right? We have some type of
  319. 12:22ticketing system. And so once again,
  320. 12:24like there's this really important
  321. 12:25delineation that I make inside of
  322. 12:28tactical agentic coding. And it is this
  323. 12:30idea of the agentic layer. The agents,
  324. 12:33the prompts, the skills, the system
  325. 12:36prompts that wrap your application are
  326. 12:39the thing to be focused on right now.
  327. 12:41Because when you put those together with
  328. 12:43your code, with your system, with your
  329. 12:45entire team and your organization, you
  330. 12:47are agentic engineering. Agentic
  331. 12:49engineering is not just about the
  332. 12:51agents. Spoiler alert, it's about your
  333. 12:54team and most importantly your users and
  334. 12:56putting together the most valuable stack
  335. 12:58of the actors of value creation. Okay,
  336. 13:01so conbon board, right? Let's let's jump
  337. 13:03into this. What does this look like?
  338. 13:04Okay, so for most teams, your tickets
  339. 13:06are then analyzed by your engineer who
  340. 13:09actually knows what's going on and
  341. 13:10they'll translate that into a mid to
  342. 13:12low-level prompt that you'll then pass
  343. 13:14into another full workflow, another
  344. 13:17agent sandbox. But some advanced teams
  345. 13:19if you're teaching your organization how
  346. 13:21to write prompts well enough and as
  347. 13:23models become more capable uh you can
  348. 13:25skip your engineer input prompt here
  349. 13:27right because your engineer's job should
  350. 13:29be building the system we act on the
  351. 13:31meta layer we act on the layer that can
  352. 13:33compound across our organization okay so
  353. 13:35advanced teams can skip the engineering
  354. 13:38prompt if this step is done properly all
  355. 13:40right but so you know this is code right
  356. 13:42conbon boards it's just code there are
  357. 13:44no agents there then we enter the meat
  358. 13:46of our workflow where we run code to
  359. 13:48move that ticket into planning. Guess
  360. 13:50what happens next? Our agents take over
  361. 13:52the pipeline. We'll have a scout agent
  362. 13:54look for all the code, look for all the
  363. 13:56tickets, look for all the documentation,
  364. 13:57look for previous spec files, and then
  365. 13:59it'll hand that to a plan agent. Right?
  366. 14:01So, we're splitting up our searching and
  367. 14:03our planning between two agents here.
  368. 14:05Once again, scaling compute, scaling
  369. 14:07impact. And after that happens, you
  370. 14:09know, plan phase is complete. So, we run
  371. 14:11code to update our ticket to move
  372. 14:13context to do some specific work inside
  373. 14:15of our sandbox. And then of course our
  374. 14:17build agent kicks off. And you know what
  375. 14:19happens from here. You've done it a
  376. 14:21million times yourself. And now with
  377. 14:23agents, your build agent moves it into
  378. 14:26testing after it's done. And then your
  379. 14:27test agent tests, right? This individual
  380. 14:30loop, which is just one part of the
  381. 14:32developer workflow, executes until the
  382. 14:35result passes. And then we're going to
  383. 14:37run our CI/CD. And guess what can happen
  384. 14:39here? This can pass or it can fail and
  385. 14:42go right back to the build agent to
  386. 14:43resolve the issues. All right. And then
  387. 14:45we get outside the sandbox. Engineer
  388. 14:47reviews the code. You know what this
  389. 14:48looks like now? Fail, pass, ship. Right?
  390. 14:51So you can see this is much more than
  391. 14:54just prompt engineering. It's much more
  392. 14:56than context engineering. It's much more
  393. 14:57than harness engineering. It's much more
  394. 14:59than loop engineering. This is about how
  395. 15:00teams move as an organism with all the
  396. 15:04actors inside. Okay? And if you're a
  397. 15:07small solo dev shop, same deal, right?
  398. 15:09It's about how you and your agents work
  399. 15:11together with code to generate valuable
  400. 15:15results. But this isn't the end. The
  401. 15:17future of engineering is vast. Okay,
  402. 15:19let's keep pushing this. What happens
  403. 15:21next? Let's let's imagine another
  404. 15:23scenario here. Imagine you have a
  405. 15:25support crisis. Production is down.
  406. 15:28Okay, production has crashed. So, what
  407. 15:31AI developer workflow do you have
  408. 15:33planned in your organization right now
  409. 15:35when production goes down? How are you
  410. 15:37leveraging engineers, agents, and code
  411. 15:40to resolve this issue and to stop your
  412. 15:42business from leaking cash as your
  413. 15:45production system is down? Let's walk
  414. 15:47through it, okay? Because we've thought
  415. 15:49through this, right? We've designed,
  416. 15:51we've architected the AI developer
  417. 15:53workflow to account for this situation.
  418. 15:55Support files a ticket. In our case
  419. 15:56here, this goes right to Slack. It goes
  420. 15:58right to Teams, goes right to your
  421. 16:00communication channel, and one of your
  422. 16:01cracked engineers picks this up
  423. 16:03immediately. What do they do? They
  424. 16:04prompt a scout agent that routes right
  425. 16:07into a hot fix agent. Your hot fix agent
  426. 16:10has a specialized set of mental memory.
  427. 16:13It's an agent expert that knows and is
  428. 16:16prioritized to get things fixed. It's
  429. 16:18not doing things the right way. It's not
  430. 16:20doing things the fancy way. It's not
  431. 16:21optimizing anything. It's getting the
  432. 16:23fix out ASAP and nothing else. This is a
  433. 16:25surgical hotfix agent, a custom agent
  434. 16:28that you have specialized, that you've
  435. 16:30templated your engineering into. Now,
  436. 16:32what happens here? Human in the loop.
  437. 16:34This is a hot fix. We need to know the
  438. 16:35solution is going to work. So you put in
  439. 16:37human effort, right? You use engineering
  440. 16:39effort to approve or reject. This
  441. 16:41creates a single loop. All right? If we
  442. 16:43approve, guess what happens? We're going
  443. 16:45to build up a bunch of sandboxes to run
  444. 16:47the solution in parallel. And guess
  445. 16:49what? We're using multiple sandboxes. I
  446. 16:52want the first fastest agent that has
  447. 16:54the solution to win. Okay? Whatever your
  448. 16:56compute budget is, you'll scale this up.
  449. 16:57You'll scale this down. If you're in a
  450. 16:59production system that's complex, you
  451. 17:00might want three, five, 10 agents
  452. 17:02running and racing toward a solution in
  453. 17:04their own agent sandbox, you don't care.
  454. 17:06You have the compute, you've done the
  455. 17:07agentic engineering to scale your
  456. 17:09impact. And guess what happens here? You
  457. 17:11already know what happens. It runs its
  458. 17:12individual loop in their sandbox. And
  459. 17:15then it passes or fails. If it fails, it
  460. 17:17goes right back to your hot fix agent
  461. 17:19and to you to resolve. And of course, if
  462. 17:21it's all successful, you the engineer
  463. 17:23validate it and you get the hot fix
  464. 17:25shipped ASAP. Okay. A question for you
  465. 17:28and your organization. Do you have an
  466. 17:30agentic workflow for production crashes?
  467. 17:32Can you get that resolved in record time
  468. 17:35using the three actors of value creation
  469. 17:38in the age of agents? Engineers, agents,
  470. 17:41and code. All three. Okay, this
  471. 17:44continues to scale and scale and scale.
  472. 17:46Let's push these workflows further.
  473. 17:49After some point, what you get is a
  474. 17:51structure like this.
  475. 17:57And this is what really starts turning
  476. 17:59into a software factory. Okay, you'll
  477. 18:02see here we have many different types of
  478. 18:04specialized agent sandbox workflows.
  479. 18:07Some are for chores, one is for a bug,
  480. 18:09one is for a feature, one is for this
  481. 18:11hot fix that we just walked through. And
  482. 18:13you get the idea here, right? Any
  483. 18:15specialized AI developer workflow you
  484. 18:18need can be built and routed to thanks
  485. 18:21to your routing system. Okay, this is
  486. 18:24the art and science of agentic
  487. 18:26engineering, right? This is all of it
  488. 18:28put together. The loops are just one
  489. 18:30small piece of this picture. I hope you
  490. 18:32can see that. Now, in all this is a
  491. 18:35great level of prompt context harness
  492. 18:38engineering. There are a million ways to
  493. 18:41do this. There are a million different
  494. 18:43multi- aent orchestration patterns to
  495. 18:45build into this. The key here is this.
  496. 18:49is that you have the right combination
  497. 18:51at the right time to push engineering
  498. 18:54work through end to end with agents with
  499. 18:57code with engineers. Okay, I know I'm
  500. 18:59repeating myself. I'm doing it on
  501. 19:01purpose. Most success in any domain is
  502. 19:04about doing a few things and saying a
  503. 19:06few things and focusing on a few things
  504. 19:09over and over and over. Let's walk
  505. 19:11through a full software factory. You can
  506. 19:14imagine how this looks, right? Let's
  507. 19:16keep with a conbon ticket example. Now,
  508. 19:18anyone can file a ticket. This is a
  509. 19:20feature. This is a bug. This is a chore.
  510. 19:22Advanced teams are going to skip wasting
  511. 19:24engineering time transferring your
  512. 19:26conbon ticket into a low-level or
  513. 19:28mid-level engineering breakdown of what
  514. 19:31needs to happen. Advanced teams are
  515. 19:32going to go right to kicking off a
  516. 19:33software factory. The moment your conbon
  517. 19:35ticket lands, once the factory starts,
  518. 19:37it's going to mark that ticket in
  519. 19:39progress and move it. And now we have a
  520. 19:41factory router agent. This could just be
  521. 19:43a simple LLM call. This could be some
  522. 19:46deterministic code. The exact nodes are
  523. 19:48up to you to decide, but you get the
  524. 19:50idea here. I'm going to throw a factory
  525. 19:52agent here to intake the results. Do a
  526. 19:55quick look at the codebase, understand
  527. 19:56what AI developer workflow we need to
  528. 19:59execute for the system. First though,
  529. 20:01we're going to set up a sandbox. We're
  530. 20:03not limiting our agents anymore. We know
  531. 20:05that agents are going to continue to
  532. 20:07expand. This is what the CPU crunch is
  533. 20:09all about. CPUs are getting wiped off
  534. 20:11the board outside of scaling RL and
  535. 20:14other ML engineering related work. Agent
  536. 20:16sandboxes are going to, I can guarantee
  537. 20:17you this, be the majority of computers
  538. 20:20out there in the world. You and I will
  539. 20:21be using fewer and fewer devices while
  540. 20:23our agents continue to scale up and use
  541. 20:25more sandboxes. Okay, but set up the
  542. 20:26sandbox. After that, our agent has
  543. 20:28already decided what type of workflow we
  544. 20:31need to get the job done at the best
  545. 20:33price, at the best performance, and at
  546. 20:35the right speed. Because as you likely
  547. 20:37know, you're not going to run your hot
  548. 20:39fix AI developer workflow or your
  549. 20:41feature AI developer workflow where
  550. 20:43you're scaling out your very best
  551. 20:44agents. Maybe your build agent is a
  552. 20:46workhorse model, but your planner and
  553. 20:48your scouters are going to be
  554. 20:49state-of-the-art model so nothing gets
  555. 20:51missed. Of course, there's a whole slew
  556. 20:53of multi- aent orchestration work that
  557. 20:55can happen here. But the whole point is
  558. 20:56you're not going to deploy your heavy AI
  559. 20:58developer workflows for a chore, right?
  560. 21:00for your chore. Throw a single agent at
  561. 21:02this with a workhorse model, maybe even
  562. 21:04a lightweight model. Build it, run the
  563. 21:06lint, run the CI/CD, engineer reviews
  564. 21:08it, and ship it out. We'll talk about
  565. 21:10ZTE in a second, but the best teams are
  566. 21:12going to start dropping off engineering
  567. 21:14review because they've built the best
  568. 21:17system possible that they know is going
  569. 21:18to execute for them. But every single
  570. 21:21unique workflow is unique for a reason,
  571. 21:24right? There are multiple workflows you
  572. 21:25want to build out here, multiple AI
  573. 21:27developer workflows you should be
  574. 21:28building out, not just one. I'll give my
  575. 21:30recommendation some really, really great
  576. 21:32practices you can use when building
  577. 21:34these out in a moment here. But the
  578. 21:36general rule of thumb is just to start
  579. 21:37simple. Once you start scaling this up,
  580. 21:39what you're going to end up with is a
  581. 21:41software factory. A software factory
  582. 21:44that can operate your application as
  583. 21:46well. And if you're doing it right,
  584. 21:48better than you and your engineering
  585. 21:50team. This is why all your effort, all
  586. 21:52of your effort goes into this. Now, the
  587. 21:54agentic layer, right? This is the al the
  588. 21:57agentic layer, not the app layer. The
  589. 22:00app layer is for your agents. The the
  590. 22:03best engineering teams never touch the
  591. 22:06product themselves. Okay, I know this
  592. 22:08might be like controversial. Some
  593. 22:09engineers are going to hate hearing
  594. 22:10this, but the best teams are doing meta
  595. 22:13work on the agentic layer. They're
  596. 22:16building the system that builds the
  597. 22:18system. That is the central thesis
  598. 22:20inside of tactical agentic coding.
  599. 22:22Thousands of engineers know that and
  600. 22:24you're going to figure it out too sooner
  601. 22:26or later. Okay, that doesn't mean you
  602. 22:27can't jump into the app to do work. But
  603. 22:29when you have a successful product
  604. 22:31scaled with users, the name of the game
  605. 22:34is this. Building a software factory
  606. 22:37that operates everything better than you
  607. 22:40alone could, better than code alone
  608. 22:42could, and better than agents alone
  609. 22:44could. Right? Three actors of value
  610. 22:46creation, agents, engineers, code. Where
  611. 22:49does that all lead us? It leads us to
  612. 22:50the simple conclusion that it's not a
  613. 22:52loop you're after. It's an AI developer
  614. 22:54workflow. Okay, you might be, you know,
  615. 22:56listening to this and thinking, but you
  616. 22:58you drew a million loops. Like, isn't
  617. 23:00this a loop? Fine. If you want to call
  618. 23:02it a loop, I don't really care. I think
  619. 23:04a loop is too constrained. If you're
  620. 23:06going to call it a loop, we're going to
  621. 23:07need if engineer, we're going to need
  622. 23:09throw engineering. We're going to need
  623. 23:10exception engineering, right? We're
  624. 23:11going to need to name all these things
  625. 23:12engineering. This is a developer
  626. 23:14workflow. This used to be what engineers
  627. 23:16did. Engineers used to decide if
  628. 23:18something was a chore, if something was
  629. 23:20a bug. We used to write the plan, we
  630. 23:22used to execute it, so on and so forth.
  631. 23:24But now we have a new tool and that's
  632. 23:26all it is. It's a new tool. We have
  633. 23:28agents to work with that gives us AI
  634. 23:32developer workflows. Okay. So at the
  635. 23:34highest levels of agentic engineering,
  636. 23:36you're building software factories that
  637. 23:39execute the right work and the right
  638. 23:41combination of engineers, agents, and
  639. 23:43code across your organization. Once you
  640. 23:45really start to scale it up, you're
  641. 23:46going to add your other teammates,
  642. 23:49right? Your other team members from
  643. 23:50other cross cutting concerns inside of
  644. 23:52your business. But at the core of it,
  645. 23:54the engineers are responsible for the
  646. 23:56code. Okay? I think a lot of orgs are
  647. 23:58going to have a a problem with this once
  648. 24:00they start scaling in and adding other
  649. 24:02team members, right? Especially ones
  650. 24:04that can't write clear tickets for the
  651. 24:06life of them. You've seen this a million
  652. 24:08times, right? It's the most painful
  653. 24:09thing when your product manager, your
  654. 24:11your CTO, your your tech lead [laughter]
  655. 24:14just writes a ticket and you have
  656. 24:16to translate it, right? So there's
  657. 24:17there's a lot of like, you know, people
  658. 24:19organizational level work to be done
  659. 24:21here. But you at the end of the day, you
  660. 24:23know, you the engineer plus the agents
  661. 24:25plus the code making up the AI developer
  662. 24:27workflow. This is what it's all about.
  663. 24:29This is where value is going to be
  664. 24:31created at absurd levels, at absurd
  665. 24:35scales. Because once you get this right,
  666. 24:37here's the dirty secret of all software,
  667. 24:40right? You already know it. Once you get
  668. 24:41this right, you set up the right
  669. 24:43guardrails, the right harness, right?
  670. 24:44Again, prompt, context, harness
  671. 24:46engineering, all of it. Once you do this
  672. 24:48right, you have a repeatable workflow
  673. 24:51that you can run tens, hundreds, and
  674. 24:53thousands of times, delivering
  675. 24:54consistent results to you over and over
  676. 24:57and over again if you template your
  677. 25:00engineering into the fabric of your AI
  678. 25:03developer workflows. Okay? And so I've
  679. 25:05been pushing against out of the box
  680. 25:06agents for a long time. Um, you know,
  681. 25:08specialization is the name of the game.
  682. 25:11What is a product? What is a company?
  683. 25:12Right? Unless you're a big tech giant,
  684. 25:14like a product in a company is a a set
  685. 25:18of people in technology that solve a
  686. 25:20specific problem for a specific avatar
  687. 25:22for a specific user for a specific
  688. 25:24customer. By very definition is
  689. 25:26specialization, right? Your expertise is
  690. 25:30the most valuable thing you have now.
  691. 25:32And you can template that into your
  692. 25:33engineering. You can template that into
  693. 25:36your AI developer workflows. All right,
  694. 25:38this is the greatest leverage point of
  695. 25:40agentic coding. It's building out these
  696. 25:43full AI developer workflows that puts it
  697. 25:45all together. Okay, and so you know once
  698. 25:48again we are pushing away from vibe
  699. 25:51coding. This is not vibe coding. Vibe
  700. 25:53coding is not knowing how the system
  701. 25:54works and it's not looking at how the
  702. 25:56system works. Okay, agentic engineering
  703. 25:58is knowing your system works so well you
  704. 26:01don't have to look. And that is because
  705. 26:03you the engineer have moved up a layer.
  706. 26:06You're meta-engineering. You're
  707. 26:07compounding an advantage by optimizing
  708. 26:10the three actors of agentic engineering
  709. 26:13engineer code agents into the right
  710. 26:16developer workflow at the right time at
  711. 26:18the right performance at the right price
  712. 26:19with the right speed. And after time
  713. 26:22you'll realize something really
  714. 26:23important is that you'll be building AI
  715. 26:26developer workflows into your products
  716. 26:28for your customers right with your
  717. 26:30customers as nodes and then as mentioned
  718. 26:33with your companies every user that can
  719. 26:35prompt into the system and receive
  720. 26:36results out the system right you have to
  721. 26:38design this system it's just another
  722. 26:40system
  723. 26:45so I've written hundreds and probably
  724. 26:47thousands of these AI developer
  725. 26:49workflows by now. So, let me give you
  726. 26:50the oil of everything I've learned so
  727. 26:52far with what I've seen and what I've
  728. 26:54recommended to engineers as they're
  729. 26:56building out their ADWs. Um, first off,
  730. 26:58keep it simple. When you start building
  731. 27:00these out, start with the simplest
  732. 27:02workflow you can think of, right? And
  733. 27:04typically that looks something like
  734. 27:05this, right? After you get an agent
  735. 27:07running, you prompt back and forth and
  736. 27:08you're babysitting your agent. Everyone
  737. 27:10knows what this looks like. Just let it
  738. 27:12lent your code. You know, to be clear,
  739. 27:13so that you can really feel this.
  740. 27:15Separate this out. I'm not saying write
  741. 27:17a skill, have your agent build, and then
  742. 27:19at the bottom of the skill, run lint.
  743. 27:22Separate this out. Use an agent SDK, run
  744. 27:24a build agent, do work, and then run a
  745. 27:27llinter. And when the llinter fails,
  746. 27:29pass that back into the build agent with
  747. 27:30the same session ID. You have to
  748. 27:32separate your code and your agents.
  749. 27:34Otherwise, you just have an agent
  750. 27:36calling code. That's not what we want.
  751. 27:38We want separation of concerns all the
  752. 27:40way through. If that doesn't make sense
  753. 27:42to you right now, don't worry. It'll
  754. 27:43make sense once you start building it.
  755. 27:45This is not a big skill where you run a
  756. 27:48hundred different nodes of workflows.
  757. 27:49There are massive testing, massive
  758. 27:52validation problems with doing that. And
  759. 27:54then what do you do after that? You add
  760. 27:56a couple nodes, right? Start solving
  761. 27:58real problems. Run your type checker,
  762. 28:00run your llinter. If things go wrong,
  763. 28:02funnel it back into your build agent.
  764. 28:04What you'll notice here is that you're
  765. 28:05starting to build a larger unit, a
  766. 28:08larger system that operates without you.
  767. 28:10You show the beginning and the end. the
  768. 28:13two constraints of agent coding,
  769. 28:14planning and reviewing, and your system
  770. 28:16does everything else. Okay? And then
  771. 28:18once you get to a certain point, you'll
  772. 28:19start separating out your agents. You'll
  773. 28:21start specializing your agents. Maybe
  774. 28:23you want to separate your front end and
  775. 28:25your back end. Maybe you want building
  776. 28:26and testing. Again, the key here is just
  777. 28:29that you separate the context out so
  778. 28:31that your context can move between
  779. 28:33individual agents and code. When you're
  780. 28:36starting, remember KISS, keep it simple,
  781. 28:38stupid. You can absolutely start with
  782. 28:40pure skill-based workflows where it's
  783. 28:43all one skill outside of the prompt and
  784. 28:45the review. But as soon as you start
  785. 28:47productionizing, as soon as you run to
  786. 28:48get serious about your AWS, you must
  787. 28:50separate code out of the skills because
  788. 28:53that's still your agent running it,
  789. 28:54right? You have to be super super clear
  790. 28:56about those steps so that you can set up
  791. 28:58the proper guard rails and information
  792. 29:00flows in your AI developer workflows. My
  793. 29:03next really big piece of advice here is
  794. 29:04design your ADWs by doing the work
  795. 29:07yourself first. For a lot of engineers,
  796. 29:09this will sound insanely painful, but
  797. 29:11you can like, you know, use your agent
  798. 29:13in the terminal. Run the build workflow.
  799. 29:16Do the testing, right? You can still use
  800. 29:17your agent for that. I'm not saying do
  801. 29:18it by hand. That would be a waste of
  802. 29:20time now. But what I am saying is
  803. 29:21whatever workflow you're setting up, run
  804. 29:23it end to end. Step into each node
  805. 29:26yourself. run the pass, run the
  806. 29:28condition, watch the functions get
  807. 29:30executed, do the review, and then do the
  808. 29:32ship to production and then start
  809. 29:34writing this all as a combination of
  810. 29:37agents, engineers, and code. And I
  811. 29:39recommend you take something like
  812. 29:40mermaid. And you know, by the way, this
  813. 29:42is like a adaptation of mermaid diagram.
  814. 29:45I had an agent create using a plan build
  815. 29:47test AI developer workflow in one shot.
  816. 29:50I created a animated application which
  817. 29:52is of course based on a mermaid diagram.
  818. 29:55Okay, so shout out to mermaid. Shout out
  819. 29:56to mermaid.live. But that's my second
  820. 29:58piece of advice, right? Walk through it
  821. 30:00all yourself first. Sit down pencil and
  822. 30:02a piece of paper or use mermaid or use
  823. 30:04whatever. Really sit down and like write
  824. 30:07out your workflow. And then lastly, make
  825. 30:09sure you're not just using agents,
  826. 30:11right? Use agents and code. As I
  827. 30:13mentioned, you can always start with
  828. 30:15agents and skills, but as soon as you
  829. 30:18start hitting production, as soon as you
  830. 30:19want to get serious, move some of that
  831. 30:21skill work into code. This is not just
  832. 30:23about token cost. This is about
  833. 30:24performance, reliability, and speed.
  834. 30:26Again, everyone in their AI psychosis
  835. 30:28has like forgotten that speed costs zero
  836. 30:31tokens. There's no hallucination. It
  837. 30:34does the exact same thing every time.
  838. 30:36And it literally runs at the speed of
  839. 30:38light. So, don't overleverage on agents.
  840. 30:41Okay? Balance it out with actual code,
  841. 30:44right? Code execution. And yes, there's
  842. 30:46information orchestration. There is this
  843. 30:47is what context engineering is. You're
  844. 30:50going to need a place for all the
  845. 30:52results in between each step. Yes, it's
  846. 30:55going to take some time. Yes, it's going
  847. 30:56to be a little knowing. Yes, during the
  848. 30:57process, you'll wonder, I should just
  849. 30:59throw this all in the skill. You'll be
  850. 31:00wrong down the road. I can guarantee you
  851. 31:02that. I've been there. Don't waste your
  852. 31:04time doing other engineers have
  853. 31:05already done wrong. Separate it out as
  854. 31:07you scale this. Okay, so that's the big
  855. 31:09third tip. Use agents and code. Okay,
  856. 31:12because agents plus code beats either
  857. 31:15alone, especially when you start really
  858. 31:17scaling these into legitimately large AI
  859. 31:20developer workflows that do serious work
  860. 31:23for you and your organization. Why?
  861. 31:25Because you're going to need to test
  862. 31:26this node. You're going to need to test
  863. 31:28plan into build. You're going to need to
  864. 31:30test plan into build and to update the
  865. 31:32status and to testing and to fail. This
  866. 31:34is all still a system you the engineer
  867. 31:36are responsible for. So keep using great
  868. 31:39classic engineering patterns,
  869. 31:41isolatable, decoupled, single interface,
  870. 31:44right? All that stuff matters probably
  871. 31:47even more, right? It matters even more
  872. 31:49now because once you do it right and you
  873. 31:51set up your AI developer workflow, it
  874. 31:52gets multiplied hundreds and thousands
  875. 31:54of times and your agents plus your code
  876. 31:57can drive the outcomes for you. Okay?
  877. 31:59So, you know, let's step away from the
  878. 32:00vibes a little bit and let's step out
  879. 32:02away from the AI psychosis a little bit
  880. 32:04because if we're going to do serious
  881. 32:05agentic engineering, you need to know
  882. 32:08what's going to happen in your system.
  883. 32:10So, if you made it to the end here, I
  884. 32:11want to just say thank you for trusting
  885. 32:13me. For everyone that's been with the
  886. 32:14channel for a while, for years now, you
  887. 32:16know, big shout out to you. I appreciate
  888. 32:18you trusting me and following along this
  889. 32:19massive journey of Agentic Engineering
  890. 32:21that we're on. Um, if you want more, I
  891. 32:23recommend you check out
  892. 32:24agenticengineer.com, specifically
  893. 32:27tactical agentic coding. As I mentioned,
  894. 32:30I've been pretty early to a lot of these
  895. 32:32ideas. In tactical agent coding, you're
  896. 32:34going to hear a lot of what I just said
  897. 32:36really broken down step by step across
  898. 32:38eight lessons and then six additional
  899. 32:41upgradable lessons if you're interested.
  900. 32:44Okay, so the big idea here is AI
  901. 32:45developer workflows. It's building
  902. 32:47systems that build systems. We're not
  903. 32:49touching the application layer anymore.
  904. 32:51We're touching the agentic system, the
  905. 32:53agentic layer that builds it on our
  906. 32:56behalf. Okay? So, if you want to pay to
  907. 32:57play, you want to get a big advantage
  908. 32:59that again thousands of engineers that
  909. 33:01you know of and have heard of at
  910. 33:03companies you know the names of, they
  911. 33:05are in here and they have gotten the
  912. 33:07advantage and they are getting the
  913. 33:08advantage, right? It's tactical agent
  914. 33:10coding is the first eight lessons you
  915. 33:11can upgrade to agentic horizon to get
  916. 33:13some upgradeable ideas. really big idea
  917. 33:15there is of course multi- aent
  918. 33:16orchestration but agent experts is
  919. 33:19turning out to be a massively banger
  920. 33:21idea a massively important idea for
  921. 33:23engineering in the age of agents if you
  922. 33:25want to build true specialists that
  923. 33:27outperform out of the box agent anyway
  924. 33:29lots more in there's a very clear 30-day
  925. 33:32refund before you start lesson 4. So if
  926. 33:34you don't like my style or you're not
  927. 33:36getting the core of it it's fine I don't
  928. 33:38want you in here if you don't want to be
  929. 33:3930-day refund before you start lesson 4.
  930. 33:41This is going to be linked in the
  931. 33:42description for you. Also, I recommend
  932. 33:44if you vibe with the ideas here, if you
  933. 33:46understand the ideas and you don't want
  934. 33:48to jump in the tactical agent coding
  935. 33:49right away, check out this blog. I'll
  936. 33:51link in the description as well,
  937. 33:53thinking in threads. It covers a lot of
  938. 33:55the same ideas we've been discussing 99%
  939. 33:58of everything I do here on this channel.
  940. 33:59It's all free. It's out there for you to
  941. 34:01understand and master agentic
  942. 34:04engineering. If you made it to the end,
  943. 34:05do me a favor, like this video, leave a
  944. 34:07comment, and share it with your coworker
  945. 34:09before your competition sends it to
  946. 34:11theirs. You know where to find me every
  947. 34:13single Monday. Stay focused and keep
  948. 34:16building.

About this transcript

This page contains the full transcript of FORGET Loop Engineering. Agentic Engineering is about THIS by IndyDevDan, generated from the public captions YouTube serves with the video. The transcript has 6,447 words across 948 segments, with the original timestamps preserved so you can click any line to jump to that moment in the embedded player.

What you can do with it

Use the transcript to take notes, quote the speaker, build a study guide, generate a summary with ChatGPT or Claude via the YouTube Summary tool, or export it as a timed subtitle file with YouTube to SRT. You can also re-open it in the transcriber to choose a caption track available on the video.

Free YouTube transcript tool

YouTube2Text is a free YouTube transcript generator — no signup, no daily limit. Paste any YouTube link and get the full transcript instantly, with timestamps, click-to-jump, caption language selection, AI prompts for ChatGPT, Claude, and Gemini, and exports to TXT, SRT, VTT, or Markdown.