YouTube2Text

Build Your AI Operating System: Regen OS. Human-Centred AI Community Workshop by Ben Pecotich — Transcript

by Dynamic4 · 14,134 words · 2,061 segments · language en · Watch on YouTube

Full transcript

  1. 0:00Good day everyone. I'm Riley Coleman. Um
  2. 0:02I have um been uh I've known Ben for a
  3. 0:07long time. Um but uh over the last sort
  4. 0:09of year or so as I've come back to
  5. 0:11Australia, I've definitely we've caught
  6. 0:13up quite a few times and um I think that
  7. 0:15we are um uh we've sort of uh rifted
  8. 0:18about AI quite a few times uh in terms
  9. 0:21of sharing what each other's doing and
  10. 0:22things like that. And so um one of the
  11. 0:25um uh reasons I brought Ben in is
  12. 0:27because of some u work that I was doing
  13. 0:29with the course that I teach people um
  14. 0:32and uh talking about you know how do you
  15. 0:34actually go for the next level in terms
  16. 0:36of um your AI maturity and that really
  17. 0:40comes down to systemizing things so that
  18. 0:43you're not having to reinvent the wheel
  19. 0:45every time. You're getting a lot more of
  20. 0:47that advantage baked in from the very
  21. 0:49start um and things like that. So
  22. 0:51building something that is more
  23. 0:53sustainable
  24. 0:54um that is able to be used um uh in your
  25. 0:58daily work um and also it learns
  26. 1:00alongside you because right now
  27. 1:03obviously um uh different AI systems are
  28. 1:06learning systems but they're kind of
  29. 1:07learning at scale and behind you know
  30. 1:10behind big kind of um retraining
  31. 1:12moments. So, um this is why Ben's coming
  32. 1:16in because uh he has uh set up uh his
  33. 1:19own um uh AI operating system uh which
  34. 1:24um is called regen. Um
  35. 1:27and is it like I wonder if it's like
  36. 1:30Siri Ben you can tell us like do you say
  37. 1:31regen and it's listening to you for that
  38. 1:33or something but
  39. 1:35>> it's not someone called me or Jen.
  40. 1:37[laughter]
  41. 1:39>> So he's going to walk through um how he
  42. 1:41Hi Oliver. uh he's going to walk through
  43. 1:43how he is um had thought through this
  44. 1:46process, how he approached both building
  45. 1:47it um iterating and and sort of
  46. 1:50developing it over time. Um and then
  47. 1:52also how he uses it um uh and how that
  48. 1:56um uh what advantage like why would you
  49. 1:59go into doing this essentially? Um what
  50. 2:01what sort of advantage does that offer
  51. 2:03you? Um and uh how does he actually
  52. 2:05leverage it um in the way that he works
  53. 2:08um every day?
  54. 2:10So um this is part of a series of
  55. 2:12workshops that I'm bringing together for
  56. 2:15a community that I'm sort of starting
  57. 2:17called human- centered AI community. So
  58. 2:19looking at um uh you know the advantages
  59. 2:22and the opportunities that AI brings um
  60. 2:25sort of co-learning together but also
  61. 2:27talking about things like um how do you
  62. 2:29do um personalization without breaching
  63. 2:32people's privacy. Uh so really looking
  64. 2:34at the ethical human uh centered side of
  65. 2:36it as well. And so um thank you Ben for
  66. 2:39joining us. Um Ben has been working uh
  67. 2:43uh for um decades within design. Uh he
  68. 2:47currently leads uh an organization uh
  69. 2:50called Dynamic 4. Um and some of you uh
  70. 2:53folks in Sydney in particular may know
  71. 2:56Ben from his um uh I think it's you said
  72. 2:5911th birthday uh Sydney design thinking.
  73. 3:01Is that correct? Yep. Uh so he's been um
  74. 3:04uh uh facilitating and running the
  75. 3:06Sydney design thinking uh community for
  76. 3:08the last 11 years which is a a really
  77. 3:11really you know uh huge kind of thing to
  78. 3:14be doing for that long a period of time.
  79. 3:16So he's been contributing to the design
  80. 3:18community uh particularly in Sydney um
  81. 3:20uh from uh a a longtime advantage uh
  82. 3:24point of view. Um and so it's a real
  83. 3:27pleasure to have Ben come in and uh talk
  84. 3:30us through how he actually approaches
  85. 3:32this um and answers all your questions.
  86. 3:34So save them. You can put them in the
  87. 3:37chat and we'll come to them at the end.
  88. 3:39Um alternatively um you can save them to
  89. 3:42the end and obviously say them out. But
  90. 3:43uh yeah, if you think of anything as
  91. 3:44he's going through, please by all means
  92. 3:46throw it in the chat and we'll come to
  93. 3:48that at the very end.
  94. 3:50Um so without further ado, I'd love to
  95. 3:53invite Ben to uh you know uh take the
  96. 3:56lead and to yeah uh tell us everything
  97. 4:00we can learn from you and your um
  98. 4:03[laughter] awesome regen OS.
  99. 4:05>> Let's not get carried away. Thanks
  100. 4:07Riley. [laughter]
  101. 4:10>> Awesome. Great to see you all. Lots of
  102. 4:13familiar faces and a bunch of fresh ones
  103. 4:16as well. So, great to meet you. Um, just
  104. 4:19want to acknowledge that I'm lucky to
  105. 4:20live, work, and play on Gatle country
  106. 4:22and pay my respects to elders past,
  107. 4:24present, and future. Um, as Riley
  108. 4:27mentioned, I'm Ben. Hi. Um, I thought it
  109. 4:31might be worth me just quickly sharing
  110. 4:33kind of the perspective that I come at
  111. 4:34this with because there's a lot of talk
  112. 4:36about AI and it's kind of everywhere all
  113. 4:39the time, all at once. Uh a lot of it's
  114. 4:41hyperbole and there's lots of fear and
  115. 4:43scaremongering as part of that. Uh and a
  116. 4:46lot of it comes very much from a tech
  117. 4:48perspective. Um but I do come at it from
  118. 4:51a tech perspective but also with some
  119. 4:53other perspectives to it as well. So the
  120. 4:55way I spend my days is um literally from
  121. 4:58boardrooms to pixels, devops and AI um
  122. 5:02and all the bits in between. So it's not
  123. 5:04just a tech orientation to this. Uh lots
  124. 5:07of that's around business model
  125. 5:08innovation, product, service and
  126. 5:10organizational design, designing and
  127. 5:12delivering project based leadership
  128. 5:14programs. So there's a lot of that kind
  129. 5:16of stuff in play. And another way that a
  130. 5:20bunch of you will probably um already
  131. 5:22know is that I'm bit of a governance,
  132. 5:26data, systems design, product tech, and
  133. 5:29learning geek. So, where all of those
  134. 5:32things come together and hang out,
  135. 5:34that's kind of where I hang out. And,
  136. 5:36um, I can see a bunch of you already
  137. 5:38here. That's I get to collaborate with
  138. 5:40and do that fun stuff with as well. Um,
  139. 5:43and so a lot of that's really about how
  140. 5:45do we uh work with people to design and
  141. 5:48build business models, products, and
  142. 5:49services that customers and teams really
  143. 5:51love. They actually make money because
  144. 5:53without that, we don't get to keep doing
  145. 5:55it. And they do great things for people
  146. 5:57in our planet all all while increasing
  147. 5:59well-being. So everything I do is
  148. 6:02focused on how do we help accelerate the
  149. 6:03transition to more regenerative ways of
  150. 6:05living and doing business. And that's
  151. 6:08how I spend my days now in terms of what
  152. 6:10I've been doing. Um over the last 30
  153. 6:13plus years I've been designing and
  154. 6:15building digital products, services and
  155. 6:16experiences. Um and also the teams and
  156. 6:19organizations that actually deliver
  157. 6:21those things. and how do you again it's
  158. 6:24not just the design and tech but how do
  159. 6:27you actually bring that together as an
  160. 6:28integrad system um I spend about 80% of
  161. 6:32my time actually doing the work and I
  162. 6:35try to keep talking about it coaching
  163. 6:38teaching writing to about 20% so
  164. 6:42everything I do is very much in current
  165. 6:44practice and real world experience not
  166. 6:46just theory or I remember a time 10
  167. 6:48years ago when we used to do it this way
  168. 6:50and that's now completely obsolete and
  169. 6:52irrelevant
  170. 6:52Um, I find it really important that I
  171. 6:54stay completely
  172. 6:57every day in the practice as well. Um, I
  173. 7:00wrote a book 5 years ago, um, it's hard
  174. 7:03to believe it's 5 years called Solve
  175. 7:04Problems That Matter, which was all
  176. 7:07about how to design, build, and launch
  177. 7:09your social enterprise idea. And I am in
  178. 7:13the middle of writing a new book. And
  179. 7:16this is actually the first tease of the
  180. 7:19working title uh which is lead what
  181. 7:21matters and that is all about how to
  182. 7:25design the conditions for momentum. So
  183. 7:28working title I'll be testing that yet
  184. 7:30but it's very much around leadership and
  185. 7:33how do we adapt to all the increasing
  186. 7:35expectations including Gen AI and and
  187. 7:39how that um impacts people and teams and
  188. 7:42organizations. Um so a few moving parts
  189. 7:45there. Hopefully that helps sort of
  190. 7:47frame this not as a tech thing. It is
  191. 7:50very much technology enabling but it's
  192. 7:53actually more about the people, the
  193. 7:55process, the organizations performance,
  194. 7:58workflows, habits, all those other
  195. 8:00things that actually are the way that
  196. 8:02we've always um needed to do work. So a
  197. 8:06very quick hopefully in the right room
  198. 8:09this is what we'll cover. Um, and a lot
  199. 8:12of this I've kind of been hesitant to
  200. 8:15share publicly because things move so
  201. 8:18fast and literally like um can say
  202. 8:23something tonight and by the morning
  203. 8:25it'll already be out of date. In fact,
  204. 8:27it might already be happening while I'm
  205. 8:28saying these words. Um, in between
  206. 8:31running a version of this workshop um
  207. 8:34back on the 7th of July, so less than 3
  208. 8:36weeks ago,
  209. 8:38huge number of things have changed.
  210. 8:40The day that I ran that workshop, there
  211. 8:43were two app app updates, one on claw
  212. 8:45desktop, one on chat GBT or it's codec
  213. 8:48still at the time. That was an hour
  214. 8:50before I started the workshop. That was
  215. 8:52on a Tuesday night. By Friday,
  216. 8:55there was no longer a codeex app as the
  217. 8:58desktop app for chat GPT. It had been
  218. 9:00merged in and ChatGpt
  219. 9:03work was announced and codeex was
  220. 9:05another angle of that. And a few days
  221. 9:08later, they even dropped the work part
  222. 9:10of chat GBT in the little toggle. So,
  223. 9:14you know, little things like that, just
  224. 9:15the way you even find and interact with
  225. 9:17these models and those harnesses or
  226. 9:19wraps that are wrapped around them
  227. 9:21literally changing by the hour. And, um,
  228. 9:24if you haven't seen in the last couple
  229. 9:26of days, um, Claude has released or
  230. 9:30Anthropic has released Opus 5. So, you
  231. 9:33probably heard all about Mythos and then
  232. 9:34you heard about Fable 5. That model
  233. 9:36disappeared for a few weeks, came back,
  234. 9:39fresh guard rails on it, and now Opus 5
  235. 9:42has been released and that is already
  236. 9:44outperforming Fable 5 that was banned by
  237. 9:46the US government um on a whole bunch of
  238. 9:49benchmarks. The other key sort of things
  239. 9:52that are without diving into all the
  240. 9:54tech side of this because it relies
  241. 9:56relates directly to the stuff we're
  242. 9:58talking about is both chat GBT/Codex
  243. 10:02um and Claude got realtime voice
  244. 10:06directly into their desktop apps. So you
  245. 10:08can control things in a real-time voice
  246. 10:10scenario um which you couldn't before
  247. 10:13Friday. Um, you could do dictation, but
  248. 10:16you couldn't do real-time voice
  249. 10:17interaction. And
  250. 10:20my biggest breakthrough of the last few
  251. 10:23days, weeks, can't even remember how
  252. 10:25long it's been. It's probably only been
  253. 10:26a week and a half, is that completely
  254. 10:30undocumented
  255. 10:31feature on codeex where now I have my
  256. 10:35team members, my synthetic team members
  257. 10:38directly DMing each other and being able
  258. 10:41to hand off work to each other and QA
  259. 10:42each other's work.
  260. 10:44according to a workflow that I've
  261. 10:45designed and completely undocumented
  262. 10:48feature and I was trying to solve team
  263. 10:50collaboration and it suddenly went hey I
  264. 10:54can do this now and a few days earlier
  265. 10:57couldn't do that haven't seen any
  266. 10:59announcements of that anywhere else
  267. 11:00either um so it's this kind of stuff
  268. 11:02that is happening all the time so even
  269. 11:05though I just spoke about it for the
  270. 11:07last couple of minutes I'm not going to
  271. 11:09talk about product features because they
  272. 11:11are literally changing that past. Um the
  273. 11:14thing I'm going to focus on and we'll
  274. 11:16talk about together is really the
  275. 11:18enduring principles that last. So the
  276. 11:20ways of working, the mindset, the
  277. 11:23workflows, the things that actually
  278. 11:25are stable regardless of what the model
  279. 11:28and the harness can do today. Um so
  280. 11:30that's where I find there's, you know,
  281. 11:32more value in thinking about because
  282. 11:35everything's changing so fast. Something
  283. 11:37I'm not going to cover today is the
  284. 11:40ethics and climate impacts. Uh extremely
  285. 11:42important topics. Love to talk about
  286. 11:44them, but that could be many hours of
  287. 11:47conversation and often one's best have
  288. 11:49at the pub. Anyway, the other thing this
  289. 11:51isn't is a buildalong session. So, it's
  290. 11:55very much about the principles and the
  291. 11:56architecture and the ways of working,
  292. 11:58but it's not going to be a workshop to
  293. 12:01sort of build your own. Um hopefully
  294. 12:03there'll be enough in there that you can
  295. 12:05sort of take it and apply. Um but it's
  296. 12:08not that guided version of things.
  297. 12:11So the main thing I'm going to focus on
  298. 12:13as we go through this is really on not
  299. 12:16technical work, not writing code. And
  300. 12:18when you um hear about these types of
  301. 12:21workflows and operating systems, they're
  302. 12:23almost always in a code and development
  303. 12:25context. I'm not going to talk about
  304. 12:27that at all. I'm going to assume that
  305. 12:29everyone is here because you want the
  306. 12:31non- tech version and it's very much
  307. 12:34about the knowledge work and so because
  308. 12:37of that very much focusing on
  309. 12:39unstructured ambiguous knowledge work
  310. 12:41not even automated processes of business
  311. 12:44process of how do you get step ABC to
  312. 12:47happen really fast. So it's working in
  313. 12:49that really uncertain ambiguous free
  314. 12:52flowing unstructured version of using
  315. 12:55these tools is the main thing that I'm
  316. 12:58going to focus on.
  317. 13:00So
  318. 13:02very quickly
  319. 13:05the other thing is we say AI now and we
  320. 13:08very specifically almost always mean
  321. 13:10generative AI. So AI has been around not
  322. 13:15since November 22. It's been emerging
  323. 13:19since the 1950s and there's been these
  324. 13:23different waves of AI
  325. 13:26and they have had different
  326. 13:27capabilities, different ways of
  327. 13:28training, different things they could do
  328. 13:30and different levels of adoption as
  329. 13:32well. And so as these waves have come
  330. 13:35through and the next wave starts, it
  331. 13:38hasn't stopped the previous wave. It's
  332. 13:40often built on top of and then now with
  333. 13:44Gen AI, they're actually all working
  334. 13:46together. But when we're talking about
  335. 13:48the frontier models, foundational models
  336. 13:51like chat GBT or Claude or Copilot or a
  337. 13:55lot of the others, we're specifically
  338. 13:57talking about Gen AI as the thing. Um,
  339. 14:01and so for a few years I held on to I
  340. 14:05refused to say AI unless I specifically
  341. 14:08meanted meant the other versions of AI,
  342. 14:11but we're past that point. So speaking
  343. 14:13the language of the customer, I've I'm
  344. 14:16going along with it. So when I say AI in
  345. 14:19this context, I'm pretty much only
  346. 14:22talking about Gen AI. Um and AI is an
  347. 14:25amplifier is an amplifier. So it's and
  348. 14:28an accelerant. It doesn't actually
  349. 14:29really a lot of the things that we talk
  350. 14:31about when the hype starts up around AI,
  351. 14:35it's actually not new stuff. They're
  352. 14:38actually um more people, culture,
  353. 14:40process, workflow and data challenges
  354. 14:42than they are technical ones. So the
  355. 14:44same sort of challenges we've had for
  356. 14:45decades slash tens of thousands of
  357. 14:48years. You know there the same types of
  358. 14:49behaviors and how do we work together
  359. 14:52and there's a lot of fear that comes in
  360. 14:54through that. So I find it's really
  361. 14:55important that we keep that perspective
  362. 14:58and that we sort of zoom out and we
  363. 15:00don't just hone in on the last sort of
  364. 15:02three and a half years of Gen AI hitting
  365. 15:05mainstream. If we zoom out and we keep
  366. 15:08that perspective, we actually see that
  367. 15:09longer time arc and we're traveling
  368. 15:12faster and with different tools, but as
  369. 15:14we look back, there's a lot of really
  370. 15:16familiar patterns and we've learned a
  371. 15:18lot of things over decades of how to
  372. 15:20navigate those complexities. Um, so I
  373. 15:22think it's really important to do that
  374. 15:24zooming out.
  375. 15:26And something I really want to emphasize
  376. 15:28is while I'm sharing this stuff, I'm
  377. 15:31definitely not saying that I've got the
  378. 15:33answers. I'm not an AI or I'm not an AI
  379. 15:36expert and I'm not a Gen AI expert. And
  380. 15:38anyone that tells you that they're a Gen
  381. 15:40AI expert, um I think it's pretty safe
  382. 15:43to say that they're lying to you andor
  383. 15:45delusional. Um because even the makers
  384. 15:47of the models or the growers of the
  385. 15:49models as sometimes now referred to
  386. 15:51because we don't actually even know how
  387. 15:52they work the neural network and we can
  388. 15:54see the effects and we can see the
  389. 15:56pre-training and some of the inference,
  390. 15:58but we don't actually understand anymore
  391. 16:00what's happening inside the models. Um
  392. 16:03so some people actually talk about these
  393. 16:05models now growing the conditions and
  394. 16:07the nurturing and some things are put
  395. 16:09together to grow them but there's not a
  396. 16:11direct cause and effect of making them
  397. 16:13as there once was. Um so there's this is
  398. 16:17very much emergent practice and there
  399. 16:20are no experts in emergence and
  400. 16:25learning starts with not knowing.
  401. 16:27So let's get into not knowing together.
  402. 16:31So, the key thing I'm really curious
  403. 16:33about to kick off is
  404. 16:35you,
  405. 16:37your data,
  406. 16:39and how you use AI. So, I'd love to be
  407. 16:43able to see you wherever possible,
  408. 16:44including with uh Andrew's
  409. 16:47animatronics head, [laughter] which is
  410. 16:49awesome. Um, but chuck in the chat. Um,
  411. 16:54let me know a little bit about what
  412. 16:56you're actually using in terms of AI
  413. 16:57models and tools right now. What's your
  414. 16:59your tool or tools of choice?
  415. 17:05Jess has got the paid the flash
  416. 17:07co-pilot.
  417. 17:08Claude and Virginia when you say Claude
  418. 17:11any particular version are using it in
  419. 17:13browser using the desktop app.
  420. 17:18Victor's got codeex claude code.
  421. 17:21So sounding more on the dev side.
  422. 17:22Desktop for Virginia. Awesome.
  423. 17:29It's mostly the chat GPT and the clawed
  424. 17:32side of things which would match all the
  425. 17:35download data.
  426. 17:38Some Figma make
  427. 17:41[laughter]
  428. 17:42Oie's living large with the new Siri. So
  429. 17:45what he means to say is he's using
  430. 17:46Gemini.
  431. 17:50Gemini mashed together with a bit of
  432. 17:51Apple love.
  433. 17:55Uh, what else we got? Claude Code, Opus,
  434. 17:59Gemini.
  435. 18:02Awesome. That's g me a good sort of
  436. 18:04sense.
  437. 18:05And when you're using your models,
  438. 18:09where do you find the good stuff goes
  439. 18:13when that session or chat ends?
  440. 18:17What happens to the outputs that you
  441. 18:18create in those little interactions?
  442. 18:29>> [laughter]
  443. 18:30>> into Riley's own neural network.
  444. 18:32Awesome. Good. Before, during, and
  445. 18:34after, I hope.
  446. 18:39And since we got more neurons outside of
  447. 18:41the brain than inside, then um I hope
  448. 18:45that's embodied AI
  449. 18:50docs, HTML, skills. Nice. Some scripts.
  450. 18:55John's geeking out with some Python.
  451. 19:00Creating prototypes.
  452. 19:07Excellent.
  453. 19:10And
  454. 19:12what's the situation here? How often do
  455. 19:14you find that you're repeating yourself
  456. 19:17across different chats or interactions?
  457. 19:20Is that a a rare thing or a
  458. 19:24most session thing?
  459. 19:26A bunch of too often.
  460. 19:30Nigel's rare. Good. That means some
  461. 19:32stuff's already set up.
  462. 19:34Howie
  463. 19:38Riley's got it sorted.
  464. 19:44Nice.
  465. 19:48And now not even thinking strictly in an
  466. 19:50AI context,
  467. 19:52but watch your data. What data do you
  468. 19:55have?
  469. 20:07You don't just have CSVs and
  470. 20:09spreadsheets. Oie,
  471. 20:12you got more interesting data than that.
  472. 20:20documents and web.
  473. 20:22[laughter]
  474. 20:24So Ollie might be letting us in on a
  475. 20:26where it does and does not trust AI to
  476. 20:29play right now.
  477. 20:32PowerPoint docs.
  478. 20:36Awesome.
  479. 20:42And the big question
  480. 20:44and one of the things of if you don't if
  481. 20:47this makes you a little bit nervous to
  482. 20:49answer or you don't know this is
  483. 20:51definitely your homework. Where does it
  484. 20:53live? Where's your data right now?
  485. 20:57How many places do you know all the
  486. 21:00places?
  487. 21:05GitHub. Nigel's definitely got the the
  488. 21:08dev rig going.
  489. 21:12everywhere.
  490. 21:16Superb base. Nice.
  491. 21:21GitHub.
  492. 21:25And the final one for this set
  493. 21:29for all that data that you've got and
  494. 21:31all those places it lives.
  495. 21:33What needs to be working for you to be
  496. 21:35able to access it when you need it?
  497. 21:42So if you said anything other than on
  498. 21:45your own device,
  499. 21:47you've got a lot of infrastructure that
  500. 21:49needs to be available.
  501. 21:51So the interweb needs to be available
  502. 21:53for Kev.
  503. 21:55GitHub needs to be up. And if it's on
  504. 21:56GitHub, then you need a whole bunch of
  505. 22:01infrastructure between your device and
  506. 22:04GitHub to be working
  507. 22:07in the clouds.
  508. 22:12And we have got to a point where the
  509. 22:14internet and just saying the internet
  510. 22:16needs to be working is almost like a
  511. 22:19passible answer because we rely on it so
  512. 22:22heavily every day. But if you think
  513. 22:24about all the moving parts that need to
  514. 22:26be up and going and working to um
  515. 22:29standard to be able to even browse a web
  516. 22:32page, let alone get to your real data,
  517. 22:35that's a lot of moving parts that you've
  518. 22:36got little to no control of. And for
  519. 22:40anyone who doesn't pay for data when
  520. 22:43you're on a flight
  521. 22:45and you need to get to that file
  522. 22:48because you really need it, then it
  523. 22:51might give you a sense of what it can
  524. 22:53feel like when you can't get the data
  525. 22:55you need.
  526. 22:57And so
  527. 23:00data,
  528. 23:02it really kicks things off. And you've
  529. 23:05probably, you know, seen a version of
  530. 23:08this pyramid or this pyramid
  531. 23:09specifically before. We've got the data.
  532. 23:12We turn that into information through
  533. 23:14synthesis and knowledge. And then
  534. 23:17hopefully we get insight out the top of
  535. 23:18it.
  536. 23:20And then all of that then wraps together
  537. 23:24as our experience.
  538. 23:26And so data, it's so important and it's
  539. 23:28so critical to everything. But not just
  540. 23:30because we love data, even though I do,
  541. 23:33but it starts the process, but it's
  542. 23:35actually our experience that gives it
  543. 23:36meaning. So it's all of those other
  544. 23:38things that wrap around it. If it's just
  545. 23:41an isolated piece of data, you might not
  546. 23:42care too much about it, but our
  547. 23:44experience gives it meaning. So if you
  548. 23:46think of a photo, a piece of music, a
  549. 23:49message, something that's really
  550. 23:51important to you, and you actually think
  551. 23:53about that thing right now.
  552. 23:57And then if you think about how would
  553. 23:59you feel if you lost it
  554. 24:02because a lot of that stuff is now
  555. 24:04stored as data.
  556. 24:08And so even though it's just a data
  557. 24:10point or data element,
  558. 24:12the data by itself is not enough. It's
  559. 24:14all those relationships and context and
  560. 24:16memory and our lived experience that
  561. 24:18wraps around it that gives it meaning.
  562. 24:21And that's really why the current
  563. 24:25experience when people use AI is a
  564. 24:29little bit weird. A lot of the time it
  565. 24:31often feels extractive or disposable
  566. 24:36and we go through some version of this a
  567. 24:39lot of the time where we sort of feel
  568. 24:42like we're starting over and over with
  569. 24:44someone that's really smart but they
  570. 24:46just and lots of potential but they just
  571. 24:48don't know us or remember us. So we ask
  572. 24:51something, we get an output, we might
  573. 24:54copy and paste that somewhere else.
  574. 24:56it then we want to build on it or do
  575. 24:59something more with it. Loses context
  576. 25:01and then you're back to sort of square
  577. 25:03one and have to start again and you
  578. 25:04start getting really frustrated of I've
  579. 25:06already told you this. Why am I telling
  580. 25:07you this again? And that's pretty
  581. 25:09infuriating. It's infuriating when it
  582. 25:11happens with people and it's even more
  583. 25:14infuriating I'd argue when it happens
  584. 25:16with machines that are supposed to just
  585. 25:18remember everything all the time. Um but
  586. 25:20that's not the experience for a lot of
  587. 25:21us a lot of the time right now. So we
  588. 25:24create these what feel like really
  589. 25:25useful moments you might even feel that
  590. 25:27excitement of look at this thing I'm
  591. 25:29starting to be able to do this thing
  592. 25:30with it and then without the way the
  593. 25:34products are at the moment a lot of the
  594. 25:36time that then a feeling of being let
  595. 25:40down or that momentum drops away there's
  596. 25:42no compounding value because it is like
  597. 25:44starting again
  598. 25:46and so that results in our thinking
  599. 25:48being a bit scattered and our context we
  600. 25:51feel disconnected and our work's just
  601. 25:54really hard to find and re reuse and and
  602. 25:56build on. And so that's what the
  603. 25:59experience is for a lot of people today.
  604. 26:02How much of that feels familiar from
  605. 26:05what people were saying in the chat?
  606. 26:06There was a fair bit and there's been a
  607. 26:08few nods. So hopefully it's not
  608. 26:11triggering too many things, but um
  609. 26:15that's where there's a huge opportunity
  610. 26:17because the tools are actually capable a
  611. 26:20lot of a lot of this now. But it does
  612. 26:22take that thinking about the workflow
  613. 26:24and the habits and building those things
  614. 26:25up. But being able to move from a chat
  615. 26:28to actually having a synthetic team or
  616. 26:30an agent team or the bots or the AIS or
  617. 26:33whatever you want to refer that refer to
  618. 26:35that to, but I think of it as my
  619. 26:38synthetic team. And so as I've been
  620. 26:41designing regen OS um and it's very much
  621. 26:44a work in progress and it's something
  622. 26:46literally working on every day because
  623. 26:48it's it iterates as I'm doing real work
  624. 26:50with it. But it's really about how to
  625. 26:52make AI a compounding asset and with
  626. 26:55data that you actually own and you own
  627. 26:58and have control of it locally, not just
  628. 27:00when somebody else's infrastructure is
  629. 27:02available. So all of that value is
  630. 27:04actually yours to use when and how you
  631. 27:07need it. And so that flow of work
  632. 27:09happens. You get the useful stuff that's
  633. 27:12produced if that's context or outputs is
  634. 27:14written back to that safe place.
  635. 27:18Patterns that are valuable become
  636. 27:20reusable. And then the next session
  637. 27:22starts from that stronger base. And
  638. 27:25because of all of that, you end up with
  639. 27:26better thinking, clearer decisions, more
  640. 27:28momentum. And that's all because that
  641. 27:30context is getting carried forward and
  642. 27:32built on rather than just left behind as
  643. 27:34a fragment in a browser window.
  644. 27:38And so
  645. 27:40this is an illustration version of
  646. 27:42regenos as a living loop. Um for those
  647. 27:47that were here for the first version,
  648. 27:50you'll see the next iteration of this,
  649. 27:52but there's five elements that form a
  650. 27:54stack, but it lives as a living loop. It
  651. 27:57actually works as a living loop. So the
  652. 27:59foundation,
  653. 28:01that's all your data, that's all that
  654. 28:03you own. That's durable. It's
  655. 28:05compounding. That's your stuff. And
  656. 28:08hopefully you can see from the icons
  657. 28:09made up of all those different file
  658. 28:11types that are really where our data and
  659. 28:14our digital life and our second brain
  660. 28:16and all of those types of things now
  661. 28:17live.
  662. 28:19The next layer building on top of it is
  663. 28:21the playbook. So that's how does the
  664. 28:24system actually behave.
  665. 28:27A really important one is the boundary.
  666. 28:30So that shield over the top of what's AI
  667. 28:33safe, what's allowed, assisted or
  668. 28:36explicitly human only of don't touch
  669. 28:38this AI hands off. This is my stuff. You
  670. 28:42either don't even know it exists or you
  671. 28:44get to read it only or you have a
  672. 28:48certain set of permissions to interact
  673. 28:50with it.
  674. 28:51And then across the top are the engines
  675. 28:55and it's plural. So there was a few
  676. 28:58people in the chat that were talking
  677. 28:59about the using multiple models. The
  678. 29:01whole idea here is that you can use
  679. 29:03multiple at once and not lose your team
  680. 29:06that you still get all the benefits of
  681. 29:08as if you're using one model and you
  682. 29:10don't have platform lockin and you
  683. 29:12reduce that risk that one platform is
  684. 29:15going to disappear or change their
  685. 29:17policy or get banned by the government
  686. 29:19or change their pricing model or do any
  687. 29:21number of things. that if you don't have
  688. 29:24that designed then all your data could
  689. 29:27literally gone and that's to me is a
  690. 29:30really scary thought.
  691. 29:33And now all of that comes together then
  692. 29:35into the studio and that's who works
  693. 29:38with who. So the human in the studio but
  694. 29:40then who are these synthetic team
  695. 29:42members? What are their roles? What
  696. 29:44memory and context are they working
  697. 29:46with? How do they interact?
  698. 29:48And that's where the work's done. And
  699. 29:50then the regeneration. So the system can
  700. 29:53keep um recovering and compounding and
  701. 29:56the continuity that you're picking up
  702. 29:58from where you left off rather than
  703. 30:00having to start again. [clears throat]
  704. 30:02So in terms of kind of the loop of how
  705. 30:05that works. So a studio member reads the
  706. 30:08foundation, they get their memory and
  707. 30:10context, they get the rules of the game
  708. 30:12from the playbook. The boundary
  709. 30:14determines what can be read, changed,
  710. 30:16suggested or decided. So the rules of
  711. 30:18that access and interaction.
  712. 30:21one of the engines or multiple of the
  713. 30:22engines and tools. You do the work
  714. 30:24through their app and the harness and
  715. 30:27then the useful outputs are then written
  716. 30:28back into the playbook and the
  717. 30:30foundation and then the whole system
  718. 30:32regenerates and gets stronger over time
  719. 30:34and so you get that compounding um
  720. 30:36value.
  721. 30:37So that's the sort of architecture of
  722. 30:40the snapshot. We'll come back to that a
  723. 30:42little bit more soon.
  724. 30:44But I think there's a really important
  725. 30:46part here. Um because as we were talking
  726. 30:49about before, a lot of this isn't
  727. 30:50actually about the tech. It's about the
  728. 30:53mental model and the the workflow and
  729. 30:55the paradigm that we bring to it. So
  730. 30:59when you think of this literally as your
  731. 31:01team
  732. 31:03rather than just a random chat bot and
  733. 31:06you apply a lot of the principles that
  734. 31:07you've probably used over years of
  735. 31:10working with new team members, on
  736. 31:11boarding, hiring new team members, how
  737. 31:14do you bring them up to speed? what work
  738. 31:16do you give to them when you know that
  739. 31:19leadership aspect of things and the man
  740. 31:22management of how do you manage things
  741. 31:24is a really important mental model that
  742. 31:27I think flows through all of this and so
  743. 31:30rather than just being a set of random
  744. 31:32things doing random stuff
  745. 31:34or even just it's one model so I'll just
  746. 31:37give it all the things in one chat and
  747. 31:39it can sort itself out in the background
  748. 31:42then each team member actually has when
  749. 31:44they're a team member
  750. 31:45they have a clear role and scope. So you
  751. 31:47know here's your JD basically and this
  752. 31:50is how what your skills needed to be.
  753. 31:53This is um the context that you're
  754. 31:55working with and this is how you play
  755. 31:58with other members of the team. And
  756. 31:59here's the playbook of how our workflow
  757. 32:02works when we're doing work together.
  758. 32:04It's got the context it needs. Each has
  759. 32:07its own memory that carries forward and
  760. 32:10it then you're renting that intelligence
  761. 32:13from one of the engines or one or more
  762. 32:15of the engines and then when something's
  763. 32:18repeatable then we can turn that into a
  764. 32:21skill and those skills are transferable
  765. 32:23across team members as well. And so it's
  766. 32:25all about being able to set the
  767. 32:27direction to find those boundaries. But
  768. 32:29as the human we are always accountable
  769. 32:32for our synthetic team and everything
  770. 32:34that they do, everything they produce or
  771. 32:36don't produce and the quality of it and
  772. 32:39any misbehavior,
  773. 32:41whatever happens there as the human
  774. 32:44that's on us. And so even looking at
  775. 32:48this is a sort of picture of the
  776. 32:50architecture,
  777. 32:52this isn't actually a team-based model.
  778. 32:55So each human has their own synthetic
  779. 32:58team and then how each human works with
  780. 33:01other humans in a real person team
  781. 33:04that is then another level of design but
  782. 33:07every human is bringing their own
  783. 33:09synthetic team to the broader team. Does
  784. 33:13that make sense?
  785. 33:15There's a whole thing on whole and
  786. 33:17hocrisy um but I'm going to stay away
  787. 33:20from that org design stuff just for now.
  788. 33:24a quick one on as a little bit of a
  789. 33:28before and how some of these things have
  790. 33:31morphed over time. Um, a bunch of you
  791. 33:34will know that I have a little ongoing
  792. 33:37creative project called Music
  793. 33:38Meanderings where I do um somewhere like
  794. 33:43150 plus um micro reviews of albums, my
  795. 33:48favorite albums having a major
  796. 33:50anniversary or new releases. Um, and so
  797. 33:55that's an always on project. I've been
  798. 33:56doing it for years. And for the
  799. 33:59anniversaries, that takes a fair bit of
  800. 34:02admin.
  801. 34:04And so I need to go through my iTunes
  802. 34:06library, get my four and five started uh
  803. 34:09four and five star rated um albums, get
  804. 34:14those all of those that are having an
  805. 34:16anniversary for the year, get those into
  806. 34:18a a sheet. So, I've got the year, but I
  807. 34:21don't yet know the date. And then I need
  808. 34:23to find out the specific date because I
  809. 34:26post on the date that it's having a
  810. 34:28major anniversary, not the general year.
  811. 34:31So, I need to go get that info. So,
  812. 34:34before AI, I'd have to go and research
  813. 34:38and and I might be looking at a sheet of
  814. 34:40150 of these. I'm I used to go and drop
  815. 34:45that into a Google search. go get the
  816. 34:48release date. When you get older than a
  817. 34:522005 album, then it gets sometimes
  818. 34:56pretty hard and especially if it's not
  819. 34:57really mainstream, it can start taking a
  820. 34:59lot of digging to get the actual release
  821. 35:01date. So, I used to have to do all of
  822. 35:03that manually. I have to remember all
  823. 35:05the things all the time and do it all
  824. 35:07myself. And then chat GBT and perplexity
  825. 35:11happened. And so when I was doing it in
  826. 35:142023,
  827. 35:16I was giving it batches and to both
  828. 35:20perplexity and to um chat GBT and I
  829. 35:26would then compare their output and chat
  830. 35:28GBT would just extremely confidently lie
  831. 35:31to me and tell me a date and I'd go that
  832. 35:35doesn't sound quite right and I'd get
  833. 35:37the same output from Plexity and
  834. 35:39Perplexity would more often say, "I
  835. 35:42don't know. I can't find that." And I
  836. 35:45would then do a compare. But it meant
  837. 35:48in, you know, late 2023 when I was doing
  838. 35:50this, I still had to do all of that
  839. 35:53manually and spot check. And because I
  840. 35:55could then couldn't trust it, I had to
  841. 35:57mostly do it manually and everything
  842. 35:58that I did have, I'd have to fact check.
  843. 36:01By late 2024 when I was doing that
  844. 36:04again, it was in a very different state.
  845. 36:08And this time it had the basics handled
  846. 36:11pretty well. I could upload a
  847. 36:13spreadsheet. It could do some
  848. 36:14restructuring of that sheet, but it
  849. 36:17couldn't really do the work. By late
  850. 36:202025,
  851. 36:22I was able to say, I need this. I gave
  852. 36:25it the list and it was able to go and
  853. 36:28accurately, and this was chat GPT this
  854. 36:30time, and fact checked with Claude, was
  855. 36:32actually able to factually go and get
  856. 36:34that info for me.
  857. 36:36We're now at a point only a few months
  858. 36:39later where I won't even need to do any
  859. 36:42of that myself in terms of going to get
  860. 36:44that data. I'll actually be able to give
  861. 36:46one of my agents or team members the
  862. 36:49goal of I want this for this reason,
  863. 36:51point to past examples and it will
  864. 36:54actually be able to use computer use, do
  865. 36:56the export out of iTunes, do the
  866. 36:58filtering and sorting and then go fill
  867. 37:01out the dates for me and tell me what my
  868. 37:03posting schedule is. So the the pace of
  869. 37:07change over those years and the reason
  870. 37:10I'm using something completely
  871. 37:12unbusiness related is because I want to
  872. 37:14make sure this is really not about
  873. 37:16coding not about operational
  874. 37:19optimization and automation of workflows
  875. 37:23really unstructured knowledge work and
  876. 37:26how do you work with that type of
  877. 37:28situation not just something that's
  878. 37:29pretty predictable and so these are the
  879. 37:33different ways of working as the
  880. 37:36capabilities have changed over the
  881. 37:38years.
  882. 37:40So my question to you
  883. 37:42is what synthetic team member would be
  884. 37:46most useful to you right now and feel
  885. 37:49free to chuck it in the chat.
  886. 37:53Does anyone got need some album release
  887. 37:55dates or you got some other uses for
  888. 37:57these [laughter] agents?
  889. 38:03And if you haven't got anything to chuck
  890. 38:05in the chat, have a think about what
  891. 38:06that might be. What's what's something
  892. 38:09that's on your plate right now that's
  893. 38:11you find frustrating
  894. 38:14or you feel a bit stuck or it's really
  895. 38:18labor intensive to get the data together
  896. 38:31visualizing skill sets of a team for
  897. 38:35specific projects. Definitely business
  898. 38:37process tacet knowledge extraction doco
  899. 38:41and as Riley mentioned
  900. 38:44now the two major models of claude and
  901. 38:48chatgpt support just screen recording
  902. 38:51that. So a lot of the other platforms
  903. 38:54where you'd have to either do that
  904. 38:55manually or pay for a se uh separate sub
  905. 38:58to be able to do things like soaps and
  906. 39:01playbooks that's all standard stuff now.
  907. 39:06or about to be
  908. 39:09virtual personal assistant. Awesome,
  909. 39:10Kev. That is actually one of the hardest
  910. 39:14things unless you've got a very
  911. 39:16operationalized, repeatable life. Uh,
  912. 39:18and as a designer, I know you don't.
  913. 39:21Then having a VA is really tricky when
  914. 39:25it's a human, especially when you don't
  915. 39:28have really repeatable loops on a
  916. 39:29timeline that makes sense to hire a VA.
  917. 39:33these types of models when it's very
  918. 39:35unstructured or it's something that
  919. 39:37happens in that little scenario I just
  920. 39:38gave of once a year and I fact check it
  921. 39:41and do some other things every now and
  922. 39:43then. Um,
  923. 39:45lots of power there. Awesome.
  924. 39:47Orchestrator,
  925. 39:49someone to work out my finances.
  926. 39:53Everything I say tonight is not
  927. 39:55financial advice, not legal advice, but
  928. 39:57I do have a financial advisor team
  929. 40:00member who does my statements of advice
  930. 40:03for me. And as the human, I am fully
  931. 40:07accountable for whatever it tells me and
  932. 40:08whatever I action, but it does all of
  933. 40:12that financial modeling for me. It looks
  934. 40:14product comparison does all of that for
  935. 40:17me as um same as a financial financial
  936. 40:20adviser would. and from my experience
  937. 40:23does it better and for free
  938. 40:28and [laughter]
  939. 40:30uh recipes awesome
  940. 40:34excellent lots of possible ways and I
  941. 40:36think the mix of very business work
  942. 40:40oriented things and lots of personal
  943. 40:42things
  944. 40:43when it's your own synthetic team you no
  945. 40:47longer have to delineate about that
  946. 40:48because you're building it for you and
  947. 40:50you can look at it whole of life and
  948. 40:52then when you're looking in a business
  949. 40:53context, you can look at which parts of
  950. 40:55this will I share now with other team
  951. 40:57members in a business context. So being
  952. 41:00able to that boundary line applies also
  953. 41:03to other humans and to other
  954. 41:04organizations etc.
  955. 41:08So the bits that make all this possible,
  956. 41:10we've talked about this a little bit,
  957. 41:12but just to make it really explicit
  958. 41:14because
  959. 41:16there's always preconditions for the
  960. 41:18good stuff to work and a lot of it
  961. 41:19doesn't happen at once.
  962. 41:21So at the moment the most powerful
  963. 41:23especially again talking about non- tech
  964. 41:26so we're not talking about code or dev
  965. 41:29in a non tech context the the superset
  966. 41:33and what I find I spend most of my time
  967. 41:35with at the moment is the chat GBT
  968. 41:38desktop app which also now includes
  969. 41:41codeex in it so it's it's one combined
  970. 41:44app now claude and again the desktop app
  971. 41:49and Obsidian in. So the key thing is
  972. 41:52with the um the models, you need the
  973. 41:56desktop app to really get the most value
  974. 41:59out of it. Now you can get a bit of
  975. 42:01stuff out of the browsers and using
  976. 42:03connectors and even some MCPs and stuff,
  977. 42:06but it's just not the same experience as
  978. 42:09the app being able to work with your
  979. 42:11files locally and you telling it what's
  980. 42:13allowed to touch and not allowed to
  981. 42:14touch. Um, so it's a completely
  982. 42:16different experience when you're using
  983. 42:18the desktop app um of these same models
  984. 42:20that a lot of people have been using for
  985. 42:22months and years now. So the key thing
  986. 42:25you need one of these apps on your
  987. 42:28desktop. Both support Mac and Windows.
  988. 42:31Um, varying support for other oss. Um,
  989. 42:36Mac tends to get the features
  990. 42:39a week, two, 3 weeks earlier sometimes
  991. 42:42and Windows. uh though that has started
  992. 42:44to change over the last few weeks. And a
  993. 42:48key thing here is you actually don't
  994. 42:50need it all and you don't need it all to
  995. 42:52be nice and clean, including your files
  996. 42:54and data before you can make a start.
  997. 42:56You can actually get your um AI to help
  998. 43:00you do a lot of that work once you've
  999. 43:03got the basic setup.
  1000. 43:05You'll notice there a non-geni
  1001. 43:08icon and that's Obsidian.
  1002. 43:11So, a lot of people keep asking me about
  1003. 43:13Obsidian for some reason. Um, if you use
  1004. 43:16Notion, it's a lot like Notion except
  1005. 43:19for you don't need to pay them. It's
  1006. 43:22free, open source, and all the files
  1007. 43:24live on your devices and can be clouds
  1008. 43:27synced, but they're yours to play with,
  1009. 43:30not someone else's. Um, and has a huge
  1010. 43:34community with plugins and stuff wrapped
  1011. 43:36around it, so you can do all sorts of
  1012. 43:38stuff with it. Um, so it's effectively
  1013. 43:41the same as notion for a lot of things.
  1014. 43:45Um,
  1015. 43:47basically it's a text editor just to
  1016. 43:50almost [laughter]
  1017. 43:51go back on that. But that's effectively
  1018. 43:54what notion is is as well. So it's
  1019. 43:58the what's emerged over the last 2 3
  1020. 44:02years is markdown has become the deacto
  1021. 44:04standard for the AI models as the file
  1022. 44:07format and markdown is literally just a
  1023. 44:11text file format. There's a specific
  1024. 44:14syntax but it's pretty much a plain text
  1025. 44:17editor that then gets enhanced with some
  1026. 44:20other stuff when you use things like
  1027. 44:21Obsidian to be able to do some
  1028. 44:23additional things on top. So, it's
  1029. 44:25nothing to be scared of. Um, and it's
  1030. 44:28not the only text editor or the only
  1031. 44:30markdown editor. So, I use Obsidian as
  1032. 44:33my main. Um, but if I just want to read
  1033. 44:36and I don't want it part of my more
  1034. 44:37structured stuff and I just want to open
  1035. 44:39it from Finder Explorer, then I use an
  1036. 44:43app called Mark Viewer or you can
  1037. 44:44literally open it in Notepad. Um, it is
  1038. 44:47literally a text file. So, it's it's an
  1039. 44:50open format and that gives it a lot of
  1040. 44:52future proofing. There have been talks
  1041. 44:55and there's a little bit of an ongoing
  1042. 44:57debate of will HTML actually be the file
  1043. 45:00format that AI runs on. Um it's possible
  1044. 45:04and even if it is markdown converts
  1045. 45:07nicely and lots of things. Um and
  1046. 45:10there's also ways to run this where all
  1047. 45:11your files and and a lot of what we're
  1048. 45:13talking about is then run in a light
  1049. 45:15database um which can also be run
  1050. 45:17locally without um server
  1051. 45:19infrastructure.
  1052. 45:21But I promised no repos um and no tech
  1053. 45:26stuff. So we won't talk about that and
  1054. 45:29no tech skills required. So I use
  1055. 45:32Obsidian partly because I already had 30
  1056. 45:36plus years of my notes in it um when it
  1057. 45:39sort of took off earlier this year. So,
  1058. 45:43and the reason I even had my notes in it
  1059. 45:45was it fits a lot of my architecture
  1060. 45:47principles um about being markdown files
  1061. 45:51that it's offline. I've always got
  1062. 45:53access to it. I can access across all my
  1063. 45:54devices anytime, anywhere. Those are
  1064. 45:57standard architecture principles I've
  1065. 45:59had forever and Obsidian fit that. Um,
  1066. 46:04and another key reason why I think
  1067. 46:06Markdown still has a better chance than
  1068. 46:08HTML at this stage is it's really easy
  1069. 46:10to create a text document and edit it
  1070. 46:12and read it. HTML mostly isn't. Um, it
  1071. 46:16normally takes a little bit more effort
  1072. 46:18around that. Not impossible, but it's
  1073. 46:21very easy to create and edit markdown
  1074. 46:22files and
  1075. 46:26it's extremely efficient as that layer
  1076. 46:28that both humans and machines can read.
  1077. 46:31So that's why I use obsidian. The thing
  1078. 46:34that I always have to show is everyone
  1079. 46:38always wants to see the graph view of
  1080. 46:41obsidian. So it automatically creates
  1081. 46:44these knowledge graphs. So every node
  1082. 46:48that you can see there is a note in my
  1083. 46:51file file and each of those files is
  1084. 46:53literally a file on my hard drive.
  1085. 46:55So as you interact with each, it will
  1086. 46:59actually show here are the relationships
  1087. 47:02that it has with other notes within your
  1088. 47:04vault as well. So you can use that as a
  1089. 47:06way to trace through that this note,
  1090. 47:09this file, this piece of data has a
  1091. 47:11relationship with another one within the
  1092. 47:13file system.
  1093. 47:15useful for humans. Um, and AI models
  1094. 47:18especially love it because then it does
  1095. 47:20the work of being able to scan um, and
  1096. 47:22be able to trace things through and you
  1097. 47:25can animate your obsidian graph showing
  1098. 47:27how the different sort of nodes and
  1099. 47:29relationships sort of grew over time. I
  1100. 47:33don't find it that useful on a every
  1101. 47:36moment of everyday use, but it is an
  1102. 47:37interesting little feature and everyone
  1103. 47:39always when they talk about Obsidian
  1104. 47:41want to see the graph. So there you go.
  1105. 47:43You saw the graph. So now working with
  1106. 47:47your synthetic team,
  1107. 47:49what's it actually look like in action?
  1108. 47:52So this is a very quick walk through and
  1109. 47:56bit of a before, during and after
  1110. 47:57journey map. So before these are the
  1111. 48:00files that exist before any sess
  1112. 48:02session. Starting how we on board
  1113. 48:05synthetic team member and that's when
  1114. 48:06the engines and the studio come into
  1115. 48:08play. the during. So that's where the
  1116. 48:10real context and that's the studio at
  1117. 48:13work. How you end a session. So you're
  1118. 48:15actually making sure that you're
  1119. 48:16compounding the that value and
  1120. 48:18regeneration can happen and continuing.
  1121. 48:21So that same team member can then be
  1122. 48:23used by a different engine and you got
  1123. 48:26that continuity.
  1124. 48:28So the before it is literally as I said
  1125. 48:34marked down. So these are just folders.
  1126. 48:37The yellow ones are folders. The purple
  1127. 48:40ones are markdown files. And so these
  1128. 48:43are just the files that sit on my
  1129. 48:45machine. You'll see that in the playbook
  1130. 48:49section. So this is how the rules of the
  1131. 48:52game basically. There's the
  1132. 48:53architecture. You would have seen the
  1133. 48:56brand. So my writing style, the dynamic
  1134. 48:59four brand guidelines, bunch of assets.
  1135. 49:02Um there's tools there skills. There's
  1136. 49:05workflow which includes things like a
  1137. 49:06decision log um and an agent daily log.
  1138. 49:10So everything that the agents do it
  1139. 49:12actually logs into a running narrative
  1140. 49:14of what it's doing. So it's always
  1141. 49:16observable and an action board which is
  1142. 49:20a cambban board where my agents talk to
  1143. 49:23each other and take work through a
  1144. 49:24workflow.
  1145. 49:26So all of these are literally just files
  1146. 49:29on my machine. There's not a single line
  1147. 49:31of code in any of this.
  1148. 49:36And
  1149. 49:40a big one is when you're thinking about
  1150. 49:43your team, what would your synthetic
  1151. 49:45team need to know, follow, and never
  1152. 49:49touch? So, if you had that idea of this
  1153. 49:52team member you'd like to bring in who
  1154. 49:55just happens to be synthetic,
  1155. 49:57what are the things that you need to
  1156. 50:00that need to know?
  1157. 50:06And whatever you're thinking of there,
  1158. 50:08that's the foundation. That's a lot of
  1159. 50:10the context. That's the material. So if
  1160. 50:12you had a human new starter in your
  1161. 50:14team,
  1162. 50:15what's the onboarding guide? What files
  1163. 50:18do you point them at? What history do
  1164. 50:20you give them? What do they need to know
  1165. 50:22about you?
  1166. 50:24The follow
  1167. 50:26is the playbook. How do you actually
  1168. 50:29work?
  1169. 50:30What are your ways of working?
  1170. 50:33What are your standards?
  1171. 50:35How does work get allocated and approved
  1172. 50:40as done?
  1173. 50:45And then there's the never touch or the
  1174. 50:49this is yours, but you can only use it
  1175. 50:50in this way. And that's the boundary.
  1176. 50:54So when you got clarity on that and you
  1177. 50:57don't need to have absolute clarity to
  1178. 50:58get started, but especially with one um
  1179. 51:02team member to start with, you can use
  1180. 51:03that as a way to start painting out the
  1181. 51:06picture of how should this thing hang
  1182. 51:08together and as a role that when you're
  1183. 51:10doing something like this that I reckon
  1184. 51:12is worth on boarding first because then
  1185. 51:14they end up being the thing that does
  1186. 51:18the work and helps you think through
  1187. 51:21things and guide you through it and
  1188. 51:24helps you look at the unintended
  1189. 51:26consequences of different decisions that
  1190. 51:29you might be making. But that chief
  1191. 51:32information and intelligence officer
  1192. 51:33CIO,
  1193. 51:35I use that role as my guide and that
  1194. 51:39actually turns everything into a
  1195. 51:41coherent system that learns and really
  1196. 51:44importantly self-heals. There's a whole
  1197. 51:46bunch of skills that I build up. So
  1198. 51:48that's a intentional loop as opposed to
  1199. 51:51something that happens accidentally or
  1200. 51:52only when something breaks. But it's uh
  1201. 51:56everything you've seen to this point,
  1202. 51:58all those files, you don't even need
  1203. 51:59them all. You just need a little bit
  1204. 52:01about who you are, how you like to work,
  1205. 52:03spin this um team member up, and then it
  1206. 52:08can guide you through the rest.
  1207. 52:11And so in terms of spinning up a team
  1208. 52:13member,
  1209. 52:15it can be as easy as just saying this is
  1210. 52:21who you are.
  1211. 52:23So no mega prompts. And I'm actually a
  1212. 52:27little bit anti-giving people prompts
  1213. 52:29because
  1214. 52:31when you copy prompts, you tend not to
  1215. 52:33think about what you're actually asking.
  1216. 52:34And 80% of that power of the interaction
  1217. 52:37is actually the thinking that goes into
  1218. 52:39it. and the principles and how to frame
  1219. 52:42what am I actually asking.
  1220. 52:45And so what that's just done is I just
  1221. 52:47said you're my demo CIO.
  1222. 52:51Now go set up your files. And I've got
  1223. 52:54some skills in the background. So it
  1224. 52:56knows what that means. And again, those
  1225. 52:59skills are literally just text files.
  1226. 53:02And then it's gone and created its
  1227. 53:04three-state file. So that team member
  1228. 53:06now has its context. And that's a bit of
  1229. 53:10a shell at the moment, but it has some
  1230. 53:11sections that it knows that it needs to
  1231. 53:13get more information on, including a
  1232. 53:15data library. It has its memory, which
  1233. 53:17it right now the only thing that's got
  1234. 53:20on its memory is I was just spun up. And
  1235. 53:23so that will live within the memory
  1236. 53:25file. And then it also has an archive
  1237. 53:28file, which we'll show you in a moment.
  1238. 53:31And so now there's a new team member.
  1239. 53:36And it literally just created those
  1240. 53:38three files. So they're text files
  1241. 53:40sitting on my hard drive. No line of
  1242. 53:42code, nothing stuck in the model,
  1243. 53:44nothing stuck in an app. Literally three
  1244. 53:46text files on my hard drive.
  1245. 53:49And so the during part is obviously when
  1246. 53:53things get more interesting. And one of
  1247. 53:56the other little projects I'm doing at
  1248. 53:57the moment is my Swiss meanderings. It's
  1249. 54:00a retrospective photo journal from my
  1250. 54:02various meanderings around Switzerland
  1251. 54:04and Montro Jazz Festival. And so I've
  1252. 54:08just said, "Go tell me about that
  1253. 54:10project. What is it? Where am I at?
  1254. 54:14What's happening?"
  1255. 54:16And it didn't have I didn't give it that
  1256. 54:18information. So it's now gone and
  1257. 54:20checked out another team member's work
  1258. 54:22who is the team member that's been
  1259. 54:24running all of this and said, "What is
  1260. 54:27this thing?" And it was able to do that
  1261. 54:28because there's a team directory. So it
  1262. 54:30was able to find Swiss Meanderings as
  1263. 54:32part of the team and project directory.
  1264. 54:34And now it's brought that across and I
  1265. 54:37can ask it some questions just to show
  1266. 54:38that it is actually getting primary
  1267. 54:41things. It's also getting things from
  1268. 54:43the internet. Um this time yesterday, no
  1269. 54:48this time 25 years ago I was in uh
  1270. 54:51Lashards and so after this session I
  1271. 54:55need to go write my next post and sort
  1272. 54:58through my photos from 25 years ago. So
  1273. 55:02all of this has happened without me
  1274. 55:04providing any real context. So there was
  1275. 55:06no rebriefing and everything it's done
  1276. 55:09it now knows and it knows in a durable
  1277. 55:11way and in a way where that information
  1278. 55:13stored on my hard drive.
  1279. 55:16The other thing is that I get and this
  1280. 55:20is a demo one. Um so it's going to be
  1281. 55:22some probably some weird cards on there
  1282. 55:24but this is actually in Obsidian. So I'm
  1283. 55:25not using Linear or Jira or Trello or
  1284. 55:29ClickUp or anything else. This is a
  1285. 55:32canban board completely textbased
  1286. 55:34sitting in Obsidian.
  1287. 55:35And each of my agents knows this is
  1288. 55:38where you go to get work. I've got
  1289. 55:40another role which is the chief of staff
  1290. 55:42who is the orchestrator of this board.
  1291. 55:43So that farms out work and it'll go
  1292. 55:47through everything that's in next
  1293. 55:49through to um work in progress. When it
  1294. 55:53thinks it's done, it'll move it to QA.
  1295. 55:56that then pings the QA role and the QA
  1296. 55:59then inspects it and does a test against
  1297. 56:03the acceptance criteria and definition
  1298. 56:05of done that was scoped out before it's
  1299. 56:08as it came out of the backlog and into
  1300. 56:09next. When the QA gives it a pass it
  1301. 56:13goes into review and that's when I then
  1302. 56:17review it and if I think it's good then
  1303. 56:20it goes to done. If I think it's not
  1304. 56:21good, I say to the chief of staff, you
  1305. 56:23need to sort something out here. And it
  1306. 56:25will go back and tell the team member
  1307. 56:26directly.
  1308. 56:28And so I'm the only person, again, I am
  1309. 56:31the human who is accountable. I'm the
  1310. 56:34only human that says, "Yes, this is
  1311. 56:36actually done." And marks as complete.
  1312. 56:40Again, no third party tools required for
  1313. 56:42that workflow. Agents talking to each
  1314. 56:44other, all sitting as text files. No
  1315. 56:47complex database, no extra
  1316. 56:48subscriptions.
  1317. 56:51And so
  1318. 56:53when you're mid session, it's got to end
  1319. 56:55at some point. And
  1320. 56:59making sure stuff gets written back is
  1321. 57:01really important. Otherwise, things are
  1322. 57:03trapped in the model until to a degree
  1323. 57:04until you do this step. So there's a
  1324. 57:07skill called /archive and that knows
  1325. 57:10then to go and update the context with
  1326. 57:13anything that's important.
  1327. 57:15the memory with a standard format
  1328. 57:17including next actions and decisions and
  1329. 57:20key insights from the session. And the
  1330. 57:24key thing it does is it creates a full
  1331. 57:26archive transcript. So one of the things
  1332. 57:28a lot of people don't know with these
  1333. 57:30apps is
  1334. 57:32they're not clouds synced that they are
  1335. 57:34on your hard drive. There's a little bit
  1336. 57:35different with codecs but not properly.
  1337. 57:38um extremely brittle with clawed. So all
  1338. 57:43of your conversation is in a hidden JSON
  1339. 57:45file on your hard drive. And for most
  1340. 57:48people that might not mean anything and
  1341. 57:50that's exactly why you should be scared
  1342. 57:51about it because it's a hidden system
  1343. 57:53file or a script. And that actually
  1344. 57:56contains the full transcript. And
  1345. 58:00without that, even when Claude does a um
  1346. 58:03compaction, quite often you can't scroll
  1347. 58:06up. So anything that happens before that
  1348. 58:08compaction you can no longer see let
  1349. 58:11alone if there's an app corruption or
  1350. 58:13any other uh device crash or anything
  1351. 58:15else that um does happen where all your
  1352. 58:18work can then be disappeared. So this
  1353. 58:21archive step means it's being written
  1354. 58:23back to that text file and now that text
  1355. 58:26file I've got synced into multiple
  1356. 58:27places across multiple devices including
  1357. 58:29my phone. So I can always see that
  1358. 58:32information and access it there.
  1359. 58:37And just to show that, so all these
  1360. 58:39other ones were in codeex/ chatgbt
  1361. 58:43and I've switched over to claude
  1362. 58:46opus 5 fresh model.
  1363. 58:50And so I've just been able to now
  1364. 58:53continue that session. I've spun it up
  1365. 58:55and said you're the demo CIO.
  1366. 58:59It's then picked up its state files from
  1367. 59:01the hard drive and then I can say to it
  1368. 59:04what's the last thing I asked you and it
  1369. 59:07continues as if it's the same team
  1370. 59:08member just now in a different model. So
  1371. 59:12I just switch from chat GBT to claude
  1372. 59:16and nothing changed. It's got all the
  1373. 59:18same context, all the same memory, the
  1374. 59:20same as if I had the same conversation
  1375. 59:22because it's got the full archive
  1376. 59:23threads. So it's all there ready to go.
  1377. 59:30So the big question, what work would you
  1378. 59:33love to be able to continue without
  1379. 59:35[laughter] having to explain everything
  1380. 59:38over and over again? And ideally,
  1381. 59:41whatever that piece of work is, if it
  1382. 59:43relates to what's that team member you'd
  1383. 59:45love to have, if they're in sync, then
  1384. 59:48you've probably got some pretty obvious
  1385. 59:50next things to do.
  1386. 59:55So, I'm going to fly through this
  1387. 59:57because we've sort of been talking about
  1388. 59:58it as we go. And so, this is probably
  1389. 1:00:00more for if you do want to refer back to
  1390. 1:00:02it and understand the layers and the
  1391. 1:00:04moving parts. But, as a good designer, I
  1392. 1:00:07start with design principles. And
  1393. 1:00:11because I like to go from strategy all
  1394. 1:00:13the way through to pixels, DevOps, and
  1395. 1:00:16AI, that actually becomes real and
  1396. 1:00:18becomes architecture. So the value and
  1397. 1:00:21design principles for this number one
  1398. 1:00:23said it many times but it is absolutely
  1399. 1:00:26critical is that the human is still
  1400. 1:00:29accountable no matter what we're the
  1401. 1:00:32ones on the hook
  1402. 1:00:35keeping and protecting that durable
  1403. 1:00:37layer. So all of that value that you
  1404. 1:00:39built up is then stored in files formats
  1405. 1:00:42and places you control not in the
  1406. 1:00:45interwebs. So being able to keep that
  1407. 1:00:48clean, controlled, but you still need to
  1408. 1:00:50do your backups obviously. Um, but
  1409. 1:00:53you've then in control of your own data
  1410. 1:00:55and all of that value that you created.
  1411. 1:00:58It's really important to make the
  1412. 1:01:00boundary explicit what AI can do, what
  1413. 1:01:03it can't do. And as part of that, I
  1414. 1:01:06think it's really important and it's
  1415. 1:01:08does take effort is that we keep all
  1416. 1:01:11that work that the agents and the
  1417. 1:01:13synthetic team are doing observable and
  1418. 1:01:15traceable. And that's why one I, you
  1419. 1:01:18know, it's one of the key reasons I have
  1420. 1:01:20that archive with the full transcript so
  1421. 1:01:22I know all the things I said and all the
  1422. 1:01:24things it said, all the outputs are
  1423. 1:01:26created and also things like the agent
  1424. 1:01:28daily log. So each team member is
  1425. 1:01:31literally writing to a daily log saying
  1426. 1:01:33I just did this piece of work which
  1427. 1:01:35means there's a record of it that I can
  1428. 1:01:37see but then other team members uh other
  1429. 1:01:39synthetic team members can see that as
  1430. 1:01:41well. a decision log if they are
  1431. 1:01:45explicit decisions where I say write
  1432. 1:01:46that to the log or there's actually some
  1433. 1:01:50thresholds where as we're talking about
  1434. 1:01:51things and decisions are actually
  1435. 1:01:53tacitly made I also have those written
  1436. 1:01:56off to a decision log as well so I can
  1437. 1:01:58always go back and go what was that
  1438. 1:02:00decision that we made and how did that
  1439. 1:02:02work key thing of keeping engine
  1440. 1:02:04swappable we don't want to be locked in
  1441. 1:02:06and hostage especially as these things
  1442. 1:02:09get more value um and they're more
  1443. 1:02:11likely to get more value from here than
  1444. 1:02:12less
  1445. 1:02:14um design for resilience. So it's very
  1446. 1:02:16safe to assume that tools will fail.
  1447. 1:02:19Things will crash. There will be model
  1448. 1:02:21changes. You will change your device. Um
  1449. 1:02:25pricing will change.
  1450. 1:02:28So making recovery actually part of the
  1451. 1:02:30system design and designing for that. So
  1452. 1:02:32it's not a surprise when it happens.
  1453. 1:02:34Those recovery paths are already um
  1454. 1:02:37natural and built in. A key one is that
  1455. 1:02:41building for regen. So all of that value
  1456. 1:02:43gets written back and then the reusable
  1457. 1:02:46pattern be um leaves you know is then
  1458. 1:02:49built on um so the system becomes
  1459. 1:02:51stronger over time. And if we optimize
  1460. 1:02:55for that compounding and we do real work
  1461. 1:02:57with it, we don't try and do it all at
  1462. 1:03:00once. We let that structure earn its
  1463. 1:03:03place. So you don't want to go too heavy
  1464. 1:03:05too soon, but you keep what works. you
  1465. 1:03:08write it back and then let the
  1466. 1:03:10compounding happen. And compounding is a
  1467. 1:03:12beautiful thing if it's taking you in
  1468. 1:03:13the right direction.
  1469. 1:03:17So that as a living loop
  1470. 1:03:22to try and talk about in simpler terms
  1471. 1:03:26is a quick fly through of the
  1472. 1:03:29foundation.
  1473. 1:03:32So that's all your data or your bits and
  1474. 1:03:34pieces. The playbook, what are the rules
  1475. 1:03:36of the game? How does the system
  1476. 1:03:38actually work? The boundary,
  1477. 1:03:40what's in and out, the engines are on
  1478. 1:03:43the outside of the boundary. They are
  1479. 1:03:44rented intelligence. They are not the
  1480. 1:03:47system.
  1481. 1:03:50the studio where all the fun stuff
  1482. 1:03:52happens, where I get to hang out with my
  1483. 1:03:54synthetic team and then I can then bring
  1484. 1:03:58us as a collective set to other people
  1485. 1:04:02that I collaborate with who also have
  1486. 1:04:03their synthetic teams. But then we get
  1487. 1:04:05to collaborate at that level rather than
  1488. 1:04:07trying to mash all the synthetic teams
  1489. 1:04:10and agents together.
  1490. 1:04:12The regen happens because it goes up and
  1491. 1:04:15it gets written back down. And then
  1492. 1:04:17through that playbook we get that
  1493. 1:04:19continuity.
  1494. 1:04:21And so
  1495. 1:04:24I'm going to fly through this.
  1496. 1:04:28The foundation, all the good stuff,
  1497. 1:04:31playbook,
  1498. 1:04:33the boundary,
  1499. 1:04:36the engines. This is all so you can
  1500. 1:04:38refer back to it if you want later.
  1501. 1:04:41and the studio.
  1502. 1:04:45And so some quick reflections
  1503. 1:04:48on what I've learned over the last
  1504. 1:04:52to one degree or another these
  1505. 1:04:53experiments have been in progress for 30
  1506. 1:04:55plus years. But the Genai specific parts
  1507. 1:04:58have been in play for about three and a
  1508. 1:04:59half years.
  1509. 1:05:01The number one thing which I've said
  1510. 1:05:03over and over, so hopefully you
  1511. 1:05:05understand. I think it's really
  1512. 1:05:06important is that
  1513. 1:05:08I when I'm working with my synthetic
  1514. 1:05:10team, I'm accountable for whatever it
  1515. 1:05:12does. The quality of the output, if it's
  1516. 1:05:14good, bad, or otherwise, I can't say the
  1517. 1:05:16computer did it. It's me and I'm the one
  1518. 1:05:19who is on the hook for that and
  1519. 1:05:21accountable.
  1520. 1:05:23There's so much change. there's so many
  1521. 1:05:25things to learn um that experimenting
  1522. 1:05:29with things rather than I won't make a
  1523. 1:05:31start until I've got the right time or
  1524. 1:05:34the right conditions um they'll never be
  1525. 1:05:37right and it's not going to get still so
  1526. 1:05:40jumping in experimenting playing with it
  1527. 1:05:43and embracing the reality which can be
  1528. 1:05:47inconvenient at times when progress is
  1529. 1:05:49nonlinear
  1530. 1:05:51so that are times when things crash or
  1531. 1:05:54features regret press or disappear or
  1532. 1:05:56models literally go offline. Um and so
  1533. 1:06:00that's going to continue to happen. So
  1534. 1:06:02one designing for that to be a reality
  1535. 1:06:04and how we um think about our workflows
  1536. 1:06:07and the um how critical that our
  1537. 1:06:10dependence is on some of these tools is
  1538. 1:06:14a really important things especially in
  1539. 1:06:16you know mission critical type
  1540. 1:06:18environments. We need to be mindful that
  1541. 1:06:21we can't assume everything's going to be
  1542. 1:06:23up all the time and working as we'd
  1543. 1:06:25hope. Every model still has this is an
  1544. 1:06:28experiment that makes mistakes. Um we've
  1545. 1:06:30I think most of us have become blind to
  1546. 1:06:32that little warning. Um but we're in a
  1547. 1:06:35global experiment and we are part of the
  1548. 1:06:39um model makers lab. Um this isn't a
  1549. 1:06:42finished product and they don't pretend
  1550. 1:06:44it is either.
  1551. 1:06:46One that is a hard lesson to learn,
  1552. 1:06:49remember, apply is that multitasking is
  1553. 1:06:53really expensive.
  1554. 1:06:55And it's something which over years and
  1555. 1:06:59decades of sort of built habits and
  1556. 1:07:02rituals and momentum around trying to
  1557. 1:07:05design for better focus and less
  1558. 1:07:08multitasking.
  1559. 1:07:10The nature of working with a synthetic
  1560. 1:07:13team can break that really quickly
  1561. 1:07:16because it's off paralleling your
  1562. 1:07:18thinking in multiple directions
  1563. 1:07:20sometimes at once. And as the human,
  1564. 1:07:24we're the slowest for a lot of this
  1565. 1:07:26stuff. And if we're going to stay as the
  1566. 1:07:30person who's actually accountable, then
  1567. 1:07:32we need to actually review it and not
  1568. 1:07:33get lazy and go good enough. The model
  1569. 1:07:36did it, so it must be right. And we'll
  1570. 1:07:37chuck it out with our name on it. I
  1571. 1:07:39again encourage no one to ever do that
  1572. 1:07:41or at least not for a long time yet. And
  1573. 1:07:45it means that task switching of looking
  1574. 1:07:46at what different team members are doing
  1575. 1:07:49and doing that in rapid succession. So
  1576. 1:07:52trying to build workflows around that
  1577. 1:07:54which is where the camb board and I'm
  1578. 1:07:56now not needing to be the glue that
  1579. 1:07:58paste things from one team member to
  1580. 1:08:01another. I can actually now have that
  1581. 1:08:04workflow managed more directly with a
  1582. 1:08:06separate QA role who I've told
  1583. 1:08:09explicitly or we've co-designed it often
  1584. 1:08:12what the acceptance criteria is. So when
  1585. 1:08:15I'm reviewing it, it's much less likely
  1586. 1:08:17to need rework and for me to be jumping
  1587. 1:08:19in and micromanaging and spoon feeding
  1588. 1:08:21the next step in a process. But as you
  1589. 1:08:24start out, um, there's the fear of being
  1590. 1:08:29kind of the thing, the bottleneck that's
  1591. 1:08:31holding everything up. And it will
  1592. 1:08:33probably be true, but finding a way to
  1593. 1:08:36not let that completely derail your ways
  1594. 1:08:38of working where you have built up good
  1595. 1:08:40habits.
  1596. 1:08:41Lots around data sovereignty and
  1597. 1:08:43stewardship. It's all running on our
  1598. 1:08:45data. How that data got there in the
  1599. 1:08:47first place. There's lots of question
  1600. 1:08:48marks and some of them aren't even
  1601. 1:08:50questions. um thinking about what that
  1602. 1:08:53might mean going forward,
  1603. 1:08:56the responsible AI, the ethical AI, uh
  1604. 1:08:59the climate impacts, these are all
  1605. 1:09:00things not to ignore. Um but I think
  1606. 1:09:03they're also things not to get freaked
  1607. 1:09:04out about and and wave our arms around
  1608. 1:09:06and therefore not play. I think the way
  1609. 1:09:09we play actually has a big degree in
  1610. 1:09:11shaping how some of these things are
  1611. 1:09:13made and what um patterns go forward and
  1612. 1:09:16which ones sort of get called out. That
  1613. 1:09:19might be overly optimistic, but that's
  1614. 1:09:20what I'm going to hold on to. And a key
  1615. 1:09:23one is, and it's probably come all the
  1616. 1:09:25way through, is resilience over lock in.
  1617. 1:09:28So, a lot of what I've been talking
  1618. 1:09:30about has been really filling product
  1619. 1:09:32gaps in the current version of the
  1620. 1:09:34products. Um, and a lot of that is
  1621. 1:09:37because a lot of those data gaps and
  1622. 1:09:39memory and things being backed up, etc.
  1623. 1:09:43have come because codeex and clawed code
  1624. 1:09:47came from development environments where
  1625. 1:09:49all of that was written back or most of
  1626. 1:09:50it was written back into repos um and
  1627. 1:09:53backed up to the cloud and there was a
  1628. 1:09:55lot of other backend infrastructure
  1629. 1:09:56there as they wrapped the skin around it
  1630. 1:09:59to make it more accessible to knowledge
  1631. 1:10:01workers who don't have that
  1632. 1:10:02infrastructure. They didn't bother
  1633. 1:10:04filling those product gaps. And so right
  1634. 1:10:07now it means filling those product gaps.
  1635. 1:10:10That's not going to last forever and are
  1636. 1:10:12already making big steps to try and sort
  1637. 1:10:15out memory and do a bunch of those
  1638. 1:10:17things. The way they're choosing to sort
  1639. 1:10:19that out, of course, is so you put even
  1640. 1:10:22more of your stuff into their platform.
  1641. 1:10:24They hold it for you nice and safe, but
  1642. 1:10:26they're the only ones that hold it nice
  1643. 1:10:28and safe. And so you get product lock in
  1644. 1:10:31and you're a hostage to their platform.
  1645. 1:10:33And as they make changes, and they
  1646. 1:10:34already are and have, as they change
  1647. 1:10:37their pricing, as they change different
  1648. 1:10:38ways of operating, if you want to be
  1649. 1:10:40able to access your stuff and keep all
  1650. 1:10:42the value that you built up, you've got
  1651. 1:10:45no real choice but to use their
  1652. 1:10:47platform. Um, so I don't want to be in
  1653. 1:10:51that situation and I recommend most
  1654. 1:10:53people don't want to be in that
  1655. 1:10:54situation. So designing around that so
  1656. 1:10:57there's no single point of failure in
  1657. 1:10:58the tools, the different providers of
  1658. 1:11:01the platforms or their pricing models as
  1659. 1:11:03they change.
  1660. 1:11:05And so the big question
  1661. 1:11:08cuz that was a blah of a lot of stuff
  1662. 1:11:10and there's probably going to be some
  1663. 1:11:11things to unpack.
  1664. 1:11:13But to get started,
  1665. 1:11:17what's one real piece of work where you
  1666. 1:11:19could test this? Not have it all
  1667. 1:11:21magically working. So test and it could
  1668. 1:11:25you know ideally in a safe to fail way
  1669. 1:11:26where it's a safe place to experiment
  1670. 1:11:28learn some stuff and be able to iterate.
  1671. 1:11:32Have you got anything in mind where you
  1672. 1:11:34go I reckon I'll use it in this way? You
  1673. 1:11:37might have your own music meanderings
  1674. 1:11:39where it's a creative project off the
  1675. 1:11:41side but all went sideways no one's
  1676. 1:11:44going to be impacted. No critical data
  1677. 1:11:47is lost.
  1678. 1:11:49If you can think of some things like
  1679. 1:11:51that within your life and whole of life,
  1680. 1:11:54it doesn't all have to be business and
  1681. 1:11:55workrelated, then that's probably a good
  1682. 1:11:59place to start. And starting with
  1683. 1:12:02something nice and simple and safe,
  1684. 1:12:04building things some things up around
  1685. 1:12:05it. See what's working, what's not
  1686. 1:12:07working. And as you feel comfortable
  1687. 1:12:11with the way it does certain things and
  1688. 1:12:13how you're um backing up data and what
  1689. 1:12:16that whole experience feels like, then
  1690. 1:12:18you might choose to give it more. But
  1691. 1:12:21not giving the models and the apps all
  1692. 1:12:23your things all at once. I would
  1693. 1:12:25definitely recommend against that. Um so
  1694. 1:12:27thinking about what's that real thing
  1695. 1:12:29that you could do, but nice and slow.
  1696. 1:12:33So stuff you could do next is what is
  1697. 1:12:38that thing that's you know it's valuable
  1698. 1:12:40but it's and it's real but it's not
  1699. 1:12:43necessarily um high risk if anything
  1700. 1:12:46goes a bit weird with it. If you create
  1701. 1:12:49one little folder and workspace so you
  1702. 1:12:51don't need to do a a yearong curation of
  1703. 1:12:55all your data sets and get them all nice
  1704. 1:12:57and clean before you start. But just
  1705. 1:12:59start with the data that's you need and
  1706. 1:13:01you feel um okay or good about putting
  1707. 1:13:04into the models into the neural network.
  1708. 1:13:08Write that simple context. Save some
  1709. 1:13:10useful stuff. And again, all of this is
  1710. 1:13:13in the context of using the desktop app.
  1711. 1:13:16You won't be able to do a lot of this
  1712. 1:13:17and get the same kind of value out of it
  1713. 1:13:19if you're still using it in the browser.
  1714. 1:13:23But think about the principles of I want
  1715. 1:13:25to be able to see what it's actually
  1716. 1:13:27done. what work did it do? What
  1717. 1:13:29decisions did it make? Did I agree with
  1718. 1:13:31that decision? Did it operate within
  1719. 1:13:33what I think are safe boundaries? So,
  1720. 1:13:36being able to set up um a way to then
  1721. 1:13:38build that and then the stuff that's
  1722. 1:13:40working, you keep using and you turn
  1723. 1:13:44those into skills. Riley mentioned
  1724. 1:13:45before, there's lots of ways to create
  1725. 1:13:47skills now. That could be, you know,
  1726. 1:13:49copying a workflow is through a screen
  1727. 1:13:51record, which is they're doing natively
  1728. 1:13:52now. It can literally be I just had a
  1729. 1:13:55conversation with you and we created
  1730. 1:13:56this output. Now reverse engineer the
  1731. 1:13:59good version of that back into a skill
  1732. 1:14:00that's reusable. Uh which is the method
  1733. 1:14:02that I still use cuz I don't have much
  1734. 1:14:04repeatable stuff to screen record. So
  1735. 1:14:07the key thing is to start with one real
  1736. 1:14:10workflow
  1737. 1:14:11and then let the structure earn its
  1738. 1:14:13place from there.
  1739. 1:14:15And so
  1740. 1:14:17this has all been about the principles
  1741. 1:14:19and the shape.
  1742. 1:14:21Um, but if you want some help navigating
  1743. 1:14:25all of this and doing a personalized
  1744. 1:14:27version where it's designed around the
  1745. 1:14:30way you work, your goals or your data,
  1746. 1:14:32the risk profile, um, then happy to have
  1747. 1:14:35a chat and also curious if that's um,
  1748. 1:14:39you know, there's different versions of
  1749. 1:14:40this I'm thinking of doing depending on
  1750. 1:14:42where there's interest. Um this is
  1751. 1:14:45definitely where it starts crossing over
  1752. 1:14:46into the the paid version of things
  1753. 1:14:48rather than the free online workshop.
  1754. 1:14:50But there's versions where doing this as
  1755. 1:14:54um sort of onetoone or with a team in
  1756. 1:14:56sort of more organizational context or
  1757. 1:14:59even doing like a a buildalong session
  1758. 1:15:01as sort of a uh online where guiding you
  1759. 1:15:05through your own but in sort of a group
  1760. 1:15:06setting. Um so there's a few different
  1761. 1:15:08options there. ways I'm looking at
  1762. 1:15:11possibly taking it forward depending on
  1763. 1:15:14what people are interested in.
  1764. 1:15:17So, that's the fire hose.
  1765. 1:15:21There was plenty of good stuff in the
  1766. 1:15:22chat.
  1767. 1:15:25Any questions that have come up that are
  1768. 1:15:27burning,
  1769. 1:15:28even if they're not burning?
  1770. 1:15:32I thought there was two um pretty
  1771. 1:15:34interesting ones. Uh well uh one was um
  1772. 1:15:38how do you start in terms of you've got
  1773. 1:15:40skills behind some of that um some of
  1774. 1:15:43the work that you were already getting
  1775. 1:15:44when you got it to spin up its own
  1776. 1:15:46little um uh sort of on boarding
  1777. 1:15:48essentially for whatever that new sort
  1778. 1:15:50of agent was.
  1779. 1:15:51>> Um so yeah what would you say to uh
  1780. 1:15:54would be the first thing you would start
  1781. 1:15:55with? Should you would you start with a
  1782. 1:15:57skill or would you start with another
  1783. 1:15:58way or or something like that?
  1784. 1:16:01So, one way is I can share my version of
  1785. 1:16:04it. Um, and at least the headings
  1786. 1:16:08because the specifics is where it gets
  1787. 1:16:11less valuable. Um, the key thing is if
  1788. 1:16:14you even just say to a synthetic team
  1789. 1:16:18member, you are my guide. help me do
  1790. 1:16:22this and interview me to work out what's
  1791. 1:16:25important and then you can and that's
  1792. 1:16:29how I built my different ones. So I
  1793. 1:16:32didn't start with like a master plan and
  1794. 1:16:34go it should do this this and this. It's
  1795. 1:16:36happened iteratively and organically
  1796. 1:16:38over time and then reverse engineered
  1797. 1:16:41into a school a skill that's repeatable.
  1798. 1:16:43And so a lot of this is not about trying
  1799. 1:16:46to get it right on the first shot. And
  1800. 1:16:49there are loads of different skill
  1801. 1:16:50libraries and stuff that you can go and
  1802. 1:16:52download. Um that can be useful if it's
  1803. 1:16:55a like a really repeatable common task.
  1804. 1:16:58Um but a lot of the value is actually in
  1805. 1:17:00the thinking, not the specific text
  1806. 1:17:03files. So being able to have that
  1807. 1:17:04interaction with your agent and get it
  1808. 1:17:07to ask you questions um is where a lot
  1809. 1:17:11of the value is. And then it's making
  1810. 1:17:14something that's repeatable. Repeatable,
  1811. 1:17:16but not trying to make it repeatable for
  1812. 1:17:18step one.
  1813. 1:17:22Awesome. Yeah, I got it to interview me
  1814. 1:17:24more than once, but yeah. Um, I think
  1815. 1:17:26that that's a good way to do it. Um, cuz
  1816. 1:17:28I can talk off the top of my head about
  1817. 1:17:30something, but like it takes me a little
  1818. 1:17:32bit of time to write it down. [laughter]
  1819. 1:17:35And and I'm sure everyone's seen now
  1820. 1:17:37like if you can get comfortable talking
  1821. 1:17:39to your device um you can do that in
  1822. 1:17:42dictation mode. You can now do it with
  1823. 1:17:44the models with the real-time text mode.
  1824. 1:17:48Um there's tools like whisper flow. Um
  1825. 1:17:51there's a Google one as well that they
  1826. 1:17:53released a few months ago. There's lots
  1827. 1:17:55of options which can if your natural way
  1828. 1:17:58of processing is verbally then that can
  1829. 1:18:03be a very um quick way to get a lot of
  1830. 1:18:05volume um out of your head. Personally
  1831. 1:18:09I'm of the school of I write to think
  1832. 1:18:12and so I don't have quite the same level
  1833. 1:18:17of experience with it. Uh I do use it
  1834. 1:18:19for some stuff, but um yeah, being able
  1835. 1:18:21to have that um quick interaction and
  1836. 1:18:25for it to iterate over time, that's the
  1837. 1:18:29key thing. So I'm still now like
  1838. 1:18:31literally today saying to my so it's
  1839. 1:18:35doing this you're not printing the you
  1840. 1:18:37know threads aren't printing the date
  1841. 1:18:38properly like they were what's going on
  1842. 1:18:40and it'll go find the root cause for me
  1843. 1:18:42go h we need to strengthen up that rule
  1844. 1:18:45here and do you approve this rule and
  1845. 1:18:47then I say yes and it goes and rewrites
  1846. 1:18:49um into a text file so you know it's
  1847. 1:18:52constantly being iterated um but it is
  1848. 1:18:55having it's more about the mindset and
  1849. 1:18:58having that approach to it than it just
  1850. 1:18:59having a perfect prompt.
  1851. 1:19:02>> Yeah. Great. Um, another one was, "How
  1852. 1:19:06many hours do you think you put into to
  1853. 1:19:08the point of actually getting positive
  1854. 1:19:10compounding return?"
  1855. 1:19:14>> Yes, good question, Jess. Um,
  1856. 1:19:17to start seeing some return, it's it's a
  1857. 1:19:20hard one to answer because when I
  1858. 1:19:22started, the models were about 1% of the
  1859. 1:19:25capability and and the apps around them
  1860. 1:19:27of what they are now. Um, so it's been 3
  1861. 1:19:32and 1/2 years of constant
  1862. 1:19:34experimentation
  1863. 1:19:35and a lot of those experiments were
  1864. 1:19:38extremely frustrating and no value
  1865. 1:19:41return. The value return has been
  1866. 1:19:44understanding how things have worked and
  1867. 1:19:45and the deeper knowledge and experience
  1868. 1:19:47around that. It's now at the point where
  1869. 1:19:50you could spend a day or two, even less
  1870. 1:19:54to start getting some value immediately
  1871. 1:19:58to get a a fuller system built out.
  1872. 1:20:01That's, you know, a few hours over a few
  1873. 1:20:04weeks and months. But to have one thing
  1874. 1:20:07done well, that's probably a few hours
  1875. 1:20:11now with a little bit of base
  1876. 1:20:12infrastructure as a starting point.
  1877. 1:20:17Yeah, I would agree on the pretty quick
  1878. 1:20:19turnaround. Um, I've just changed jobs
  1879. 1:20:21and I've rebuilt my own little one at
  1880. 1:20:23work that I've just started as a brand
  1881. 1:20:25new sort of instance and yeah, it didn't
  1882. 1:20:27take me more than
  1883. 1:20:30yeah, half like not even a couple of
  1884. 1:20:32hours. Um, yeah, but probably about
  1885. 1:20:33three or four three or four hours I'd
  1886. 1:20:35say. Um yeah,
  1887. 1:20:38so it's my own personal onboarding
  1888. 1:20:40system to the company as well cuz I kind
  1889. 1:20:41of had to gather some enough internal
  1890. 1:20:43information to be able to kind of you
  1891. 1:20:45know um uh on board myself and so at the
  1892. 1:20:47same time I just onboarded you know
  1893. 1:20:49essentially a new nent kind of OS as
  1894. 1:20:53well starting to anyway
  1895. 1:20:56um does any
  1896. 1:20:57>> one of sorry uh just a quick one
  1897. 1:21:00something we were talking about the
  1898. 1:21:00other day Jess um that makes a huge
  1899. 1:21:03difference is when you're setting
  1900. 1:21:05setting up when you're on boarding and
  1901. 1:21:07you sort of mentioned a little bit there
  1902. 1:21:08Riley when you're on boarding and you're
  1903. 1:21:10setting up your context
  1904. 1:21:12it's makes a massive difference if you
  1905. 1:21:14go through a step of actively creating a
  1906. 1:21:16data library as part of your context
  1907. 1:21:18file. So curating that a bit not as in
  1908. 1:21:22you need to go get all the files and put
  1909. 1:21:24them in one place but getting the the
  1910. 1:21:28model to go within the boundaries that
  1911. 1:21:30you've said of go have a look around
  1912. 1:21:32here and then do a bit of a review of
  1913. 1:21:36the data it's found and the different
  1914. 1:21:38sources to go yes this is current and
  1915. 1:21:40reliable this should have a higher
  1916. 1:21:42waiting than this other thing from 3
  1917. 1:21:45years ago under a whole bunch a whole
  1918. 1:21:47different strategy. So that effort in um
  1919. 1:21:51just reviewing and curating the data
  1920. 1:21:53library bits means that you got a much
  1921. 1:21:56higher quality base and context than
  1922. 1:21:57build off um and it's you get a lot less
  1923. 1:22:00drift and um also helps with the context
  1924. 1:22:03window but won't go into that side of
  1925. 1:22:06things.
  1926. 1:22:08>> Cool.
  1927. 1:22:12>> Jesse, did you have a spot? Sorry.
  1928. 1:22:15>> Sure. Thanks. I was nervous I was going
  1929. 1:22:17to um take up time and go down a rabbit
  1930. 1:22:19hole. But so yeah, I played with that
  1931. 1:22:21data library idea for about 2 hours on
  1932. 1:22:23the weekend. What I found was with
  1933. 1:22:25co-pilot, it kept coming back saying,
  1934. 1:22:27"Yeah, yeah, I can see it all." And so
  1935. 1:22:30what was your phrase, Ben? Trust and but
  1936. 1:22:33verify. No.
  1937. 1:22:35>> Yes. KGB phrase.
  1938. 1:22:37>> KGB phrase. Right. So I [laughter] was
  1939. 1:22:39like, "Okay, well uh tell me what's in
  1940. 1:22:41that document." And I I I I I think I
  1941. 1:22:45eventually realized that it couldn't
  1942. 1:22:46actually really see what was in the
  1943. 1:22:48company SharePoint. Um so so but I was
  1944. 1:22:53still learning um um the the
  1945. 1:22:57interaction. So I I still got something
  1946. 1:22:59out of it, but I still don't know if
  1947. 1:23:02technically it can see the things I want
  1948. 1:23:03it to see. Yeah.
  1949. 1:23:05>> Yeah. And and that's a good example of
  1950. 1:23:07the 2025
  1951. 1:23:092024 version of a lot of these
  1952. 1:23:11experiments uh where
  1953. 1:23:15with co-pilot uh Microsoft copilot
  1954. 1:23:18you're probably still in a situation
  1955. 1:23:20where you'll need to curate those files
  1956. 1:23:23into a safe place and say look at that
  1957. 1:23:26um because it's a bit weak on doing
  1958. 1:23:29stuff that the other models are able to
  1959. 1:23:31do. But if if you do the show me what's
  1960. 1:23:34in it and it comes back with sensible
  1961. 1:23:36stuff, then you know that's part of that
  1962. 1:23:38test and learn of you're saying one
  1963. 1:23:41thing but show me evidence of that
  1964. 1:23:42before I believe that and start doubling
  1965. 1:23:44down on it. Um otherwise definitely in
  1966. 1:23:47hallucination land.
  1967. 1:23:48>> Yeah, love it. Thanks. [laughter]
  1968. 1:23:53>> Cool. Um probably got time for one one
  1969. 1:23:55more question. U what have you so I've
  1970. 1:23:59got a couple here but um what have you
  1971. 1:24:03tried the Australian sovereign AI model
  1972. 1:24:07um from uh trailers data trail data is
  1973. 1:24:11that you think no I haven't I haven't
  1974. 1:24:14played with any of the um local models
  1975. 1:24:20um
  1976. 1:24:21it's something that sort of keeping an
  1977. 1:24:23eye on But I have intentionally taken
  1978. 1:24:28predominantly a non- tech approach to
  1979. 1:24:31Gen AI. Um, all of my experiments over
  1980. 1:24:34the last three and a half years, I've
  1981. 1:24:36stayed away from having to do anything
  1982. 1:24:38that's starting to get into code or
  1983. 1:24:40repos or stuff that I do when I'm
  1984. 1:24:43designing and building digital product,
  1985. 1:24:45but not stuff that I want to do in a Gen
  1986. 1:24:48AI context because I know how fast it's
  1987. 1:24:51moving and I see a lot of that's going
  1988. 1:24:53to be obsolete before um, it's valuable
  1989. 1:24:57and then it just builds up the overhead
  1990. 1:24:59of trying to learn and manage all this
  1991. 1:25:01stuff. Anyway, um but I think the at a
  1992. 1:25:03principal level and a conceptual level
  1993. 1:25:05of the sovereign versions of models, I
  1994. 1:25:09think it's going to be
  1995. 1:25:12over the next 6 to 12 months one of the
  1996. 1:25:14hottest topics, especially now that
  1997. 1:25:16we've had um the US government ban and
  1998. 1:25:21make Anthropic take Fable 5 offline for
  1999. 1:25:24a few weeks.
  2000. 1:25:26um they have said that they now want to
  2001. 1:25:29early um view of new models models being
  2002. 1:25:34released. Australia has talked about
  2003. 1:25:36doing a similar thing. Um OpenAI has
  2004. 1:25:40talked about giving uh the US government
  2005. 1:25:435% shares which does that accelerate
  2006. 1:25:47preference actually put up guard rails.
  2007. 1:25:50All of these things are not really
  2008. 1:25:52known. Um so having access to the stuff
  2009. 1:25:57that we need and when we need it is
  2010. 1:26:01definitely um in flux at the moment. Uh
  2011. 1:26:03and then in the last week as well a lot
  2012. 1:26:06of the couple of the Chinese open source
  2013. 1:26:08models are performing near benchmark of
  2014. 1:26:11um opus 4.8. So pretty much Frontier
  2015. 1:26:15model with the um the weights and and
  2016. 1:26:19being open source, but you need a
  2017. 1:26:21there's about 2 tab of data for to be
  2018. 1:26:25able to tink with the weights and run it
  2019. 1:26:27locally. So it's not yet at the point
  2020. 1:26:28where it's light enough to really be
  2021. 1:26:31able to um use it for most people. But I
  2022. 1:26:34think that side of things, the sovereign
  2023. 1:26:36aspect, the offline, the open source,
  2024. 1:26:39um, are all conversations that are going
  2025. 1:26:40to ramp up even more over the next six
  2026. 1:26:42to 12 months. And that's also part of
  2027. 1:26:45the design principle that I've built
  2028. 1:26:46around here is those engines are
  2029. 1:26:48swappable. And so I'm hanging out for
  2030. 1:26:51the time when I can be truly offline and
  2031. 1:26:54have a local model that can do the bulk
  2032. 1:26:57of what I need and I'm not actually even
  2033. 1:26:59needing the internet to be up anymore.
  2034. 1:27:01Um, and I reckon that's no more than 12
  2035. 1:27:03months away.
  2036. 1:27:07>> Awesome. Thank you so much for your time
  2037. 1:27:09uh tonight, Ben, and sharing your uh
  2038. 1:27:11your setup and what you've learned along
  2039. 1:27:12the way. Um, it was uh great to have you
  2040. 1:27:16uh back and hopefully um uh you get some
  2041. 1:27:19uh yeah, uh anyone who's keen to uh find
  2042. 1:27:22out more, then we can um certainly, you
  2043. 1:27:25know, follow this up um uh with Ben and
  2044. 1:27:28find out what he's doing. Um, and
  2045. 1:27:30>> and if and if you hit that QR code, um,
  2046. 1:27:33you can book a discovery call, but you
  2047. 1:27:35can also see music meanderings and photo
  2048. 1:27:38meanderings. Um, so if you curious about
  2049. 1:27:41what these little projects are, you'll
  2050. 1:27:43see that on that same QR code because it
  2051. 1:27:45goes to my link tree.
  2052. 1:27:48>> Bonus bonus ad there. [laughter]
  2053. 1:27:51>> Um, thank you very much. We will follow
  2054. 1:27:53this up with a um the recording um all
  2055. 1:27:56things being equal at the end of this uh
  2056. 1:27:58when we hang up. Um but [laughter] yeah,
  2057. 1:28:01join me in thanking Ben and um yeah,
  2058. 1:28:05>> awesome.
  2059. 1:28:06>> Thank you very much.
  2060. 1:28:07>> Thanks everyone. Great to see you all
  2061. 1:28:09and uh more soon.

About this transcript

This page contains the full transcript of Build Your AI Operating System: Regen OS. Human-Centred AI Community Workshop by Ben Pecotich by Dynamic4, generated from the public captions YouTube serves with the video. The transcript has 14,134 words across 2,061 segments, with the original timestamps preserved so you can click any line to jump to that moment in the embedded player.

What you can do with it

Use the transcript to take notes, quote the speaker, build a study guide, generate a summary with ChatGPT or Claude via the YouTube Summary tool, or export it as a timed subtitle file with YouTube to SRT. You can also re-open it in the transcriber to translate the transcript into 100+ languages.

Free YouTube transcript tool

YouTube2Text is a free YouTube transcript generator — no signup, no daily limit. Paste any YouTube link and get the full transcript instantly, with timestamps, click-to-jump, translation to 100+ languages, AI prompts for ChatGPT, Claude, and Gemini, and exports to TXT, SRT, VTT, or Markdown.