YouTube2Text

Opus 5.5 is proof that we do need smarter models — Transcript

by Theo - t3․gg · 6,476 words · 904 segments · language en · Watch on YouTube

Full transcript

  1. 0:00I'm going to be real with y'all. AI's
  2. 0:01gotten pretty damn smart. It's a hell of
  3. 0:03a lot smarter than I ever thought it
  4. 0:04would be. Just 2 years ago, a blond guy
  5. 0:07with a mustache that somehow had access
  6. 0:09to this YouTube channel did a video
  7. 0:10called AI isn't going to keep improving
  8. 0:12where he relatively confidently asserted
  9. 0:15that we were going to hit a plateau with
  10. 0:16how intelligent AI could get that would
  11. 0:19make the improvements more and more
  12. 0:21marginal as we tried using these new
  13. 0:23tools. I made that video before Opus 4.5
  14. 0:26was even in training and the amount
  15. 0:28things have changed since then is truly
  16. 0:31hard to comprehend. We went from AI that
  17. 0:33could auto-complete when we were typing
  18. 0:35occasionally to being able to ask real
  19. 0:37questions about our code base, tell it
  20. 0:39which files to edit, and now we're at
  21. 0:41the point where we just handed a
  22. 0:42screenshot of a bug and trust it to
  23. 0:44figure it out and test it and get it
  24. 0:45merged. It's crazy. But with all that,
  25. 0:48my take changed a bit. I went from
  26. 0:50thinking that it wouldn't keep getting
  27. 0:51smarter to something a bit more bold. I
  28. 0:54started to think we might not need them
  29. 0:56to be smarter. And I felt this many
  30. 0:58times when new models drop. It's like,
  31. 1:00"Oh, this is so much better. I can
  32. 1:02barely figure out how to take advantage
  33. 1:04of this level of intelligence. I have no
  34. 1:06idea why we would want anything
  35. 1:08smarter." I felt this with Fable 5 and
  36. 1:11Opus 5.5 has changed my mind. Not just
  37. 1:14because it is better at doing the things
  38. 1:16I do every day or it's faster or it's
  39. 1:18cheaper, but because it's smarter. And I
  40. 1:20don't just think this is better for
  41. 1:22coders, I think it's better for a lot
  42. 1:24more people than I ever would have
  43. 1:26guessed. I used to think that these
  44. 1:28model improvements were only going to
  45. 1:29really benefit a select set of people
  46. 1:31who were always on this bleeding edge
  47. 1:33pushing the limits of what they're
  48. 1:34capable of.
  49. 1:36I was wrong. And the reason my mind
  50. 1:37changed on this is sillier than you
  51. 1:39probably think.
  52. 1:46Yes, it's Halo and Call of Duty. While
  53. 1:48I'll gladly admit I'm a sucker for
  54. 1:50skateboarding stuff, I do think this
  55. 1:52represents a huge shift where models
  56. 1:54getting more capable is going to benefit
  57. 1:57a hell of a lot more people than just
  58. 1:59software devs. Let me explain why
  59. 2:01everyone will benefit from this after a
  60. 2:03quick word for today's sponsor. I know
  61. 2:05this is supposed to be an ad, but I want
  62. 2:06to give a real quick history lesson.
  63. 2:07Back when AI first started getting
  64. 2:09attention, it was to answer basic
  65. 2:10questions using the knowledge that it
  66. 2:12had. It progressed very quickly to the
  67. 2:14point where we were using it to edit
  68. 2:15files on our computers using tools like
  69. 2:17Claude code. I think we're about to
  70. 2:18enter a third era, an era where the
  71. 2:20agents aren't just working within the
  72. 2:22little box of the website they're on or
  73. 2:24the computer that we're running our
  74. 2:25systems in. They're going to start doing
  75. 2:27real work for us. But in order to do
  76. 2:29that, they need to be able to get out
  77. 2:30and do things on the web, which means
  78. 2:33they need a platform that supports this.
  79. 2:35Today's sponsor is browserbase, and man,
  80. 2:36I wish all the personal assistants I
  81. 2:38used were using them. There's a lot of
  82. 2:40layers to why I think browserbase is the
  83. 2:42best way for your agents to do things on
  84. 2:43the internet, but I'll start with one
  85. 2:45that has been really frustrating as I've
  86. 2:46leaned more into Grok Bot,
  87. 2:48authentication. When I want to let my
  88. 2:49Grok Bot access a service that isn't
  89. 2:51already a plugin, I have to let it spin
  90. 2:53up a computer in the cloud, open it up
  91. 2:55myself, go to the webpage, and sign in.
  92. 2:57But if they were using browserbase, I
  93. 2:58could link my one password account, and
  94. 3:00it's handled for me. Not only can
  95. 3:02browserbase handle the sign-in, they can
  96. 3:04also handle the management of your
  97. 3:06sessions and persisting them so that
  98. 3:07your agent doesn't have to sign in again
  99. 3:09every single time it makes a request. I
  100. 3:11know this sounds trivial, but you have
  101. 3:12no idea how much everyone else is
  102. 3:14getting this wrong, even the major labs
  103. 3:16into their personal assistant tools.
  104. 3:17That's all great for the signed-in
  105. 3:18experience, but a lot of what your
  106. 3:20agents do is finding things on the web
  107. 3:21and accessing them. That's why the
  108. 3:23search API is so useful to get a bunch
  109. 3:25of results that your agent might need,
  110. 3:26as well as the fetch API, which will
  111. 3:28turn those results and pages into HTML,
  112. 3:30JSON, or markdown. This is way more
  113. 3:31reliable than a curl will ever be.
  114. 3:33Considering that 85% of APIs on the web
  115. 3:36cannot be accessed via curl, this all
  116. 3:39comes together with a really, really
  117. 3:40powerful experience. Unlock your agents
  118. 3:42and see what they can do at
  119. 3:43toydev.link/browserbase.
  120. 3:45While I could sit here all day and watch
  121. 3:46all of my favorite childhood games get
  122. 3:48reverse engineered, decompiled, and
  123. 3:50mashed together in these crazy ways.
  124. 3:53This is just like the tip of the iceberg
  125. 3:55in a lot of ways, and I'm realizing this
  126. 3:58stuff goes a lot further than I would
  127. 4:00ever have guessed, especially for people
  128. 4:02who might not be engineers. It's
  129. 4:04genuinely kind of silly that it took all
  130. 4:06of these game mash-ups to make me
  131. 4:08realize that everyone can benefit from
  132. 4:10smarter models, but it it really made it
  133. 4:13click for me. And then there's a couple
  134. 4:15different angles to this. The most
  135. 4:17obvious one is the one that we've all
  136. 4:19been living with for a while now.
  137. 4:22Smarter models means devs can make
  138. 4:24better software faster. This has been
  139. 4:26the case, honestly, since like Sonic 4,
  140. 4:30that AI could allow developers to take
  141. 4:32their roadmap, their plans, the things
  142. 4:33they were going to build, and get
  143. 4:35through those faster and deliver
  144. 4:37software their users want more
  145. 4:39effectively than they could have before.
  146. 4:41And as models have continued to get more
  147. 4:43capable at dev stuff, the amount that a
  148. 4:46dev can do has gone up exponentially.
  149. 4:48I'm shipping more code in a week than I
  150. 4:49shipped in all of last year at this
  151. 4:51point. It's crazy. And I know it's all
  152. 4:54slop or whatever. You guys are just
  153. 4:55wrong at this point. Half the code that
  154. 4:57my AI is writing for me is better than
  155. 4:59all the code you've written in your life
  156. 5:00if you actually think that way. Like
  157. 5:01it's insane how far these things have
  158. 5:03gotten and how capable they are at
  159. 5:05making good decisions and doing real
  160. 5:06work. That is all good and dandy, but
  161. 5:09we're still presuming that the person
  162. 5:11has experience because that is kind of
  163. 5:14necessary to get the most most out of
  164. 5:16these tools. So, devs can do all of
  165. 5:18these things, and when they do these
  166. 5:20things and make better software, people
  167. 5:22benefit because they can use the
  168. 5:24programs that might not have been worth
  169. 5:26building before. For a silly example of
  170. 5:28this, I built a service called Lawn. I
  171. 5:30was using Frame.io, and I was getting
  172. 5:32more and more frustrated with how slow
  173. 5:34it was, with how expensive it was, with
  174. 5:36how Adobe it was starting to feel, and
  175. 5:39how annoying it was to just send a quick
  176. 5:40link to one of the brands that we're
  177. 5:42working with for a review and stuff like
  178. 5:43that. So, I threw together an
  179. 5:45open-source alternative myself in a few
  180. 5:47days, and it works great. This is how we
  181. 5:49do all of our video for my team now. For
  182. 5:52reference, Frame.io was acquired by
  183. 5:54Adobe for 1.3 billion dollars in October
  184. 5:57of 2021, and I would legitimately say we
  185. 6:00have about 70% of their functionality
  186. 6:03that they had at that acquisition point,
  187. 6:05as well as a ton of extra things that
  188. 6:07they still don't have today. That was
  189. 6:09considered a 1.3 billion-dollar product
  190. 6:12not that long ago, and now at the
  191. 6:14beginning of the year, I was able to
  192. 6:16recreate it and open source it cuz why
  193. 6:19not? All trivially.
  194. 6:22It's crazy how viable these types of
  195. 6:25things are when before they just
  196. 6:26absolutely weren't. And that was with
  197. 6:29like Gemini 3 Pro and Opus 4 6. Do you
  198. 6:33know how much it's improved since then?
  199. 6:34It's crazy. And I didn't even need to
  200. 6:36reverse engineer anything for this
  201. 6:38because the way the core product works
  202. 6:39made a lot of sense. It was just all the
  203. 6:41integrations and like edges you have to
  204. 6:42hit to make it work that made it hard.
  205. 6:44But that's the program I built that a
  206. 6:46lot of others have benefited from. It's
  207. 6:48not like a huge product, but there's a
  208. 6:49few hundred people that use Lawn to
  209. 6:52power their video pipelines for a lot of
  210. 6:53YouTube channels that you and I both
  211. 6:55watch, which is super super cool. And
  212. 6:57people even been forking it and building
  213. 6:58their own things on top. And that was
  214. 7:00where the next layer started for me. So
  215. 7:02you already have professional devs are
  216. 7:04able to make better software with
  217. 7:06smarter models, but the next piece I've
  218. 7:08been seeing I'll call technical people.
  219. 7:12There's no good term for this cuz I
  220. 7:13don't want to be like offensive. It's
  221. 7:15the types of people who like maybe they
  222. 7:16played with code a bit and just decided
  223. 7:18it wasn't for them. They're very smart,
  224. 7:20they're very capable. They just didn't
  225. 7:22go the route of being software
  226. 7:23developers for a living. I would argue
  227. 7:25somebody like a Linus Tech Tips would
  228. 7:27fit this archetype to an extent. Not
  229. 7:29script kiddies, but like people who know
  230. 7:32their way around a computer and have a
  231. 7:34good intuition for what software can and
  232. 7:36can't do, but very little intuition on
  233. 7:39what is or isn't realistic for them to
  234. 7:41make. And what's cool with these people
  235. 7:43is the power they get as models get
  236. 7:45smarter because they don't understand
  237. 7:48the limitations of code as well. They
  238. 7:50understand limitations of the thing the
  239. 7:52code does, they don't necessarily
  240. 7:53understand limitations of like different
  241. 7:55frameworks and tools and ecosystems. And
  242. 7:57if their app's getting really slow and
  243. 7:59they built it in Rails, they don't know
  244. 8:01what is making it slow. They might hear
  245. 8:04that PlanetScale is really fast and
  246. 8:06Railway's really fast and end up
  247. 8:08spinning up both in different regions
  248. 8:10and then their app is really slow and
  249. 8:11they just don't get it. As models get
  250. 8:13smarter, those gaps start to get
  251. 8:15plugged, too. And they can ask questions
  252. 8:17like, "Why is the app so slow now?" And
  253. 8:21it can do the types of analysis to get
  254. 8:23these answers. A highly motivated
  255. 8:25technical person that just never quite
  256. 8:27got good at coding can do so much more
  257. 8:29now. They can fork software they rely
  258. 8:33on.
  259. 8:34They can now also debug systems far
  260. 8:35beyond their understanding. They can
  261. 8:38whip up scripts or fork some program and
  262. 8:40when it doesn't work how they expect it
  263. 8:42to, they can change and adjust the same
  264. 8:44way that like you could open up your
  265. 8:46computer and swap a part, these same
  266. 8:48technical people can now open up their
  267. 8:50software and swap things out, too.
  268. 8:52Previously, they could like make their
  269. 8:53own small little apps with AI. Now, they
  270. 8:56can ask the AI to fork some tool they
  271. 8:58use and make changes to adjust it to
  272. 9:01their liking. They can reverse engineer
  273. 9:02apps they're using every day like Codex
  274. 9:04and ChatGPT or Discord and insert
  275. 9:06JavaScript to change the experience in
  276. 9:09the product. All of that was super cool,
  277. 9:12but it was very personal. It didn't like
  278. 9:13scale out the same way because models
  279. 9:16just weren't great at like packaging the
  280. 9:18work they had done and making it so
  281. 9:20others can adopt those things. You might
  282. 9:22be able to make a cool plugin for your
  283. 9:24local Discord, but setting that up in a
  284. 9:26way others can use it was still complex
  285. 9:28and dangerous and hard to get right. But
  286. 9:30while devs could make things others
  287. 9:32could use, technical people could use
  288. 9:35the AI tools to customize what they were
  289. 9:36already using, but not necessarily to
  290. 9:38productize it and give it out to others.
  291. 9:41And that might be my initial framing
  292. 9:43here.
  293. 9:43Tier one is it helps with things I'm
  294. 9:45good at. This is like I'm already
  295. 9:46editing code and I ask the AI to
  296. 9:48customize a function or maybe I let auto
  297. 9:50complete drive some of the lines as I'm
  298. 9:52changing them. Then it can make edits to
  299. 9:54the things I use often. This could be
  300. 9:56using AI to customize a tool that you
  301. 9:58use every day, to fork a library and
  302. 10:00make some slight adjustments to it, to
  303. 10:02do your job more effectively, but it's
  304. 10:04still like a very personal. Like the AI
  305. 10:06and the thing I build with it isn't
  306. 10:08really leaving my little bubble. It's
  307. 10:10tier one, I am telling the AI like what
  308. 10:12its constraints are and building
  309. 10:13everything around it. Tier two is I'm
  310. 10:15letting it do a bit more and it's
  311. 10:17exploring places I'm not as familiar,
  312. 10:18but it's still limited to me and my
  313. 10:20little circle of like the software I
  314. 10:22use. This is using AI to build a
  315. 10:23personal Chrome extension or to make a
  316. 10:26Discord script that changes how Discord
  317. 10:27works for you or even like the personal
  318. 10:28AI assistants and things. All I would
  319. 10:30put here. Then it gets to the point
  320. 10:32where they can build things you don't
  321. 10:33fully understand. Where I have a bunch
  322. 10:36of projects I've been working on in Rust
  323. 10:38and I don't actually write Rust. I
  324. 10:40barely understand the language. I played
  325. 10:41with it a bit. I find it tedious and
  326. 10:43annoying, but I'm writing a lot of
  327. 10:44projects in Rust now even if I'm not
  328. 10:46writing the code. And I'm also able to
  329. 10:47distribute those projects and I will be
  330. 10:49shipping many of them to real users in
  331. 10:51the very near future. And then all the
  332. 10:52way at the bottom, there is the crazy
  333. 10:54new unlocked tier of oh [ __ ] we can use
  334. 10:57these tools to decompile, reverse
  335. 10:59engineer, and rebuild the things that
  336. 11:01already exist in the world at like their
  337. 11:04very core. Things that like are
  338. 11:06basically impossible to understand. Like
  339. 11:08no one fully understands the decompiled
  340. 11:10code base for Super Mario 64. That's
  341. 11:13just not viable. And it's magical, truly
  342. 11:17unbelievably so, that these tools can
  343. 11:19build a good enough comprehension of
  344. 11:21something like that to operate within
  345. 11:23it. The reason I'm tiering this is when
  346. 11:25model level ups happen, there are
  347. 11:27different categories of people that are
  348. 11:29affected differently. So if we have devs
  349. 11:32for example, when AI coding first
  350. 11:34started to be a thing with like OG
  351. 11:36Co-pilot, it would help devs with things
  352. 11:38they're good at, and technical people
  353. 11:41were not helped at all in this framing.
  354. 11:43Like they could ask it questions and get
  355. 11:45answers, sure, but they're not building
  356. 11:47things with it yet. But then the models
  357. 11:50got better, and then they got to the
  358. 11:52point where they could like actually use
  359. 11:54a tool and edit some code. And then this
  360. 11:57happened. Technical people could use
  361. 12:00these tools to like customize their home
  362. 12:02pages or like work on their Wix sites
  363. 12:05and stuff like that. Devs could suddenly
  364. 12:07use it to actually customize the tools
  365. 12:09they use to edit some packages that
  366. 12:11they're relying on to make real changes
  367. 12:13to their code base that are multiple
  368. 12:14files that are being touched. And then
  369. 12:17the models got better again. Opus 4.5
  370. 12:19dropped, and all of a sudden everything
  371. 12:21shifted again. Technical people were
  372. 12:23suddenly able to build full apps that
  373. 12:25kind of worked. There were people who
  374. 12:27had never coded months before building
  375. 12:29benchmarks that they couldn't read for
  376. 12:31things they didn't understand. And devs
  377. 12:33suddenly could go even deeper. This is
  378. 12:35when a lot of us started like building
  379. 12:36games as side projects or trying to port
  380. 12:39libraries to different things or use
  381. 12:42these tools to automate some of these
  382. 12:44decompilation processes. And then the
  383. 12:46models got better again. And I would
  384. 12:48argue with Fable 5 and eventually with
  385. 12:50Astra, the jump for devs was immediately
  386. 12:53huge, but the jump for technical people
  387. 12:55was not quite as big, and I thought this
  388. 12:57might be the end to an extent. That the
  389. 12:59gap from technical people who don't code
  390. 13:02to devs who will know life like all
  391. 13:04their understandings, I thought this gap
  392. 13:06was going to just keep getting bigger
  393. 13:07and bigger and bigger. And then Opus 5.5
  394. 13:10happened, and the thing that made Opus
  395. 13:125.5 so interesting to me is while it
  396. 13:14didn't really move what I was doing with
  397. 13:17AI much, like I do a lot more, but it
  398. 13:19didn't necessarily unlock a lot of new
  399. 13:21capability for me that I couldn't piece
  400. 13:23together with other things, the fact
  401. 13:25that there was one model that could do
  402. 13:27all of this stuff that was well priced
  403. 13:29and accessible on the subscription tiers
  404. 13:31bumped technical people deep deep deep
  405. 13:34into this idea of being able to build
  406. 13:36things they don't understand. There are
  407. 13:37now people who have never coded before.
  408. 13:39They've never opened Blender. They've
  409. 13:40never done any of those things that are
  410. 13:42using their Claude subscription they're
  411. 13:43paying 200 bucks a month for to port
  412. 13:45maps from their old favorite games into
  413. 13:48new games that they were reverse
  414. 13:49engineered. That's crazy. But there's
  415. 13:51another tier of people non-technical
  416. 13:54people.
  417. 13:55I don't think they have been moved
  418. 13:58anywhere near as much. But that's an
  419. 14:00opportunity for the people in these
  420. 14:02other areas. If you are the person who
  421. 14:04fixed their mom's computer for a long
  422. 14:06time, you might be able to find more and
  423. 14:08more problems that your mom has with
  424. 14:11other things that AI could solve either
  425. 14:13by showing her to use an AI tool or
  426. 14:14building her something useful with your
  427. 14:16AI tools. You also can start modding
  428. 14:18games in ways that you fundamentally
  429. 14:20couldn't understand in this position and
  430. 14:23then you can share those mods with your
  431. 14:25friends. And I am sure there's a bunch
  432. 14:26of people playing the Call of Duty Halo
  433. 14:29mashup that don't understand anything
  434. 14:32about how it works. They were just sent
  435. 14:34an EXE from a friend who got it all
  436. 14:36figured out and these technical people
  437. 14:38can now share so many more cool things
  438. 14:41with their friends. And here is where my
  439. 14:43spiciest take comes in.
  440. 14:45So we need to talk more about these
  441. 14:46people, the devs. Cuz I have a harsh
  442. 14:50reality I need a lot more of y'all to
  443. 14:51wake up to.
  444. 14:53We're not very creative. And the more
  445. 14:55creative you think you are as a dev, the
  446. 14:57more likely you are to have really bad
  447. 14:58ideas generally. Devs are not very good
  448. 15:03at most things that aren't delivering
  449. 15:05code.
  450. 15:07That's just reality. The reason that my
  451. 15:10channel is so popular isn't cuz I'm
  452. 15:11super smart or really good at branding
  453. 15:14clickbait thumbnails. It's cuz I'm like
  454. 15:17six out of 10 at communication in a
  455. 15:19space where where average is a three. So
  456. 15:21I'm able to talk about these things and
  457. 15:23be a lot easier to listen to than your
  458. 15:26average dev who would otherwise talk
  459. 15:27about these things. This is why so many
  460. 15:29dev teams have a non-technical designer
  461. 15:31and a product manager that don't know
  462. 15:33[ __ ] about code that are being paid 100k
  463. 15:35plus a year. It's cuz we need them
  464. 15:38because we don't have the taste or the
  465. 15:40creativity to do anything other than
  466. 15:42like link two libraries up in a novel
  467. 15:44way. We're not good at this. And here is
  468. 15:47where the spice comes in. Technical
  469. 15:49people who can't code are necessarily
  470. 15:52decent at this. These are the people who
  471. 15:54got really into Zapier back in the day
  472. 15:56because they didn't know how APIs or
  473. 15:58webhooks worked. So, they would use
  474. 16:00those tools to force things to work
  475. 16:03together in ways that made no sense.
  476. 16:05I've seen some OBS setups that hurt my
  477. 16:08brain because it's just so far outside
  478. 16:12of how the program was built to work.
  479. 16:14Like I know somebody who has over 40,000
  480. 16:17scenes in her OBS because she uses them
  481. 16:19all as dynamic layers that link to and
  482. 16:22stack on top of each other for crazy
  483. 16:24dynamic scenes in like situations that
  484. 16:27she'll create in OBS. Like I've seen
  485. 16:29some crazy [ __ ] And that's all weird
  486. 16:32creative [ __ ] thinking. And suddenly
  487. 16:35those types of people have had their
  488. 16:38like shackles taken off to an extent.
  489. 16:41And that's what's so exciting here is
  490. 16:43what happens when those people who don't
  491. 16:46understand how this all works, who don't
  492. 16:48understand that a game made in IW4
  493. 16:51should not work inside of the same
  494. 16:54engine as a game made in UE3 versus a
  495. 16:56game made in whatever the [ __ ] EA was
  496. 16:57cooking at the time. People who don't
  497. 17:00have that strong like fundamental belief
  498. 17:03that like these things are different,
  499. 17:04therefore they can't be combined. Or
  500. 17:06these things work this way because
  501. 17:08they've worked this way for 20 years.
  502. 17:09All of this stuff is just it it's hard
  503. 17:13for us to comprehend. And I know this
  504. 17:15for a reason that is really, really
  505. 17:18silly. I know devs aren't good at this
  506. 17:20because of my most popular short.
  507. 17:22>> Why can't we commit our environment
  508. 17:23files? It sounds stupid when I put it on
  509. 17:25a slide like this, but I want you to
  510. 17:26really think about this for a second.
  511. 17:28When I have a team of engineers that are
  512. 17:30working on a project, why do I have to
  513. 17:32build another system to share this
  514. 17:34specific file, but all the other files
  515. 17:36can go and get just fine? We have to
  516. 17:38take the step back and think, is this
  517. 17:40how we do things cuz it's right, or is
  518. 17:42this how we do things cuz it's just how
  519. 17:44we've always done it?
  520. 17:45>> Why can't we commit our environment
  521. 17:46files?
  522. 17:46>> I played this short because I have
  523. 17:48learned this take is an unintentional
  524. 17:52I don't want to say IQ test. It's a like
  525. 17:54creative thinking exercise for engineers
  526. 17:56who are not good at creativity and
  527. 17:57they're often not good at thinking. The
  528. 17:59reason I brought this up in my AI world
  529. 18:01fair talk was because I want us as
  530. 18:04engineers to start unraveling these
  531. 18:07deep-set beliefs that we have. It's time
  532. 18:09for us to take a step back and look at
  533. 18:13what we're doing and why we're doing it.
  534. 18:15And one of the best ways to do this is
  535. 18:17to have outsiders come in and be like,
  536. 18:19that makes no sense. And they do things
  537. 18:20differently cuz they don't know any
  538. 18:21better. This happens a lot in music
  539. 18:23where some random kid from some foreign
  540. 18:25country will like something they hear in
  541. 18:26another place and make their version of
  542. 18:29it, and by the time it's notable enough
  543. 18:31to be heard by people from the original
  544. 18:33culture, it's also refined enough that
  545. 18:35they can't really poke holes in the
  546. 18:37things that it does differently. We're
  547. 18:38about to hit this era with software
  548. 18:41where people who have no idea what
  549. 18:43they're doing can come in with ideas
  550. 18:44that do not make sense to us because
  551. 18:46we've been engineering for 20 plus years
  552. 18:49and these kids don't know the difference
  553. 18:51between Java and JavaScript, and they're
  554. 18:52going to make things that are really
  555. 18:54cool and surprisingly powerful because
  556. 18:57they don't know to not ask for it. And I
  557. 18:59know we're not going to be very good at
  558. 19:01this as engineers because of the comment
  559. 19:04section in all of these videos. Why
  560. 19:06can't I post a picture of my credit card
  561. 19:08to Twitter? What kind of tech brain rot
  562. 19:10is this? The saga of the sinking Theo
  563. 19:12continues. Homie still learning soaps
  564. 19:15exist. I can give you a couple reasons.
  565. 19:18Decoupling sourcing keys, sometimes in
  566. 19:20the company you want to see code of one
  567. 19:22another but don't have the ability to
  568. 19:23launch it. Yeah, you're you're assuming
  569. 19:25everything still works the way it works
  570. 19:27today. The point I'm trying to make is
  571. 19:29that GitHub giving everyone access to
  572. 19:32every file into get as an origin system
  573. 19:35sharing every file with everybody with
  574. 19:37access might not be the right way to
  575. 19:40manage our source code. Love this
  576. 19:42comment from Shiv. Oh, you want me to
  577. 19:44think? Nah, too much. I'm a software
  578. 19:46engineer, man. Yeah, I'm not paying you
  579. 19:47to think. I'm paying you to write code.
  580. 19:49Boil the ocean, but we can't even find
  581. 19:50the ocean actually.
  582. 19:52Gamer girl
  583. 19:53The reason I'm talking about this I
  584. 19:55think devs like you are going to be very
  585. 19:58well off cuz there's a lot of devs who
  586. 20:00are creative weirdos that do strange
  587. 20:02[ __ ] with code that have struggled to
  588. 20:04find a job for various reasons usually
  589. 20:06dumb. That has shifted a ton. Highly
  590. 20:09motivated people with a bit of
  591. 20:11creativity and a willingness to think
  592. 20:13outside of the box and dive on to things
  593. 20:15they don't understand fully, they're
  594. 20:16going to be rewarded absurdly heavily in
  595. 20:19this era. Where the the less tied you
  596. 20:22are to the way things have to work right
  597. 20:24now, the more likely you are to break
  598. 20:27out of that box a bit and come up with
  599. 20:29more unique and creative things. And
  600. 20:31when things don't work, you can ask
  601. 20:33questions and figure out why. A simple
  602. 20:36way of putting this that I actually
  603. 20:37really like from chat. Yeah, here it is
  604. 20:39from chorus here. Try first to
  605. 20:41understand why not cuz there's a lot of
  606. 20:43questions and things we do in software
  607. 20:44dev that are effectively just cuz cuz
  608. 20:46the tools have worked this way forever
  609. 20:48and it would be too expensive to try and
  610. 20:51change it. Things like the compilers we
  611. 20:53use written in one language like porting
  612. 20:55it to another is just too much effort
  613. 20:56and time and risk and keeping it synced
  614. 20:58is not necessarily worth it. Or apps
  615. 21:00that were built in one language that
  616. 21:02aren't worth porting to another because
  617. 21:04it's expensive to to
  618. 21:05Or if you have an audio device that's
  619. 21:07bugging you, like I often do,
  620. 21:09technically speaking, if I was to spend
  621. 21:11a few months to a few years, I could
  622. 21:13absolutely reverse engineer my
  623. 21:14Rodecaster and write custom firmware for
  624. 21:16it. It would just take me a very, very,
  625. 21:18very long time. Now, these things are
  626. 21:20much more accessible. The amount of
  627. 21:23effort and historical experience you
  628. 21:25need to try out these crazy YOLO runs is
  629. 21:30so much lower. And I've done these
  630. 21:32things before AI could help me with it.
  631. 21:35Where I try some crazy bold idea, like
  632. 21:37building my own tech stack, or trying to
  633. 21:39build my own game engine, which
  634. 21:41obviously didn't go as well as the other
  635. 21:42things I did, or trying to build my own
  636. 21:44protocol for WebRTC STUN servers to make
  637. 21:47the quality of the connections better
  638. 21:49without causing any latency issues.
  639. 21:51Like, I have been trying these types of
  640. 21:53crazy YOLO missions for the better part
  641. 21:56of my career. And now those explorations
  642. 21:59are much less expensive and much more
  643. 22:01accessible, which means you have to be
  644. 22:03willing to go down them. But you also
  645. 22:05have to be willing to try things and
  646. 22:07have them fail. And I find a lot of devs
  647. 22:09are worse at that. Since devs are used
  648. 22:11to working in the things in the systems
  649. 22:12they understand, even if they don't
  650. 22:14understand them fully, they are used to
  651. 22:16failures, but it's like they change five
  652. 22:18lines of code, it doesn't do what they
  653. 22:20expect, so they go change them a few
  654. 22:21more times. It is so rare that a dev
  655. 22:24files a PR that doesn't eventually get
  656. 22:26merged that we almost feel bad. Like,
  657. 22:29who here has merged a pull request
  658. 22:31because they felt bad closing it because
  659. 22:34they know the person who made it worked
  660. 22:36really hard on it. I know I have. Let's
  661. 22:38see some yeses and ones in chat if
  662. 22:40you've ever guilt merged a PR.
  663. 22:44See all those?
  664. 22:46This happened because it feels bad
  665. 22:48throwing away somebody's work, but we're
  666. 22:50also just so used to the point of a PR
  667. 22:52going up being that that PR will merge.
  668. 22:55And that is just a deep culturally set
  669. 22:58thing that we have to start walking
  670. 23:00back. And let's be real here. Let's say
  671. 23:03a professional dev who's written code
  672. 23:05for years spends 2 hours on some slop
  673. 23:09thing that is a 2,000 line of code PR.
  674. 23:12And then separately, a technical person
  675. 23:15who isn't a dev spends 5 hours on the
  676. 23:18same thing and makes a nearly identical
  677. 23:20PR. Who's going to feel worse when you
  678. 23:22close the PR because you don't want that
  679. 23:25in your product? The engineer who spent
  680. 23:262 hours on it or the technical person
  681. 23:29who spent 5 plus?
  682. 23:30>> I think we all know the answer to this.
  683. 23:31It's obviously the developer. They value
  684. 23:33their time more highly. They have
  685. 23:35expectations when they are building
  686. 23:36these things. They are used to PRs they
  687. 23:38file being merged. And if they can do a
  688. 23:41week of work in 2 hours, they're still
  689. 23:43putting up a PR that feels like that
  690. 23:44week of work. And when you don't merge
  691. 23:46it, they still feel bad the way they
  692. 23:47used to. The technical people who
  693. 23:49haven't coded before don't have this
  694. 23:50experience, but they also just don't
  695. 23:52have the expectation, either. Because
  696. 23:55they're not going in expecting this to
  697. 23:56work or expecting this to land.
  698. 23:58They're going in expecting this to be a
  699. 24:00fun experience, really. And that
  700. 24:02difference in expectation going in has
  701. 24:05allowed these people to do crazy [ __ ]
  702. 24:08recently. So, what I'm trying to say
  703. 24:09here is we need to get over ourselves a
  704. 24:11bit as developers. We need to be a
  705. 24:13little more willing to take a step back
  706. 24:15and question things. We need to feel
  707. 24:17less bad when the thing we do doesn't
  708. 24:19work and should be thrown out. We need
  709. 24:21to ask more questions both to our agents
  710. 24:23and to ourselves about what we're
  711. 24:24building, why we're building it, and
  712. 24:26what we could potentially do
  713. 24:27differently. We need to be a little bit
  714. 24:28more willing to boil the ocean and do
  715. 24:30these crazy things that don't really
  716. 24:33make sense. I remember just a few months
  717. 24:36ago
  718. 24:37my Yolo project rewriting the entirety
  719. 24:39of the TypeScript compiler in Rust felt
  720. 24:42like the unobtainium of AI. Like maybe
  721. 24:45someday AI will be able to make a little
  722. 24:48bit of headway in this project. Not only
  723. 24:50was it working in under 20 hours, it is
  724. 24:54now two two three times faster than TS
  725. 24:56Go. And most importantly for my actual
  726. 24:58reason I want it, it works in WASM. I
  727. 25:01didn't think this project would ever be
  728. 25:02able to like realistically happen. If I
  729. 25:05was lucky, it might pass a compilation
  730. 25:07here and there. Now it works on all the
  731. 25:09real projects I care about with 99.99%
  732. 25:12accuracy against the other versions of
  733. 25:14TypeScript. And not to keep calling out
  734. 25:17chat, but raging here said that when I
  735. 25:19first started the project that they made
  736. 25:21fun of me for it so hard because they
  737. 25:23never thought it would work. That's why
  738. 25:25I started it. I started this project as
  739. 25:27like my attempt to think of a thing AI
  740. 25:30would never be able to do. And now this
  741. 25:31feels too easy. Like yeah, of course the
  742. 25:34AI could rewrite a known target like a
  743. 25:37compiled app in a different language.
  744. 25:39But just a couple weeks ago this didn't
  745. 25:41seem possible. It's crazy how much
  746. 25:45things have changed. And I'm not even
  747. 25:47thinking bold enough, and it's my job to
  748. 25:49think too bold so I can make videos out
  749. 25:51of it. I like this way of framing it
  750. 25:52Game Mechanic. I'm a software engineer
  751. 25:54as well as a systems engineer, and my
  752. 25:55hot take is that most devs are pretty
  753. 25:57happy writing the same damn linked list
  754. 25:59written by every other dev over and over
  755. 26:00again. They don't really like
  756. 26:02differentiated workloads. As a systems
  757. 26:04engineer, I'm basically annoyed writing
  758. 26:06code that's already been written before.
  759. 26:08I think the people who can work at
  760. 26:09higher levels of abstraction and not
  761. 26:10care about the low level low level
  762. 26:12implementation are going to be the
  763. 26:13winners. I pretty much entirely agree
  764. 26:15with this. The only thing I would change
  765. 26:17is the people who are willing to be
  766. 26:19flexible with how low or high level they
  767. 26:21go, they are going to be the ones who
  768. 26:23benefit the most. The people who are
  769. 26:25willing to throw away their preferences
  770. 26:28in order to make something better for
  771. 26:30their goals are going to benefit a lot.
  772. 26:33Like do you have any idea how many
  773. 26:34technical decisions I have had to make
  774. 26:37in projects that are not the first
  775. 26:39decision I would prefer at all because
  776. 26:42they are the thing that gets me my goal
  777. 26:45the fastest. Like I really do genuinely
  778. 26:47want to switch us over to the SwiftUI
  779. 26:50rewrite for the mobile app, but the
  780. 26:52speed the agents can operate at with the
  781. 26:54React Native app, combined with the OTA
  782. 26:55updates, and all the pushing that Julius
  783. 26:58and Jay have done to make the
  784. 26:59performance not just comparable, but I
  785. 27:01would say in many ways faster. I'm not
  786. 27:03going to probably ship the version that
  787. 27:05I prefer, especially on a technical
  788. 27:07level cuz I know it's more capable,
  789. 27:08because the agents, the tokens, and the
  790. 27:10time are going into a different thing.
  791. 27:12Or, for a sillier example, my fleet. You
  792. 27:14might notice some of these boxes have a
  793. 27:16new OS on it. You would imagine if I was
  794. 27:20making T3OS, that it would be full of
  795. 27:22all my opinions. Well, if I do end up
  796. 27:25shipping T3OS, it's not going to look
  797. 27:28like what you think, because it has none
  798. 27:30of my opinions in it. I didn't make this
  799. 27:33new distro of Ubuntu because I want to
  800. 27:35have a distro that does everything I
  801. 27:37want. I'm building this distro because I
  802. 27:40want a distro that has none of the
  803. 27:41things I want. It's designed to have the
  804. 27:44things the agents need instead. T3OS
  805. 27:46doesn't have a GUI when you boot it. It
  806. 27:49is headless, but it will spin up GUIs
  807. 27:52that are a fork of XFCE for my agents to
  808. 27:54use through the driver level with Kua
  809. 27:57control, so they can do computer use for
  810. 27:59each individual thread. It's also using
  811. 28:01Bash instead of Zsh or Fish, because as
  812. 28:04much as I prefer Zsh, I very much prefer
  813. 28:06Zsh, I recently audited all of the
  814. 28:08errors that my agents have, and over 30%
  815. 28:11of the errors that Claude runs into
  816. 28:13across my machines are because the Zsh
  817. 28:16machines format newlines slightly
  818. 28:18different, and Claude malformats the
  819. 28:20Ripgrep commands. I've also learned my
  820. 28:22agents aren't quite as good at dealing
  821. 28:24with Arch and Cash OS for a dev box. And
  822. 28:26as much as I would prefer to run Cash on
  823. 28:28all my [ __ ] I've accepted it's not the
  824. 28:30best choice for a lot of work and for a
  825. 28:32lot of my boxes. So, now I'm making a
  826. 28:35not really a fork of Ubuntu. It's more
  827. 28:36like a super customized Ubuntu image
  828. 28:38that is customized for the agents, not
  829. 28:40me. And this is weird because on one
  830. 28:42hand I'm going deeper, customizing the
  831. 28:44OS, but on the other hand I'm going
  832. 28:46shallower because I'm not making the
  833. 28:48decisions for myself. In my willingness
  834. 28:50to be flexible up and down the spectrum
  835. 28:53of depth for this stuff. Because I'm not
  836. 28:56building the product for me is how I'd
  837. 28:57put it. Or like I'm not building T3OS
  838. 28:59for me. I'm building T3OS for my agents
  839. 29:02so they can build things for me. And if
  840. 29:04we are not more willing to think about
  841. 29:05things this way as devs, not only are we
  842. 29:08going to stop benefiting from the models
  843. 29:10getting smarter, these technical folks
  844. 29:12who don't have the same boundaries in
  845. 29:15their brains are going to accelerate far
  846. 29:17past us. That person you used to get
  847. 29:19annoyed by in high school because their
  848. 29:21solution to everything was install
  849. 29:23Ubuntu, even though they've never
  850. 29:25programmed before, that person's going
  851. 29:27to run laps around you if you're not
  852. 29:28careful. And I say all of this because I
  853. 29:31was wrong. I had the silly belief that
  854. 29:34models would be putting out things that
  855. 29:36were so complex that technical people
  856. 29:38couldn't understand it and the devs
  857. 29:40would be the only ones who could. And
  858. 29:42that same knowledge that made us more
  859. 29:44capable of wielding Opus 4.5 and
  860. 29:46eventually even Fable is starting to
  861. 29:48hold us back. So what happens when this
  862. 29:50all hits the non-technical folks? I have
  863. 29:53no idea. I'm just paid to talk about
  864. 29:55code, guys. Seriously though, like I've
  865. 29:57been thinking too much about this and I
  866. 29:58just wanted to get the ideas out of my
  867. 30:00head because these things are changing
  868. 30:02faster than I expected or still
  869. 30:04accelerating. And it turns out a model
  870. 30:06that can write its own compiler is
  871. 30:08useful to people who want to rewrite
  872. 30:10their old favorite games. And I never
  873. 30:12thought a model that capable would be
  874. 30:14useful to my friends in high school, but
  875. 30:16I didn't think people would be rewriting
  876. 30:18their favorite Xbox 360 games from
  877. 30:20decompiled ports in Rust plus Bevy and
  878. 30:23then mashing them up together, either.
  879. 30:25We're at the very, very tip of this
  880. 30:27crazy-ass iceberg and I hope that you
  881. 30:29guys are prepared for the future as it
  882. 30:32is coming. Cuz god damn,
  883. 30:34it's not going to get any slower. What
  884. 30:36I'm trying to say is that I was wrong
  885. 30:38and I've been reflecting on it a lot and
  886. 30:39I know a lot of y'all probably are
  887. 30:41thinking the same way I was just weeks
  888. 30:43ago. I hope this video convinces you to
  889. 30:45start rethinking where these models are
  890. 30:48going and who will be able to use them
  891. 30:50because I know I have been blown away
  892. 30:52with what we can do. Every time I get a
  893. 30:53DM from an old friend from high school
  894. 30:55or somebody I used to work on random
  895. 30:57audio engineering stuff with showing me
  896. 30:59the crazy things they're building with
  897. 31:00help us. I realize that we are very very
  898. 31:03early still.
  899. 31:04And where we are going is going to be
  900. 31:06pretty damn cool.
  901. 31:08So that's all I have to hear. Let me
  902. 31:09know what y'all think and until next
  903. 31:10time.
  904. 31:11Peace nerds.

About this transcript

This page contains the full transcript of Opus 5.5 is proof that we do need smarter models by Theo - t3․gg, generated from the public captions YouTube serves with the video. The transcript has 6,476 words across 904 segments, with the original timestamps preserved so you can click any line to jump to that moment in the embedded player.

What you can do with it

Use the transcript to take notes, quote the speaker, build a study guide, generate a summary with ChatGPT or Claude via the YouTube Summary tool, or export it as a timed subtitle file with YouTube to SRT. You can also re-open it in the transcriber to choose a caption track available on the video.

Free YouTube transcript tool

YouTube2Text is a free YouTube transcript generator — no signup, no daily limit. Paste any YouTube link and get the full transcript instantly, with timestamps, click-to-jump, caption language selection, AI prompts for ChatGPT, Claude, and Gemini, and exports to TXT, SRT, VTT, or Markdown.