YouTube2Text

Cerebras Killed Notion, Obsidian, and Your "Second Brain" — Transcript

by Nick Saraev · 5,543 words · 773 segments · language en · Watch on YouTube

Full transcript

  1. 0:00So this is really interesting. This
  2. 0:01company Sarah just built a knowledge
  3. 0:03base that I think is not total
  4. 0:06And that's hard for me to say because up
  5. 0:09until now, virtually every instance of
  6. 0:12knowledge bases or second brains or
  7. 0:14whatever have just been total hot air.
  8. 0:17This is a massive AI hardware company
  9. 0:19that essentially creates super quick
  10. 0:21inference chips and they're used by a
  11. 0:24variety of major billion dollar
  12. 0:25companies that you guys probably have
  13. 0:26heard of. And at no point in this big
  14. 0:28tutorial which they just wrote a big
  15. 0:30blog post on did they show an obsidian
  16. 0:32graph. At no point did they show a
  17. 0:35floating 3D brain in a tube. Uh you know
  18. 0:38instead what they showed is they showed
  19. 0:39a very reliable and robust data
  20. 0:42ingestion pipeline that allows virtually
  21. 0:44anybody in their company to answer any
  22. 0:46question that they have about the
  23. 0:48business and about things that other
  24. 0:50people have done in the business. What
  25. 0:51they've done is they've fed in like
  26. 0:53gigabytes of text and image data from
  27. 0:56platforms like Slack. Every Slack
  28. 0:58conversation that's ever occurred in the
  29. 1:00organization. Um their wiki and
  30. 1:01Confluence, all of their code repos and
  31. 1:04GitHub, you know, their net list PRM
  32. 1:06docs as well as custom databases.
  33. 1:08They've just slashed or rather I should
  34. 1:10say squashed all of this data into
  35. 1:12embedding space which you can just think
  36. 1:14of as concepts that an AI could query
  37. 1:17over. So that if somebody said, "Hey,
  38. 1:18what was that thing Paul was talking
  39. 1:20about 3 days ago?" ago, it had something
  40. 1:21to do with, you know, embeddings. It can
  41. 1:23actually go in to the Slack without
  42. 1:25having to, you know, query the API or
  43. 1:27whatever and just always know what's
  44. 1:29going on in the business. So, what I
  45. 1:31want to do in this video that isn't
  46. 1:32clear is I want to show you what this is
  47. 1:33and then I actually want to build one
  48. 1:35alongside you. I've already built one of
  49. 1:36these for my own business and it's quite
  50. 1:38useful already and that's just as a
  51. 1:40small team. I can imagine how if you
  52. 1:42have thousands of people in your
  53. 1:44organization, stuff like this starts to
  54. 1:46scale and get really, really good. Um,
  55. 1:48and this is also just as mentioned like
  56. 1:50one of the ones that's not
  57. 1:51There's a lot of noise on YouTube
  58. 1:53obviously because everybody's trying to
  59. 1:54push their own particular way of doing
  60. 1:55things. This is not my way of doing
  61. 1:57things. This is this major company's way
  62. 1:59of doing things um that I happen to
  63. 2:01think is actually quite practical and it
  64. 2:02it is not all about visualizing
  65. 2:04something goofy for people that are non
  66. 2:06super technical. Now to really
  67. 2:07understand this system you first need to
  68. 2:09understand what retrieval augmented
  69. 2:11generation is. Also commonly referred to
  70. 2:13as rag. Rag is the cornerstone behind
  71. 2:15more or less all of this stuff. So, it's
  72. 2:17worth at least a brief refresh if this
  73. 2:19is the first time that you're
  74. 2:20encountering this or not. What rag
  75. 2:21basically does is it allows models to
  76. 2:23answer questions specifically about a
  77. 2:26set of data as opposed to just in the
  78. 2:29general sense over all data. Like for
  79. 2:31instance, if I were to type how tall is
  80. 2:33Nick into my AI model chat box right
  81. 2:35now, it would probably ask me who are
  82. 2:38you talking about? Who is Nick? Well,
  83. 2:41that depends broadly on which Nick
  84. 2:42you're talking about. if you meant, you
  85. 2:44know, Nick Jonas, Nick Jonas is XYZ
  86. 2:46tall, right? That's a very general
  87. 2:48question. So, it's likely that you're
  88. 2:50going to have a general answer. And the
  89. 2:51reason why is because it's enumerating
  90. 2:52over all of its data. So, just to
  91. 2:54visualize this and because I thought
  92. 2:55it'd be kind of funny to make the whole
  93. 2:56world know I'm taller than Nick Jonas.
  94. 2:57Um, you know, here's a quick
  95. 2:59visualization of maybe all the possible
  96. 3:00answers you could get. You know, how
  97. 3:02tall is Nick? Which Nick? Nick Jonas is
  98. 3:045' 10. That depends, right? Um, now the
  99. 3:07question is, imagine hypothetically if I
  100. 3:09didn't just say, "How tall is Nick?"
  101. 3:11Imagine if the prompt that I fed into
  102. 3:13this model was Nick is 6'2
  103. 3:18and then I added some lines over here
  104. 3:20and then I said how tall is Nick. What
  105. 3:22do you think the model would say? Well,
  106. 3:24it's pretty obvious how tall Nick is,
  107. 3:25right? We just fed in a piece of
  108. 3:27information immediately before the rest
  109. 3:28of the prompt that just says how tall is
  110. 3:30Nick? So, what do you think the model's
  111. 3:32going to say? Well, the model's probably
  112. 3:33just going to say, well, Nick is 6'2. It
  113. 3:36doesn't even know really which Nick I'm
  114. 3:38referring to or anything like that
  115. 3:40because it just has the information
  116. 3:41directly in its prompt, right? And so
  117. 3:43what we've done is we basically
  118. 3:45collapsed all of the possible responses,
  119. 3:47all the variability of the model and
  120. 3:48made it hyperspecific. We basically made
  121. 3:50it like exactly what we want every time.
  122. 3:53Okay? So all rag really is retrieval
  123. 3:55augmented generation is it is augmenting
  124. 3:58the AI generation of a piece of text by
  125. 4:01retrieving information like Nick is 6'2
  126. 4:04from some database. Okay. Now the key is
  127. 4:07it's not just a database. It's not like
  128. 4:09we just hypothetically have height of
  129. 4:11every man on planet earth and then
  130. 4:13somehow we store the right entry in.
  131. 4:15What it usually is is it it sort of
  132. 4:17exists in a language that LLM and large
  133. 4:20language models can intuitively
  134. 4:22understand called the embedding space.
  135. 4:24You should know that all retrieval
  136. 4:25augmented generation really is is just a
  137. 4:27system that allows us to store
  138. 4:28information before the question. Now,
  139. 4:30hypothetically, let's say you were
  140. 4:32trying to build a really cool knowledge
  141. 4:33base that just answered all the
  142. 4:34questions inherent in your business,
  143. 4:36everything that's gone on in the last 24
  144. 4:37hours. Um, well, you can apply that same
  145. 4:39approach. Like if I just asked my little
  146. 4:42knowledge base, hey, what did Peter say
  147. 4:44at that talk last week? It's probably
  148. 4:46going to go and collapse into or rather
  149. 4:48spread a variety of different answers
  150. 4:49and be like, who the hell's Peter? What
  151. 4:50talk are you talking about? I don't even
  152. 4:52know what year it is, man. I'm just a a
  153. 4:54text corpus. So, what we need to do is
  154. 4:55we need to find a way to insert
  155. 4:57information. So, you know,
  156. 4:58realistically, what we want is like uh
  157. 5:00Peter Jackson delivered a talk last week
  158. 5:04at 6:52 p.m. on Thursday. in the talk he
  159. 5:09discussed X Y and Z. What we want is we
  160. 5:11basically just want a way to prepen that
  161. 5:13uh before the prompts, right? So all
  162. 5:16this knowledgebased system from Sarah
  163. 5:18does is it just allows you to basically
  164. 5:21retrieve a relevant piece of information
  165. 5:23from your company and then inject it
  166. 5:25above your prompt such that if this is
  167. 5:28your main prompt over here, this is just
  168. 5:30like your sort of injected and I don't
  169. 5:32know, I'm just going to call it like
  170. 5:33help. I mean, the model doesn't know the
  171. 5:35difference, right? the model just sees
  172. 5:37the text whether it saw this or whether
  173. 5:39it saw all of this combined. You know,
  174. 5:41it's going to heavily change what the
  175. 5:42model says, but it doesn't know that
  176. 5:44like, you know, we've helped it out by
  177. 5:45providing the information. It just
  178. 5:46thinks like this is part of its training
  179. 5:48data essentially. Um, and so that's
  180. 5:49that's more or less what the system
  181. 5:51does, and that's why it's so powerful.
  182. 5:52It allows anybody in the whole company
  183. 5:54to answer any question about anything
  184. 5:55that's gone on. It also allows you to
  185. 5:57store things like, hey, you know, here's
  186. 5:59a set of problems and then here's a set
  187. 6:00of solutions that we use to solve those
  188. 6:02problems. So that if a newbie comes on
  189. 6:03board, they're I don't know trying to
  190. 6:05make some code fix or something and it's
  191. 6:06not entirely working, they can just go
  192. 6:07to the knowledge base and say, "Hey,
  193. 6:09like why isn't this thing working?" And
  194. 6:10they would say, "Ah, you're probably not
  195. 6:11pushing to prod as we do in this
  196. 6:13business. It's a little bit different
  197. 6:14than most other businesses. Let me show
  198. 6:15you guys how it works." All right, so
  199. 6:16the first thing to know is this is made
  200. 6:18by three handsome gentlemen, Isaac,
  201. 6:20Daniel, and Mike. At least they're the
  202. 6:22ones that wrote the the blog post. Uh
  203. 6:24and currently they're being asked
  204. 6:25something like 15,000 questions every
  205. 6:27day. Now, this is obviously a pretty
  206. 6:28long blog post. There a bunch of really
  207. 6:29cool visualizations and stuff, but for
  208. 6:31the sake of your time, um, let me find
  209. 6:33the most important sections of this so
  210. 6:35that you have everything you need. Okay,
  211. 6:37the first is the anatomy of the
  212. 6:39knowledge base. And so this knowledge
  213. 6:40base is composed of three major
  214. 6:42sections. The first is it's a platform
  215. 6:43for collecting and storing internal
  216. 6:46data. And so that makes sense, right? We
  217. 6:48need to find a way to basically get
  218. 6:50knowledge from outside of, you know, the
  219. 6:52system into the system. So the knowledge
  220. 6:55inherent in conversations let's say of
  221. 6:57people in the Slack the knowledge
  222. 6:59inherent in the SOPs of the company the
  223. 7:01the checklists the processes all of the
  224. 7:04emails all of that stuff we basically
  225. 7:05need a way to take all of this in the
  226. 7:07ether and then stick it into this
  227. 7:08knowledge base in an appropriate manner
  228. 7:10so that it doesn't get super crappy. The
  229. 7:12second thing we need is we need a
  230. 7:13platform for querying that data. And so
  231. 7:15now that we have the data in the the
  232. 7:17brain so to speak the knowledge base we
  233. 7:19need a way to extract it and kind of
  234. 7:21pull it out. And so this for instance
  235. 7:23would be if I asked my knowledge base a
  236. 7:25question about hey grab stats on the
  237. 7:28last week of performance for XYZ
  238. 7:30software platform and then apply that
  239. 7:32cool lens that Nick talked about in his
  240. 7:35most recent uh company seminar to it.
  241. 7:37That would be an example of you know
  242. 7:39using this platform which we've
  243. 7:41collected and stored internal data into
  244. 7:43uh to query it and then pull something
  245. 7:44out. And then finally, because Cabris
  246. 7:46is, you know, a big company and they're
  247. 7:48dealing in hardware, they also need a
  248. 7:49layer that enforces authentication and
  249. 7:51authorization with auditing, analytics,
  250. 7:53see who's like accessing the data, why,
  251. 7:55and so on and so forth. Now, I'm pretty
  252. 7:57small relative to this massive hardware
  253. 7:59company that works with billion-dollar
  254. 8:00businesses all over the world. So, I'm
  255. 8:01not going to do that. And really, the
  256. 8:03thing that's most important for us is
  257. 8:05just going to be one and two. And I'm
  258. 8:06going to assume anybody in my business
  259. 8:07is probably okay. So, let's actually
  260. 8:09visualize what this looks like.
  261. 8:11Basically, at the very top end, we have
  262. 8:13a bunch of different data sources that
  263. 8:14they're constantly ingesting, right, for
  264. 8:17that first section to to to store a
  265. 8:19bunch of data in their platform. And the
  266. 8:21first is Slack. So, as I'm sure you can
  267. 8:24imagine, any major business will have
  268. 8:25some sort of messaging platform these
  269. 8:26days. And basically what this does is it
  270. 8:29scans through all of the messages that
  271. 8:30are sent in all of the accessible
  272. 8:32workspaces and then converts them into
  273. 8:34what are called embeddings. And
  274. 8:36embeddings are just another way of
  275. 8:37referencing or referring to that data.
  276. 8:39It's just uh it's a little easier for
  277. 8:41models and LLMs to understand. And so
  278. 8:43you can imagine, you know, if you guys
  279. 8:45use Discord, you do this on Discord. If
  280. 8:47you guys use email, then you wouldn't do
  281. 8:48Slack. You just do it over email. But
  282. 8:50the idea is you just need a place where
  283. 8:51people are talking. The second is, you
  284. 8:54know, most companies at least sizable
  285. 8:56businesses will have some form of wiki.
  286. 8:58So whether it's wiki, whether it's
  287. 8:59Confluence, whatever it is, there's some
  288. 9:01place that you guys have already tried
  289. 9:02to sort of store all of your
  290. 9:03information. And typically that's done
  291. 9:05naively through like checklists and SOPs
  292. 9:08and onboarding pages and welcome to
  293. 9:10Clairvo. You know this company is going
  294. 9:11to walk you through blah blah blah blah.
  295. 9:13And so just like Slack, you sort of
  296. 9:14stick that into this embedding space.
  297. 9:17Next up are code repos. This is
  298. 9:18particularly important if you're a
  299. 9:19software business or software adjacent.
  300. 9:21Now in my case I consider my business
  301. 9:22software or software adjacent. So you
  302. 9:24know scanning through all the code repos
  303. 9:26is going to be important. Net lists, PRM
  304. 9:28docs, you know this stuff is going to be
  305. 9:29more uh relevant again to software
  306. 9:31businesses. And then also any sort of
  307. 9:33custom databases you have that store
  308. 9:34information. And so maybe you are doing
  309. 9:37some sort of sales or rather
  310. 9:38spearheading a sales department I should
  311. 9:40say and you guys have databases that
  312. 9:42have info on all of your KPIs. So you
  313. 9:44know uh how many sales are being made,
  314. 9:46how often you know what we can do is we
  315. 9:48can actually take all of that data that
  316. 9:49formatted database information and then
  317. 9:51just store it as these embeddings. Okay.
  318. 9:53And that sort of takes me to that idea
  319. 9:55of like what is an embedding? Well an
  320. 9:57embedding basically just takes the raw
  321. 9:59data itself. So let's say hypothetically
  322. 10:02um the data that we want to stick in
  323. 10:04this pipeline is just a I don't know
  324. 10:06it's it's Nick thinks
  325. 10:09I don't know penguins are cool. So what
  326. 10:11we have is we have this naive sort of
  327. 10:12text data here and then what we'll do is
  328. 10:14we'll actually pass that through a large
  329. 10:16language model. So this might be I don't
  330. 10:18know man like chat GPT claude it could
  331. 10:20be an open source model it could be
  332. 10:21anything. And then we just ask it
  333. 10:22questions about this and we actually say
  334. 10:25hey who's Nick? Why did Nick say that?
  335. 10:27What time did Nick say that? Where did
  336. 10:29Nick say that? when did Nick say that?
  337. 10:31And so on and so forth. And so at the
  338. 10:33end of it, we don't just have this naive
  339. 10:34piece of text that says Nick thinks
  340. 10:36penguins are cool. We have Nick thinks
  341. 10:38penguins are cool, you know, time 5:32
  342. 10:42p.m. We have, I don't know, subject Nick
  343. 10:44Sarafh. We have description, you know,
  344. 10:47and then here maybe it would say
  345. 10:48something like, you know, oh, Nick is
  346. 10:50the founder of XYZ organization. Nick
  347. 10:53does blah blah blah and blah blah blah.
  348. 10:55So what we're doing is we're basically
  349. 10:56taking a core piece of data which you
  350. 10:57can visualize sort of like I don't know
  351. 10:59just this cube over here and then we're
  352. 11:01adding metadata to it. We're adding a
  353. 11:02bunch of additional kind of outcrop
  354. 11:04pieces of information. So it's no longer
  355. 11:06just that tiny little nugget in the
  356. 11:08middle. Now it's like okay now we know
  357. 11:09the time of date it was sent. We know
  358. 11:11who it was sent to, where it was sent
  359. 11:12from, who the person is, why any of this
  360. 11:14is relevant, what the point is that Nick
  361. 11:16was trying to make, and so on and so
  362. 11:17forth. And I mean it's pretty similar to
  363. 11:19I don't know like the way that a camera
  364. 11:20works if you think about it. When you
  365. 11:22take a photo with a digital camera,
  366. 11:23right? You have the photo which is the
  367. 11:25core data, but then you also have a
  368. 11:26bunch of metadata around that. You have
  369. 11:28stuff like, you know, what time it was
  370. 11:29taken, what the color scheme of the
  371. 11:31photo was, where, you know, a lot of
  372. 11:32these cameras are now storing GPS info,
  373. 11:34which is kind of terrifying. But anyway,
  374. 11:36what I'm trying to say is we're not just
  375. 11:38storing the data itself, okay? What
  376. 11:40we're doing is we're adding a bunch of
  377. 11:41stuff to that data and then storing it
  378. 11:42in a way that the machine understands.
  379. 11:44And the reason why that's important is
  380. 11:45because much like your brain remembers
  381. 11:49new things more better and stronger,
  382. 11:52this system remembers new additions to
  383. 11:55the knowledge base more, better, and
  384. 11:57stronger. And so we have the source, we
  385. 11:58have the time stamps, we actually know
  386. 12:00how to weight the data. If the data
  387. 12:02comes from some super low-level employee
  388. 12:033 years ago, we're going to weight it a
  389. 12:05lot less strongly than if the data comes
  390. 12:07from Nick, the founder of the business,
  391. 12:08and it happened 30 seconds ago. You
  392. 12:10know, if somebody asks for information
  393. 12:12related to some recent seminar or
  394. 12:14something like that, it will go through
  395. 12:15not just all seminars equally like most
  396. 12:17naive language models would do. It'll go
  397. 12:19through the most recent seminar uh sort
  398. 12:21of preferentially. It'll be like, okay,
  399. 12:22recency. What does that mean? Okay,
  400. 12:24what's the date? Okay, cool. And then in
  401. 12:25this way, you're going to have a bunch
  402. 12:26of these like quote unquote memories of
  403. 12:29this brain um that are sort of uh uh
  404. 12:31ranked based off the date, based off the
  405. 12:33time, and based off the relevance. Okay,
  406. 12:35so that's that. And then the third step
  407. 12:37is obviously actually quering that data.
  408. 12:39And so that data is queried you know via
  409. 12:41MCP you know web UI AI agents uh people
  410. 12:44are sending messages into a chat box
  411. 12:46whatever it is you know what what occurs
  412. 12:48really is it goes in reverse the query
  413. 12:51goes through the embeddings the
  414. 12:52embeddings represent a particular form
  415. 12:54of information say a slack message okay
  416. 12:56and then you know we what we do is we
  417. 12:58pull the embedding version of that uh in
  418. 13:00order to get the answer key practical
  419. 13:02example of this with a slack message and
  420. 13:05you know I think the examples I provided
  421. 13:06here do kind of suck so bear with me But
  422. 13:09there'll be a message maybe sent in the
  423. 13:10CKPT- support thread. Okay. And at 9:14,
  424. 13:14Amaya will say, "Hey, the restore stalls
  425. 13:16after manifest load on the larger
  426. 13:18cluster, but small runs are fine." Maybe
  427. 13:20Owen then says, "Yeah, I can reproduce
  428. 13:22this with 128 hours." The log stop
  429. 13:24before the cache warm-up, though.
  430. 13:25[gasps] Basically, what happens is
  431. 13:27question summary, right? Maybe here's a
  432. 13:28resolution a few minutes later. We take
  433. 13:30all of the information in a chat thread
  434. 13:33sort of divided into these windows and
  435. 13:35it'll all be done for you automatically.
  436. 13:37And then it'll be essentially created as
  437. 13:39a structured artifact which you guys
  438. 13:41can't really see here. Let me zoom in.
  439. 13:43And so this is the metadata that I was
  440. 13:44talking about because we'll have a large
  441. 13:46language model um take this information
  442. 13:48and ask questions about it. You have
  443. 13:49things like question, hey, why does the
  444. 13:51restore stall after the manifest load?
  445. 13:53Well, guess what? The summary of the
  446. 13:55sort of this conversation is well large
  447. 13:57restores stop before the cache warm-up.
  448. 13:59you know, if I knew what the hell this
  449. 14:00meant, it might be a little bit easier.
  450. 14:01But maybe it's like, hey, uh, who was
  451. 14:03that guy that came in to do that talk on
  452. 14:05Thursday? And maybe the summary is now,
  453. 14:08um, you know, the guy that came in to do
  454. 14:10the talk on Thursday was Nick. You maybe
  455. 14:12there's a resolution step if it's
  456. 14:13something that needed to be resolved.
  457. 14:14And so in this case, you can imagine how
  458. 14:16now we have the ability to actually, um,
  459. 14:18I don't know, like literally store the
  460. 14:19answer to this question permanently
  461. 14:21inside of the company, meaning the
  462. 14:22company grows more efficient and more
  463. 14:23effective over time. You then store a
  464. 14:25bunch of things like maybe code rest
  465. 14:26maybe that just means I don't know like
  466. 14:28what is the slack thread where all that
  467. 14:30information is stored and maybe systems
  468. 14:32that includes a bunch of systems that
  469. 14:34these people are working on. It'll
  470. 14:35actually store a list of them. Obviously
  471. 14:36it includes other information as well.
  472. 14:38It includes like the source ID. It'll
  473. 14:39include um I don't know the time and and
  474. 14:41and date and so on and so forth. But
  475. 14:43yeah, I mean like that is that's about
  476. 14:44how detailed we're getting under the
  477. 14:46hood. Uh but we again don't need to
  478. 14:47store any of that stuff. Just wanted to
  479. 14:49make sure you guys all understood what
  480. 14:50was really going on under the hood. So
  481. 14:51you don't need to know everything that I
  482. 14:53just said. That's okay. I'm going to
  483. 14:54walk you guys through the actual build
  484. 14:56process. And the good news is I don't
  485. 14:57even know, you know, what 90% of this
  486. 14:59stuff really is. I just understand it at
  487. 15:00a high level, which is sufficient. Um,
  488. 15:02as long as you understand the way that
  489. 15:03the data flows, we can actually take
  490. 15:04that and use that to build our knowledge
  491. 15:05base. You don't need a crazy dev to do
  492. 15:07this. Um, you know, we can 100% do this
  493. 15:09ourselves. Okay. So, how do you actually
  494. 15:10build something like this in practice?
  495. 15:12Well, the very first thing you need to
  496. 15:13do, so you need to whip up a coding
  497. 15:15agent of some kind. And so, in my case,
  498. 15:17I'm using Claude Code V2.1.211.
  499. 15:21I'm not saying you have to use Claude
  500. 15:22Code. You can use one of many available
  501. 15:24open models, but this Fable 5
  502. 15:26intelligence right now just happens to
  503. 15:27be the best, aka the most performant,
  504. 15:29and um I have the money to to pay for
  505. 15:31it, so might as well. Okay, so you can
  506. 15:33get whatever model you want, Claude
  507. 15:35Code, you know, Chat GPT, Codeex,
  508. 15:37whatnot. As long as it's like a coding
  509. 15:39model, it can actually make changes on
  510. 15:40your computer, you're good. And if you
  511. 15:41want more information on that, then just
  512. 15:43um you know, check out my my 4-hour
  513. 15:44Cloud Code course. So, all we really
  514. 15:46need to do to make this work is I'm just
  515. 15:48going to copy this whole blog post in.
  516. 15:50Okay? Okay. And then I'm going to go all
  517. 15:51the way back to my Ghost TTY terminal.
  518. 15:54That's just what I happen to be using
  519. 15:55for this. Then I'm going to paste this
  520. 15:57in. Then I'll say, I'd like you to build
  521. 15:59something like this for, and in my case,
  522. 16:02I'll say Nick Sarif Media LLC. I have a
  523. 16:06Slack, a set of emails, an email
  524. 16:08address, a GitHub, and a YouTube
  525. 16:11channel. I want us to build ingestion
  526. 16:14pipelines, which is just how we get data
  527. 16:16into the system for all of them. I'll
  528. 16:18also say PS this is a demo. I've already
  529. 16:21done this. Given that it's a demo in
  530. 16:23front of the audience, I want you to
  531. 16:24build it totally fresh. The reason for
  532. 16:26that is because I've just already done
  533. 16:27this several times. And what I wanted to
  534. 16:29do is just pretend that it's totally
  535. 16:31new. Now, the cool thing is, as
  536. 16:33mentioned, you do not need to know how
  537. 16:34this works. You can just go through
  538. 16:36this, okay, entirely autonomously. Uh
  539. 16:38the model can sort of figure it out. Um,
  540. 16:40if for whatever reason Cabris has, I
  541. 16:43don't know, put a block on their page,
  542. 16:44then rather than feeding the URL, you
  543. 16:46can also just go back to Google Chrome,
  544. 16:48copy the whole thing manually, and
  545. 16:49literally just paste it in. Um, the
  546. 16:51important thing is you just need to get
  547. 16:52it in to like this intelligent model.
  548. 16:54Now, what it'll do next is it's going to
  549. 16:55attempt to log in to all of the various
  550. 16:57accounts of reference. So, in my case, I
  551. 16:59actually have accounts that are already
  552. 17:01logged in. For instance, I have GitHub
  553. 17:03logged in. I have my YouTube channel
  554. 17:06logged in. I have my email addresses
  555. 17:08logged in. And so it'll do so almost
  556. 17:10entirely automatically basically at
  557. 17:12once. But I want you guys to know that
  558. 17:13that might not necessarily be the case
  559. 17:15for you. And so if you guys wanted for
  560. 17:17instance an email to be set up, all you
  561. 17:20have to do is just open up a new
  562. 17:22instance of this. And I'm just going to
  563. 17:23go claw-bose. I'm just going to zoom in
  564. 17:26a little bit so you guys could see both
  565. 17:27of these. And then I'll say something
  566. 17:28like, "Hey, I want you to get access to
  567. 17:32my email." Then I'm just going to give
  568. 17:34it one of my emails, nickleclick.ai.
  569. 17:37You should be able to query each email,
  570. 17:40read all of my emails, send emails,
  571. 17:43basically have full admin access. How
  572. 17:45would you do this hypothetically if you
  573. 17:48didn't already have access to it? Now,
  574. 17:51I'm asking that question because it
  575. 17:52already has access to my emails and I
  576. 17:54don't want to sit here for 4 hours
  577. 17:55showing you guys it say I already have
  578. 17:58access to your email. And as you can
  579. 17:59see, it eventually will tell you here's
  580. 18:01how you'd set it up from scratch. You
  581. 18:03would have to open up a Google Cloud
  582. 18:04project, enable the Gmail API, do an
  583. 18:07OOTH consent screen to create an OOTH
  584. 18:09client, some sort of desktop app. Uh you
  585. 18:12would have to do a one-time consent
  586. 18:14form. You'd also need some sort of
  587. 18:16refresh token. I guess what I'm trying
  588. 18:17to say is it's not it's not very
  589. 18:19difficult. This would realistically take
  590. 18:20you about 5 to 10 minutes for every
  591. 18:22pipeline of information that you want to
  592. 18:24set up. And so that's the cool thing
  593. 18:25about agents. I mean, you can just ask
  594. 18:26them, hey, how do you do this? And if
  595. 18:28the model is smart enough, in our case,
  596. 18:29Opus 4.8 8 in this instance, but you
  597. 18:31know, you could use Fable 5, you could
  598. 18:33use GPT 5.6, so you can use whatever you
  599. 18:35want. Um, you'll get the credentials
  600. 18:37that you need in order to build set
  601. 18:38injection pipeline. And on the left hand
  602. 18:40side, speaking of it is currently doing
  603. 18:42the building. Now, because I kind of
  604. 18:44want to see what's going on, I'm
  605. 18:46actually just going to go /btw. That's a
  606. 18:48cloud code specific feature. And I can
  607. 18:50say, visualize the system you're
  608. 18:52building for me in ASI. In case you guys
  609. 18:55didn't know, ASKI is just a text way to
  610. 18:58demonstrate sort of visually like what a
  611. 19:00di like a diagram or something like
  612. 19:01that. And so what this is now doing is
  613. 19:03while the main thread is running, I have
  614. 19:05another thread that's going on on top of
  615. 19:07that just asking it various questions.
  616. 19:09And so I'm saying visualize the systems
  617. 19:10you're building and asking. And here's
  618. 19:11what it's doing. It's actually showing
  619. 19:12me it so we could see. I'm just going to
  620. 19:13zoom out. And so what we're doing is
  621. 19:15we're basically building that exact
  622. 19:16thing. We have a Slack over here. We
  623. 19:18have three accounts over Gmail. We have
  624. 19:20my GitHub. Then we also have my YouTube
  625. 19:22channel. And so these are the
  626. 19:23connectors. So this is sort of like the
  627. 19:25APIs and uh MCPs and whatever it is that
  628. 19:28allows us to pump stuff in there. We
  629. 19:29have the distillation step like I talked
  630. 19:31about earlier where we're basically
  631. 19:32taking each thread passing it through a
  632. 19:34ha coup in this case feeding in a
  633. 19:36question a summary resolution systems
  634. 19:38and then we're ingesting this into our
  635. 19:40actual pipeline or database if we're
  636. 19:42giving it just one table in what looks
  637. 19:44like postgrql. And then down at the very
  638. 19:46bottom here we have retrieval setup with
  639. 19:48full text where we look for exact
  640. 19:50matching tokens and stuff like that and
  641. 19:52then embedding. Okay. And right after
  642. 19:54this is all done, I'm just going to jump
  643. 19:56to it and then I'll show you guys how it
  644. 19:57actually works when you query it. And
  645. 19:58now you can see sort of a artifact that
  646. 20:01shows the same model asked the same 20
  647. 20:03questions, one with the knowledge base
  648. 20:05and one without. You can see that the
  649. 20:07one that had the knowledge base answered
  650. 20:0817 out of 20 questions correctly. Um the
  651. 20:11other three were just honest partials or
  652. 20:13declines. It just said, "Hey, I don't
  653. 20:14really know what's going on cuz I don't
  654. 20:15have the evidence to to back it up."
  655. 20:17Whereas without the knowledge base, I
  656. 20:19answered zero. So I mean, these are
  657. 20:21really high quality. Um, comparatively,
  658. 20:22you can imagine how rolling this out
  659. 20:24inside of any companies would
  660. 20:25significantly improve both the quality
  661. 20:27and then the speed with which you get
  662. 20:28things answered. So, for instance, which
  663. 20:30AI company recently pitched a paid
  664. 20:32sponsorship for the Stacked podcast? In
  665. 20:35case you guys didn't know, I run a
  666. 20:36podcast with Jack Roberts called
  667. 20:38Stacked. And, you know, we're we've
  668. 20:40recently grown a little bit. Um, I think
  669. 20:42we're up to 5,600 subscribers now. So,
  670. 20:44Jack and I kind of screwing around,
  671. 20:46having a fun time. We're almost at 6K.
  672. 20:48Well, uh, you know, if you just asked
  673. 20:49that question natively, obviously you
  674. 20:51wouldn't get the answer. But in our
  675. 20:52case, we know it's abacus.ai. They
  676. 20:54pitched a paid sponsorship for the
  677. 20:55stacked podcast promoting as chat LLM
  678. 20:58all-in-one AI super assistant. The
  679. 21:00outreach came from insert person here.
  680. 21:02Did we take it? Absolutely not. Or how
  681. 21:04about this one? Which GitHub repos did
  682. 21:06NSM push to most recently? We actually
  683. 21:08have the exact GitHub activity right
  684. 21:11over here. And it was just me replacing
  685. 21:13sort of a defunct company name with a
  686. 21:14new company name. Now, this isn't super
  687. 21:16impressive. any sort of rag could do
  688. 21:18this. What is impressive is the fact
  689. 21:19that this data is now being ingested
  690. 21:20completely automatically and I have
  691. 21:22nothing that I need to do with it. It
  692. 21:24occurs entirely without my control not
  693. 21:26without my control but not requiring my
  694. 21:28management. Um this will occur in the
  695. 21:30background and so I can ask this any
  696. 21:32sort of question that I want at any
  697. 21:34point in time. Unfortunately, the thing
  698. 21:35you can't really visualize is just how
  699. 21:37much better this is than naive rag,
  700. 21:39which most other people are doing
  701. 21:41because we have information like the
  702. 21:43date and time, aka how long it's been
  703. 21:46since the thing was created. We also
  704. 21:48have significantly higher quality rag.
  705. 21:50You know, I only had 640ish documents
  706. 21:53inside of my system. A company like
  707. 21:54Cerebrus probably has, you know,
  708. 21:56hundreds of thousands. Uh the thing that
  709. 21:58differentiates like a crappy
  710. 22:00knowledgebased uh system that you ask
  711. 22:01questions to and have woven into your
  712. 22:03business with the ones that are good
  713. 22:05isn't necessarily how many documents you
  714. 22:06have, but it's how effectively can you
  715. 22:07retrieve the highest quality ones, the
  716. 22:09most relevant ones. And uh that's the
  717. 22:11question that this sort of rag system
  718. 22:12answers. So I'm not going to tell you
  719. 22:14have to use this one. There are
  720. 22:15obviously a bunch of different rags that
  721. 22:16you can use and there also a bunch of
  722. 22:18different approaches to knowledge bases,
  723. 22:19but this is done by a major business.
  724. 22:21These guys aren't screwing around.
  725. 22:23They're not going to do something like
  726. 22:24this if it doesn't actually generate a
  727. 22:26return on their time and energy. And as
  728. 22:28it stands right now, this is definitely
  729. 22:29generating a return on time and energy.
  730. 22:31It's generating a return on time and
  731. 22:32energy for me because I have this
  732. 22:34syndicating and then embedding and then
  733. 22:36pulling and and enriching all content
  734. 22:38that I'm currently creating and that is
  735. 22:40going into my business. It's it's a it's
  736. 22:41an abundant training resource that
  737. 22:43immediately gets everybody up to speed
  738. 22:45in my team. uh you know, it's something
  739. 22:46that I can just dole out literally with
  740. 22:48the snap of a finger and I can give them
  741. 22:51the same brain that I personally have
  742. 22:52spent a long time creating. And the
  743. 22:54unfortunate thing is doesn't look super
  744. 22:56sexy. I don't have a big floating brain
  745. 22:57in the middle of my screen, but you
  746. 22:58know, it's the same resource that's
  747. 23:00accessible via Obsidian or via, you
  748. 23:02know, Graphify or whatever the heck. Um,
  749. 23:04this is just probably the higher ROI way
  750. 23:07of doing it because of the frequency
  751. 23:08waiting, the time waiting, and stuff
  752. 23:10like that. Anyway, as you guys could
  753. 23:11tell, I'm uh singing hard for Cerus. a
  754. 23:14dope company and this is not a sponsored
  755. 23:16post in any way, shape or form. I was
  756. 23:18not paid any money to do this. I just
  757. 23:20think it's probably the coolest
  758. 23:21knowledgebased implementation that I've
  759. 23:22ever seen. So yeah, that's that. If you
  760. 23:23guys like this sort of thing, definitely
  761. 23:24check out Maker School. It's my
  762. 23:26day-by-day accountability roadmap where
  763. 23:27I show you guys how to acquire your very
  764. 23:29first customer for an AI or automation
  765. 23:31service, which could be building rag or
  766. 23:33knowledgebased systems like this um for
  767. 23:35money within 90 days, or you get all of
  768. 23:37your money back. So I have a refund
  769. 23:40guarantee because it works really well
  770. 23:41and obviously I would love to see you
  771. 23:42there. Have a lovely rest of the day.
  772. 23:44Subscribe to the channel if you haven't
  773. 23:45already.

About this transcript

This page contains the full transcript of Cerebras Killed Notion, Obsidian, and Your "Second Brain" by Nick Saraev, generated from the public captions YouTube serves with the video. The transcript has 5,543 words across 773 segments, with the original timestamps preserved so you can click any line to jump to that moment in the embedded player.

What you can do with it

Use the transcript to take notes, quote the speaker, build a study guide, generate a summary with ChatGPT or Claude via the YouTube Summary tool, or export it as a timed subtitle file with YouTube to SRT. You can also re-open it in the transcriber to translate the transcript into 100+ languages.

Free YouTube transcript tool

YouTube2Text is a free YouTube transcript generator — no signup, no daily limit. Paste any YouTube link and get the full transcript instantly, with timestamps, click-to-jump, translation to 100+ languages, AI prompts for ChatGPT, Claude, and Gemini, and exports to TXT, SRT, VTT, or Markdown.