Build An AI Second Brain Knowledge Base (Step-By-Step) — Transcript
Full transcript
- 0:00So, I just built a second brain
- 0:01knowledge management system that has an
- 0:03entire wiki built in that I can chat
- 0:05with. It will pull any information from
- 0:07that second brain when I chat. It's got
- 0:09a built-in CRM. I can journal, and it
- 0:11will actually look at my wiki knowledge
- 0:13base and try to help me with whatever
- 0:15issues I'm going through from my journal
- 0:18by looking inside of the wiki. And of
- 0:20course, it's got all of the content that
- 0:23I've saved from around the web,
- 0:24including YouTube videos and articles
- 0:26and tweets and podcasts and just tons of
- 0:30stuff that I've injected into this that
- 0:31is all accessible directly from a chat
- 0:34or from journaling. It is really, really
- 0:36sweet, and I'm going to break down how
- 0:38the whole thing works and how you can
- 0:39build one for yourself right now. Most
- 0:41second brain systems are just like
- 0:42storage, right? You dump your YouTube
- 0:45transcripts and your articles and your
- 0:47blog posts and your podcasts and just
- 0:49everything that you're interested in,
- 0:51you just dump it all into one place.
- 0:53Problem is, that's kind of where the
- 0:55information just goes to die. Unless
- 0:57you're like actively going back through
- 0:59and reviewing the notes all the time and
- 1:01searching through your second brain,
- 1:03it's just a dumping ground for
- 1:04information that I never go back and
- 1:06look at later. So, for the knowledge
- 1:08management system that I'm going to
- 1:09build, there's three core pillars that I
- 1:12want to build for mine. Number one is
- 1:13the wiki/knowledge base. This is where
- 1:16I'm going to store like everything from
- 1:17around the web that I find. YouTube
- 1:19transcripts, articles, podcast
- 1:21transcripts, tweets, you name it, it all
- 1:24goes into this wiki knowledge base
- 1:26section. Number two is my CRM. So,
- 1:28whenever I go to a events and I meet
- 1:30people or I jump on Zoom calls with
- 1:33people, I want to remember those
- 1:34conversations and I want to be able to
- 1:36recall them in the future. I also want
- 1:37to store details about those people, how
- 1:40I met them, where I met them, some of
- 1:42the discussions we had, any sort of
- 1:44contact details I got from them, email,
- 1:46phone number, address, whatever. They
- 1:48can all live in this sort of CRM element
- 1:50of this bigger second brain that I'm
- 1:52building. And the third element is where
- 1:53this all gets pulled together, and And
- 1:55the journal. Now, I'm a big journaler. I
- 1:57journal pretty much every single day.
- 1:59When I have good days, I journal about
- 2:01what went right, the things I'm excited
- 2:03about, gratitude, that sort of stuff.
- 2:04When I have rough days, I journal about
- 2:06the things that are bothering me. My
- 2:08videos not performing as well as I want
- 2:10them to, having a creative block and not
- 2:12knowing what to make videos about. I do
- 2:13a lot of travel and I debate a lot about
- 2:16whether the travel's going to be worth
- 2:17it or not. I journal about pretty much
- 2:19everything in my business. So, these are
- 2:21my three ideal inputs. For you, it might
- 2:24be clients or workouts, research papers,
- 2:27recipes, sales calls, classroom notes.
- 2:30The point is, the knowledge base sits at
- 2:32the center and then everything else sort
- 2:34of connects to it. The two elements that
- 2:36I think are probably the most useful to
- 2:38the most amount of people are going to
- 2:39be the wiki and the journal. Maybe the
- 2:41CRM isn't what you need. Again, maybe
- 2:43it's your classroom notes, your
- 2:45workouts, your recipes, et cetera. So,
- 2:47here's a rough drawing of what I have in
- 2:50mind. So, you've got your knowledge base
- 2:51that lives at the center of all of this.
- 2:53All of this knowledge is going to live
- 2:55in Obsidian. I'll get into the whole
- 2:57building process in a second. You're
- 2:58going to save articles from around the
- 3:00web, YouTube videos, you know, podcast
- 3:02notes, whatever you find around the web
- 3:04that's relevant to you, you're going to
- 3:06save it with a simple Chrome web clipper
- 3:08and it's going to save into your
- 3:09knowledge base. The CRM that I just
- 3:11mentioned, notes about people you met
- 3:13and where you met them and all that kind
- 3:15of stuff gets saved to the knowledge
- 3:16base. Meeting notes, I personally use
- 3:18Granola to record my meetings and take
- 3:20notes for me. Those meeting notes can
- 3:22automatically be injected into the
- 3:24knowledge base. And then you have
- 3:25journal entries. This is the layer where
- 3:27you actually interact with your
- 3:29knowledge base. You journal on what
- 3:31you're dealing with right now and
- 3:32ideally it's going to pull from the
- 3:34knowledge base that has all of this
- 3:35other information in it to ground the
- 3:37responses to your journal entries. This
- 3:40will make more sense as I go. Please
- 3:42excuse the PowerPoint style slide here,
- 3:44but I really want to explain what I'm
- 3:46trying to build. So, here's the system I
- 3:47imagine. You save your articles, your
- 3:49transcripts, et cetera, into this
- 3:51system. We'll do that using a web
- 3:53clipper. The AI layer in the background
- 3:55that we're going to build then
- 3:56summarizes this stuff for us. So, it's
- 3:58not just a giant transcript, it's
- 4:00actually sort of the bullets and just
- 4:02the information we need to know. The AI
- 4:04is also going to extract people,
- 4:05companies, tools, ideas, and themes, and
- 4:08sort of break those off. That's where it
- 4:10becomes kind of like a wiki. You could
- 4:11click into the tools page and it will
- 4:13list off all the tools that have been
- 4:15mentioned across everything that we've
- 4:17saved. You can click into one of the
- 4:18tools and it will mention where and what
- 4:20video that came from. And that goes for
- 4:23all of these little categories here. I
- 4:25also wanted to auto-link related notes.
- 4:27So, if I have multiple videos about how
- 4:29to build something with OpenClaw, they
- 4:31all get cross-referenced to each other
- 4:33and I can click around and sort of jump
- 4:35into others. If you're familiar with
- 4:37other second brain systems or like the
- 4:39Zettelkasten system, it's essentially
- 4:41that same concept of interlinking. I'm
- 4:43then going to let the journal directly
- 4:45into the system. So, when I do write
- 4:47journals, it responds like ChatGPT, but
- 4:50it's actually grounded in my own saved
- 4:51knowledge. So, it's not going to just
- 4:53respond with what ChatGPT would have
- 4:56responded with. It's going to respond
- 4:57with something like, "I see you're
- 4:59struggling with ideas for videos. Well,
- 5:01you saved this video 3 days ago that
- 5:03says you should do this, this, and this.
- 5:05You also saved this video 2 weeks ago
- 5:07that gave this advice when you're
- 5:08struggling with video ideas." And it
- 5:10will actually pull from the knowledge
- 5:12that I've saved, making it more tailored
- 5:14to exactly what interested me and what I
- 5:17found valuable over time as I save stuff
- 5:20into the system. It's also going to use
- 5:21AI to find patterns from past journal
- 5:23entries. So, if I'm constantly
- 5:25journaling on the same thing over and
- 5:26over again, the same struggle, it's
- 5:28going to see that as a pattern and take
- 5:29that into account when it's responding
- 5:31to my next journal entries. It should
- 5:33resurface relevant ideas when I need
- 5:35them, and it should also let me save
- 5:37notes about people and connect those
- 5:39people to ideas, companies, events, and
- 5:40conversations. So, the CRM and the
- 5:42meeting notes that I'm constantly
- 5:44saving, that should also be connected to
- 5:46ideas and journal entries and all of it
- 5:48sort of pulled together in this big
- 5:50mashup of like here's the conversations
- 5:52I've had, here's what I'm journaling on,
- 5:53here's what I've saved that I found
- 5:54interesting, and it's all in this big
- 5:56old soup of content that I'm saving, but
- 5:59that big old soup of content that I'm
- 6:00saving is the grounded information that
- 6:03is getting pulled when I write my
- 6:05journal entries and then get a chat
- 6:06response based on those journal entries.
- 6:08All right, now that I've completely over
- 6:10explained this, let's just jump into the
- 6:12process I'm going through to build this.
- 6:14>> There's a cool new feature from
- 6:15Hostinger that's made for deploying AI
- 6:17agents at home. So, if you've ever
- 6:19wanted to run something like OpenClaw,
- 6:21but don't know where to start or find it
- 6:23really complicated, this is going to
- 6:24make the process a lot easier. I
- 6:26actually use OpenClaw myself, so I can
- 6:28attest that the setup can get pretty
- 6:30technical. Right now, it's deployed on
- 6:32my DGX Spark and my favorite thing it
- 6:35built is simple CRM that when I meet
- 6:37people at events, I can save quick notes
- 6:39in Slack and then later ask it to remind
- 6:42me what we talked about. So, it's great
- 6:44for automating everyday things like that
- 6:46to full-on businesses and these huge
- 6:49agentic systems, which I've also seen
- 6:51people do. And this new feature from
- 6:53Hostinger makes it a lot easier to set
- 6:55up. You can either pick a managed
- 6:57OpenClaw plan or a VPS option. The
- 7:00managed version is honestly the easiest.
- 7:02It's a one-click deployment that
- 7:03includes built-in AI credits, web
- 7:05scraping already connected, and they
- 7:08handle the updates, backups, and
- 7:09security for you. You just go to the
- 7:11OpenClaw landing page on Hostinger,
- 7:13click get OpenClaw, choose your plan,
- 7:16and by the way, if you do the 12- or
- 7:1824-month option, it's even cheaper per
- 7:20month. Then, during setup, you choose
- 7:22your AI provider, pick your
- 7:24communication channel like Telegram or
- 7:26WhatsApp, and launch. And then, once
- 7:28it's live, your agent runs 24/7. AI
- 7:31agents like this used to feel very
- 7:34gatekept. Like, only the really
- 7:36technical people or big enterprises were
- 7:38able to use them, but now it's pretty
- 7:39cool how easy it's become to set it up
- 7:41and use it for yourself at home. So, if
- 7:44you've wanted your own AI assistant
- 7:45without the headache of managing servers
- 7:48manually, this is probably the easiest
- 7:50way I've seen to do it. Check it out at
- 7:52the link in the description box, and to
- 7:53save even more money, use my code Matt
- 7:56Wolfe for an additional 10% off. And
- 7:58thank you so much to Hostinger for
- 7:59supporting my channel and sponsoring
- 8:01this portion of today's video. Now,
- 8:03before I go any further on this, I do
- 8:04want to give credit where credit is due.
- 8:06This whole LLM knowledge base idea came
- 8:08straight from Andrej Karpathy. I
- 8:10specifically took the idea of using
- 8:12Obsidian as the front end. Obsidian sort
- 8:14of helps organize and easily read
- 8:17markdown files. I'm just sort of
- 8:19extrapolating off of this idea and
- 8:21adding my journaling element and my CRM
- 8:23element to the wiki concept that Andre
- 8:26laid out here. Now, in order to build
- 8:27this, you're going to need a couple
- 8:28tools. I'm going to build this in Codex
- 8:30here. This has been sort of my IDE of
- 8:32choice lately to do coding and projects
- 8:35like this. This is free to download, and
- 8:37you get a certain amount of usage on the
- 8:38free ChatGPT plan, but you're going to
- 8:40get the most out of it if you do end up
- 8:42upgrading. I'm also using Obsidian here.
- 8:45Again, this is just a giant markdown
- 8:47organizer and reader. This is totally
- 8:49free to get. You can find it over at
- 8:51obsidian.md.
- 8:52You're also going to want the Obsidian
- 8:54web clipper. So, if you're on the
- 8:56obsidian.md website, I can scroll all
- 8:58the way to the bottom here, and you can
- 8:59see there's a link for web clipper.
- 9:01Click in there, click add to Chrome, and
- 9:03you'll get this little Obsidian web
- 9:05clipper that you can see here in my
- 9:07Chrome. And if I click this, this is
- 9:08what automatically creates a new
- 9:11markdown file, a new note for whatever
- 9:13page you're on. And the cool thing that
- 9:14I really like about this Obsidian web
- 9:16clipper is that it automatically pulls
- 9:18the transcripts from any YouTube video.
- 9:20So, if I come over here to YouTube and
- 9:22click on one of my recent YouTube
- 9:24videos, and then I come up to the
- 9:25Obsidian web clipper, it'll take a
- 9:26second to load, but it will eventually
- 9:28load the entire transcript for this
- 9:31whole video straight into Obsidian, and
- 9:33that makes it really easy to inject any
- 9:35YouTube video or any article you find
- 9:38around the web directly into your
- 9:40Obsidian vault. So, once you have
- 9:42Obsidian installed on your computer,
- 9:44create a brand new vault, and I'm going
- 9:46to call it second brain, and I'm going
- 9:48to save it in a folder on my computer
- 9:49called second brain. Now, I'll open
- 9:52that, and we'll create this new vault,
- 9:53and you can see I have a fresh blank
- 9:56vault with nothing in it yet except for
- 9:58a little welcome message. Now, it's
- 10:00important to remember where on your
- 10:02computer you just saved this vault, cuz
- 10:04that's going to be necessary in the next
- 10:05step here. I'm going to delete this
- 10:07welcome message. It's not going to be
- 10:08necessary, and now we have a purely
- 10:10empty clean vault. So, for the next
- 10:13step, I'm going to jump into Codex, and
- 10:15we're going to actually build the dang
- 10:16thing. So, over on the left here inside
- 10:19of Codex, I'm going to click on add new
- 10:21project, and then I'm going to select
- 10:22use an existing folder. It's going to
- 10:24open up my browser here to pick the
- 10:26folder, and I'm going to go to the exact
- 10:28folder that we just set our Obsidian
- 10:31vault up with. So, for me, it's this
- 10:32second brain folder that I created here,
- 10:35and we'll go ahead and open that, and
- 10:36then you can see I now have a project
- 10:38over here called second brain. So, to
- 10:40start this off, we're going to build the
- 10:41basic bones of our wiki. And luckily,
- 10:43Andre Karpathy generously gave us this
- 10:46GitHub page that explains exactly how
- 10:49the wiki architecture works. So, the
- 10:52initial sort of hard part of building
- 10:54the wiki is already figured out for us.
- 10:56We can just take this URL to this GitHub
- 10:58post here, open up Codex, make sure
- 11:00we're in our second brain project folder
- 11:03here, and giving it the prompt build out
- 11:05architecture based on Karpathy's LLM
- 11:07wiki here. I'm linking to that page on
- 11:09GitHub that we were just looking at, and
- 11:10then I said the current second brain
- 11:12folder is the folder that Obsidian is
- 11:14connected to. It is currently empty, so
- 11:15we're building from scratch. And let's
- 11:18go ahead and let it build out the sort
- 11:20of architecture bones for us based on
- 11:22what Karpathy's already figured out. All
- 11:24right, so it worked for about 5 minutes.
- 11:26It actually built out a whole bunch of
- 11:29extra files that it didn't need to
- 11:31build. I don't know why it created 51
- 11:33files. The architecture is actually
- 11:35supposed to be pretty small for this.
- 11:37So, I literally prompted it, "Please
- 11:38remove all the extra crap and just build
- 11:40what's explicitly called for in
- 11:42Carpathy's game plan." And it says,
- 11:44"Done. I pruned it back to the minimal
- 11:45Carpathy game plan." And now we just
- 11:47have these files built in. If we pop
- 11:50open Obsidian here, you could see we've
- 11:52got just the folders we need. We have
- 11:53the raw folder, we have the wiki folder,
- 11:56we have our agents.md file, our index.md
- 12:00file, and our log.md file. We can see
- 12:03here exactly what each of these is for.
- 12:05The raw folder is for the immutable
- 12:07source material. This is where the
- 12:08original stuff goes. Raw/assets, this is
- 12:11for optional local Obsidian attachments.
- 12:13You got the wiki. This is the
- 12:15AI-generated markdown files that it's
- 12:17pulling from the raw content that we're
- 12:20inputting. You have the agents.md file,
- 12:22which basically explains how this whole
- 12:24thing works. So, we can see it's got the
- 12:26operations. When the user adds a source
- 12:28and asks LLM to process it, it does all
- 12:30these things. When the user asks a
- 12:32question, it queries it this way. So, it
- 12:34basically tells it how this agent should
- 12:36operate. You have the index.md file.
- 12:39This is basically the catalog of
- 12:41everything that's in the wiki. And then
- 12:42you have the log file, where whenever
- 12:44you make updates or changes or add
- 12:45things, it updates the log file. Super,
- 12:48super simple. We're starting bare-bones
- 12:50here. If I look directly in the folder,
- 12:52we just have what you see inside of
- 12:54Obsidian. So, now I'm going to make sure
- 12:56that my Obsidian web clipper is dialed
- 12:58in. So, I'll go ahead and click on this.
- 13:00We'll click on settings. Make sure you
- 13:02add the name of your vault right here
- 13:04under the vault list. If you're in
- 13:05Obsidian down in the very bottom left
- 13:07corner down here, you can see this is
- 13:09the name of the vault. So, make sure
- 13:11it's the same name exactly. And then
- 13:13over under default, you've got the
- 13:14templates over here. Click on the
- 13:16default template and make sure that you
- 13:18select that Second Brain vault or
- 13:20whatever you titled it. And then I'm
- 13:21having mine pull in these properties.
- 13:23The source title, the source URL, the
- 13:25date that it was created. That's the
- 13:26date that I'm saving it in the web
- 13:28clipper, not the date that the article
- 13:29was actually written, and it's adding an
- 13:31automatic web clip tag to it. And then
- 13:34for the note content, it's just pulling
- 13:35in the content. A lot of this might
- 13:37actually be set for you by default, but
- 13:39if it's not, this is what it should look
- 13:40like. Under note location, we're going
- 13:42to change this to just say raw, because
- 13:45that is the folder inside of our
- 13:47Obsidian vault that we want it to dump
- 13:49it inside of. All right, so I can close
- 13:51out of this, and for the very first
- 13:52thing I'm going to ingest, might as well
- 13:54ingest the instructions for how to build
- 13:57one of these wikis. I know it's very
- 13:58meta, but I want it inside of my wiki.
- 14:01I'll click on my little Obsidian clipper
- 14:03button, and you can see the source
- 14:04title, LLM Wiki, we've got our source
- 14:06URL, the date I'm pulling this in, and
- 14:08the tags for web clip. And then here is
- 14:10all of the content of this page here.
- 14:12We'll go ahead and click add to
- 14:13Obsidian, and we can see it added it
- 14:15directly inside of the raw folder here
- 14:18inside of Obsidian. Now, nothing's going
- 14:20to happen automatically. We actually
- 14:22need it to tell it to process the files
- 14:24inside of raw for anything to actually
- 14:26happen. But let's add a few more things.
- 14:28I'm going to look through my YouTube
- 14:29history and ingest some of the recent
- 14:31videos that I've watched, like this
- 14:33video called how to trick your brain
- 14:35into becoming so disciplined your
- 14:36friends will be shocked by your success.
- 14:38I love a lot of psychology and mindset
- 14:40type videos, so if I want to ingest
- 14:41this, I come up to my web clipper, and
- 14:43you can see it's going to pull in the
- 14:45entire transcript here. So I'm going to
- 14:47go ahead and click add to Obsidian, and
- 14:49once again, we've got another file here
- 14:51under raw. Now, there's one issue that's
- 14:53going to pop up when I pull in YouTube
- 14:55videos, is it's not going to properly
- 14:57know the channel name, because it's not
- 14:59automatically pulling it in into any of
- 15:01these properties. But I can go to codex
- 15:03here and give it some additional
- 15:04instructions. When I save a video from
- 15:07YouTube using the Obsidian web clipper,
- 15:10and then you go and process the files,
- 15:13make sure it also pulls the channel name
- 15:16from YouTube and adds it as one of the
- 15:18front matter fields. All right, so let's
- 15:20go ahead and do that. So now let's go
- 15:22ahead and do a quick test. We've got two
- 15:23source files in here. So I'm going to
- 15:25jump into Codex and go ahead and tell it
- 15:27to process the files inside the raw
- 15:30folder. Let's see how well it does right
- 15:32now. All right, so it took about 3
- 15:34minutes to process and it created a few
- 15:37new sections. So let's just go ahead and
- 15:39pull open Obsidian here and we can see
- 15:41it left the original source material
- 15:43here, but then it started to build out
- 15:45the wiki of everything else. So we've
- 15:48got our compounding knowledge base which
- 15:50was clearly pulled from the explanation
- 15:52from Andre, discipline without
- 15:54willpower. This was pulled from this
- 15:56channel, Aaron Miller study. Let me just
- 15:59double check that it got the channel
- 16:00name correct. Yep, Aaron Merrill study,
- 16:03environment design. We can see this was
- 16:05from the source discipline without
- 16:07willpower, which was one of the concepts
- 16:09that it saved, which came from this
- 16:11original video that we saved. Identity
- 16:13led goals, LLM wiki, temporal
- 16:15discounting, and temptation bundling. So
- 16:18we can see our wiki is starting to get
- 16:19built out we have our index here, our
- 16:21various sources, the LLM wiki and the
- 16:24discipline without willpower. It
- 16:25actually renamed it cuz it was
- 16:27originally called how to trick your
- 16:28brain into becoming so disciplined your
- 16:30friends will be shocked by your success,
- 16:31but it decided discipline without
- 16:33willpower was a better name for it. We
- 16:35can see the concepts here and it's
- 16:37starting to build out. And if we look in
- 16:38our log, we can see what it registered
- 16:40in our log so far since we started
- 16:42building this. One thing that I actually
- 16:44like to do as this gets bigger and
- 16:46bigger is you've got this graph view
- 16:48here that starts really small when you
- 16:50first build it and over time you'll see
- 16:52this build out and build out and things
- 16:54get more interconnected with each other
- 16:56and it just gets really cool over time.
- 16:58Now, I'm going to go seed this with some
- 17:00more content. I'm going to go through my
- 17:01watch history and pull in some of the
- 17:03other videos that I watched recently,
- 17:05using your money to be happier, the art
- 17:06of tripod filmmaking, how to become
- 17:08addicted to doing hard things, if you
- 17:10think you're too busy watch this, how to
- 17:12become a lucky person, and then build
- 17:14your own self-improving AI wiki in 11
- 17:16minutes. I know that's very meta, but
- 17:18let's go ahead and import that. So, I'm
- 17:20just going to go through and inject
- 17:21every single one of these like we just
- 17:23saw. I'm going to let it process them
- 17:25all, and then they'll all be in the
- 17:26Wiki, and then we'll move on to the next
- 17:28steps, which are building out the
- 17:30journal and the CRM elements that I
- 17:32mentioned earlier. Okay, so it's done
- 17:34injecting all of those videos that I
- 17:36just saved. It took about 6 minutes
- 17:38here, and this is what my Obsidian looks
- 17:39like now. You can see all of the assets
- 17:41of stuff that I ingested into it, and
- 17:44the Wiki is getting built out quite a
- 17:46bit more. We've got our index here, and
- 17:48as you can see, the index is also
- 17:50getting built out more as well. If I
- 17:52click into like Hermes agent here, we
- 17:55can see we've got key ideas from this
- 17:57original video plus related content
- 17:59inside of our Wiki. So, Codex
- 18:01capabilities, I click on this one, and
- 18:03it jumps to the video from Riley Brown
- 18:05and the details around that one. Again,
- 18:07this is the very, very simple, basic
- 18:09setup of Carpathys' LLM Wiki. Now, if I
- 18:13come into Codex again, we can
- 18:15essentially chat with the Wiki. So, I
- 18:17come to my second brain folder, click on
- 18:19new chat, and I can ask questions. Like,
- 18:21what are some tips for motivation when I
- 18:23don't feel like doing the hard task
- 18:25today? I know I saved a couple videos
- 18:27about this exact topic, and we can see
- 18:29it's already saying, "I'll treat this as
- 18:30a Wiki query. First, I'm checking the
- 18:32vault index, then I'll answer from
- 18:34anything already captured and add the
- 18:36reusable bit back into the Wiki if it
- 18:38isn't there yet." Here's our final
- 18:39response. When you don't feel like doing
- 18:41the hard task, don't wait for motivation
- 18:42to arrive first. Treat it as a task
- 18:44design problem. Make the first few
- 18:46minutes smaller, easier, and more
- 18:47rewarding. Try this. Gives me a handful
- 18:49of tips, and this was all pulled and
- 18:51grounded from the Wiki, but it also
- 18:54updated the Wiki based on the question
- 18:56that I asked. You can see that it
- 18:57changed the index.md file, the log.md
- 19:00file, and the Wiki motivation for hard
- 19:03tasks. So, opening up my Obsidian vault
- 19:05here again, looking in my log, we can
- 19:07see that it actually logged this query,
- 19:09motivation when avoiding a hard task,
- 19:11answer to query about motivation, and it
- 19:13even updated the index with it. And it
- 19:15created motivation for hard tasks and
- 19:17linked back to the original sources that
- 19:19it found this information from. So, as
- 19:22you ask questions, the wiki further and
- 19:24further and further builds out based on
- 19:26the questions you were asking. Now,
- 19:28there's a few things that I want to do
- 19:29to clean this up a little bit and make
- 19:31it slightly more useful for me cuz right
- 19:33now, once it processes something, it
- 19:35just leaves it in this raw folder, and
- 19:37this is just going to build up and build
- 19:38up. And so, what I want to do is under
- 19:40this raw folder here, I'm going to go
- 19:42ahead and create a new folder, and I'm
- 19:44going to call it processed. Whenever it
- 19:46processes one of these files and adds it
- 19:48to the wiki, I want it to move it to the
- 19:50processed folder, so I know that that
- 19:52has already been ingested. So, now that
- 19:54I've got this processed folder, I can
- 19:56simply come down to my agents file here
- 19:58and then tweak what happens when the
- 20:00file is processed. So, if I come down
- 20:02here, we've got operations ingest when
- 20:04the user adds a source and asks the LLM
- 20:06to process it, read the source from raw,
- 20:08create or update wiki pages, update
- 20:10relevant entity concept topic overview
- 20:12synthesis or comparison pages, update
- 20:14index.md, append an entry to log.md.
- 20:18Well, now I can just add a number six
- 20:20and say move the source file from the
- 20:22root raw directory to raw/processed.
- 20:27By adding that extra bit to the little
- 20:29prompt here, now it's going to go
- 20:30through all these steps, but then move
- 20:32it into the processed folder. It also
- 20:34misunderstood me when I said to add the
- 20:36channel name. It thought I wanted it to
- 20:37add the channel name to the actual wiki
- 20:40generated page, but I wanted it to add
- 20:42the channel name to the original source.
- 20:44That's what makes the most sense to me.
- 20:46So, I'm going to come to my agents
- 20:47section here and just tweak that as
- 20:50well. So, right now it says for YouTube
- 20:51videos clipped with Obsidian Web
- 20:53Clipper, also open or inspect the
- 20:54YouTube source URL and add the channel
- 20:56name to the generated wiki page front
- 20:58matter. But instead of that, I'm going
- 20:59to say add the channel name to the
- 21:02original source page front matter. I I
- 21:05want it to link back to the original
- 21:06source. So, I'm going to add a step
- 21:08right after step three here and say
- 21:10cross-link any wiki pages generated or
- 21:13updated to the original source page.
- 21:15Basically, I don't want these pages
- 21:16orphaned. If there's a new wiki page
- 21:18here, I want it to link to the original
- 21:21page here. So, that's the manual way to
- 21:23update the agents.md file, but you can
- 21:25also do it by prompting it inside of
- 21:28Codex. So, if I come to my second brain
- 21:30project, create a new chat here, I can
- 21:32give it instructions on additional
- 21:34things that I want to happen. So, I
- 21:35mentioned my journal and I mentioned my
- 21:37CRM. So, let me go ahead and build the
- 21:40bones for that here. I will close these
- 21:42folders to clean everything up. I will
- 21:43create a new folder called journal and a
- 21:46new folder called CRM. Now, I can come
- 21:49to Codex and say update the agents.md
- 21:52file to handle these items. Number one,
- 21:55if I start a chat with journal, add the
- 21:57text of that chat and subsequent
- 21:59conversation as a new md file within the
- 22:02journal folder. The entire conversation
- 22:03should be added to the markdown file.
- 22:05Create an index file in the journal
- 22:07folder that's similar to the wiki index
- 22:09file. Each new journal entry gets added
- 22:11to the index file. Decide on a short
- 22:13title for the journal entry based on the
- 22:15contents of the journal and use the date
- 22:17and the title as the journal entry file
- 22:19name. Add the date and title to the
- 22:21index and link to the entry. Also, log
- 22:24the journal entry title and short
- 22:25summary in the log.md file. Your
- 22:27response to my journal entry should be
- 22:29grounded in content from the wiki in the
- 22:31same way you view the index and respond
- 22:33to my chat questions based on what's in
- 22:34the wiki. Provide advice and insights to
- 22:36my journal entries based on what's
- 22:38available in the wiki, as well as your
- 22:40own LLM knowledge. Provide helpful
- 22:42advice, insights, guidance, tactics, and
- 22:43ideas using what you know, along with
- 22:45what's available from the wiki, past
- 22:47journal entries, and the CRM. So, when I
- 22:49journal, I want it to look in the wiki,
- 22:51find information that's helpful to what
- 22:52I just journaled on. I want it to look
- 22:54in past journal entries to see if
- 22:56there's anything relevant I've journaled
- 22:57on in the past, and I want it to look at
- 22:59my CRM and see if there's conversations
- 23:01I've had with people about what I'm
- 23:03journaling about, too, for the CRM. If I
- 23:05tell you I'm giving you information for
- 23:07the CRM, either update the person in the
- 23:09CRM or add the person to the CRM. CRM
- 23:12file should always be a person's name. I
- 23:14will share details about a person, their
- 23:15name, contact details I have for them,
- 23:17details about where or how we met,
- 23:19things that I know about them, etc.
- 23:21Creator, update the contact record in
- 23:22the CRM with whatever details I give
- 23:24you. In the CRM folder, create an index
- 23:26file similar to our other index files
- 23:28with the name of the people in the CRM
- 23:30listed in alphabetical order and a short
- 23:31bio of what information I have about
- 23:33that person. This will allow me to ask
- 23:35questions about contacts that are inside
- 23:38the CRM. I want it to update these two
- 23:39things in our agents.md file, which will
- 23:42make it so that whenever I chat with my
- 23:44second brain project here in Codex, it's
- 23:46either one going to answer the question
- 23:49that I asked it using the sort of query
- 23:52task that's already built into the
- 23:53agent, it's going to handle it as a
- 23:55journal if I preempt it with journal
- 23:58here, or if I tell the chatbot that it's
- 23:59for the CRM, it will update the CRM
- 24:02section. So, I'm going to let it go
- 24:03ahead and update our agents.md file,
- 24:06create the various index files, and that
- 24:08should build out the system for these
- 24:10elements. Okay, so we can see that it
- 24:12updated the agents.md file with our
- 24:14journal rules, our CRM rules, and if we
- 24:17open up Obsidian once again, I can open
- 24:19my journal folder and you can see we've
- 24:21got an index with date entry and
- 24:23summary, and if I open up my CRM, we've
- 24:25got our index with the person and the
- 24:27summary, and where most of the updates
- 24:29happened was this agents.md file. So,
- 24:32now below the wiki section, we have a
- 24:34journal section. It built all the rules
- 24:36that I just asked it to build for me,
- 24:38and then we also have our CRM section.
- 24:40So, it created all the rules for the CRM
- 24:42section now. Let's jump into Codex one
- 24:45more time and let's test this out. I'm
- 24:47just going to say add to CRM, and then
- 24:50I'll put Matthew Berman, and then I'll
- 24:53just put met at Qualcomm event in 2024,
- 24:58hung out at CES in 2025,
- 25:02got lunch during TechCrunch disrupt in
- 25:052025, and then I would obviously add
- 25:08whatever sort of contact details I have
- 25:10about him, but no point in doing that on
- 25:12camera. I'll just tell it to add that to
- 25:14the CRM, and we can see updating the CRM
- 25:16record for Matthew Berman, creating a
- 25:17new record, and it says, "Great, I
- 25:19created that." If I look in my Obsidian
- 25:21here, we can see under CRM, we now have
- 25:24a Matthew Berman in CRM here with our
- 25:26summary, no contact details provided,
- 25:28how we met, relationship context, and
- 25:31you know, other stuff that's still empty
- 25:33right now. And then if I look at my
- 25:34index, we can see it added the person,
- 25:36Matthew Berman, and a quick summary
- 25:38there. It also added it to the log down
- 25:40here that the CRM was updated. But the
- 25:42idea being is, let's say I'm going to a
- 25:45conference, and I bump into somebody,
- 25:47and I'm like, "Oh, shoot, where did we
- 25:48meet?" I can jump into my second brain
- 25:49and say, "Where did I meet Matthew
- 25:51Berman again?" I'll check the vault and
- 25:53CRM records. You met Matthew Berman at
- 25:55Qualcomm event in 2024 according to your
- 25:57CRM notes. So, a really good way to
- 25:59reference information later. I'm going
- 26:01to go ahead and make a pretend journal.
- 26:03So, what I'll do is I'll click on a new
- 26:05chat inside of my second brain project
- 26:07here, and I'll start it with journal,
- 26:09and then I'll go to another line, and
- 26:11I'll just brain dump some thoughts. So,
- 26:13this is just a simple demo journal
- 26:16entry, but you know, it's got some
- 26:18reality to it. I have a ton of ideas for
- 26:19videos, but I decide not to make them
- 26:21because I'm worried they won't get a
- 26:22good view count. I also talk about how I
- 26:24know how to write titles that will get a
- 26:26lot of clicks, but I also hate the whole
- 26:28clickbait thing, so I end up making
- 26:30titles that I know will get less clicks
- 26:33because they're more literal to what the
- 26:35video is about, and I constantly grapple
- 26:37with making videos that will get a lot
- 26:39of clicks, but knowing I'll get hate in
- 26:41the comments because they're too
- 26:43click-baity versus making videos that
- 26:46the title is very literal, so I won't
- 26:48get the hate comments, but I'll also get
- 26:50a lot of less views. And that's
- 26:51something that I grapple with, and I
- 26:53know pretty much every YouTuber grapples
- 26:55with. And so, that's my short journal
- 26:57entry. So, let's go ahead and submit
- 26:58that and see what happens. I'll treat
- 27:00this as a journal entry and grab the
- 27:02response in the vault first. Going to
- 27:04read the indexes, look for relevant
- 27:05prior notes around creating video
- 27:07attention, then I'll write the journal
- 27:08file before answering. The vault has
- 27:10several creator strategy pages. I'm
- 27:12pulling those in rather than answering
- 27:13from a blank slate. There aren't prior
- 27:15journal entries yet, and the CRM doesn't
- 27:17appear relevant to this one. So, it's
- 27:18just pulling from the wiki. Okay, and
- 27:20check out this journal response here. I
- 27:22think there are two fears braided
- 27:23together here, creative integrity and
- 27:25channel safety. One part of you does not
- 27:27want to betray the video with a title
- 27:28that feels gross. Another part is afraid
- 27:30that a few underperformers will teach
- 27:32YouTube not to trust you. The creator
- 27:33notes in the vault push back on the
- 27:34second fear. YouTube value of death and
- 27:36creator persistence both frame visible
- 27:38metrics as lagging indicators. A few
- 27:41lower view videos are not a downward
- 27:42spiral, blah blah blah. So, it is
- 27:44actually grounding the response to my
- 27:46journal in what is existing in the wiki.
- 27:49And then it actually goes on to just
- 27:50give a response that ChatGPT would
- 27:52normally give, but it's pulling from
- 27:54both the knowledge built into the LLM as
- 27:57well as the knowledge in the wiki. So,
- 27:59that's all working exactly as intended.
- 28:02And then if I want to pop open Obsidian
- 28:04here, I can open my journal folder, and
- 28:06we can see here is my journal entry.
- 28:08Here is what the assistant replied with.
- 28:10Here's some synthesis, and here's some
- 28:12related content about what I'm
- 28:14journaling about. If I look at my index
- 28:16here, it automatically logged the date,
- 28:18the entry title, and a quick like one
- 28:20paragraph summary of what my journal
- 28:22entry is about. Now, I want some of this
- 28:24to happen on autopilot. I don't want to
- 28:26have to jump into Codex constantly and
- 28:29tell it to process everything that I
- 28:31saved in here. And there's an easy
- 28:32solution for that. Before I show you,
- 28:34I'm going to do one thing. I'm going to
- 28:36go ahead and clean up my existing
- 28:38Obsidian wiki because, remember, I want
- 28:40these to all get moved into processed,
- 28:42and I also want it to save the YouTube
- 28:45channel name up here in the front
- 28:46matter. So, I'm going to tell it,
- 28:47"Please reprocess all of the files in
- 28:51the raw directory following the recent
- 28:55updated instructions on how to process
- 28:59them." So, I'm going to let that
- 29:00process. It's going to clean up my wiki
- 29:01real quick. All right, now that that's
- 29:03finished and my Obsidian vault is
- 29:05cleaned up and we can see all of my
- 29:06videos have been moved to process and it
- 29:08added the channel name to the original
- 29:10videos here. Let's automate some of
- 29:12this. So, in Codex here, you've got a
- 29:14feature called automations. This is
- 29:16where you can set it up to do recurring
- 29:17tasks. So, if I click into automations
- 29:20here, select new automation. For
- 29:21automation title, we'll call it process
- 29:24second brain raw files. For work tree,
- 29:27I'm going to set it on local so it runs
- 29:28directly in the selected project. For
- 29:30our project, we're going to select
- 29:31second brain. Here, we'll select when we
- 29:33want it to run. I'm going to go ahead
- 29:34and set mine to hourly, but you can do
- 29:36it at whatever cadence you want. And I'm
- 29:38just going to say if there are any
- 29:41unprocessed files inside the raw
- 29:43directory, please process them now. For
- 29:46the model, I'm going to set it as a
- 29:47GPT-5.5.
- 29:49I recommend just using the strongest
- 29:51model you have available. I'm going to
- 29:52set it on high reasoning and I will
- 29:55create this automation. Now, it's going
- 29:56to run every hour, see if there's
- 29:58anything in my raw folder that's
- 30:00unprocessed, and then it will process
- 30:02it. And that's it. That's the whole
- 30:04process now. Whenever I come across
- 30:05stuff I want to save, I just use the
- 30:07Obsidian web clipper and clip it into my
- 30:09raw folder automatically. And every
- 30:12hour, it's going to ingest that and turn
- 30:13it into one of the wiki pages. If I want
- 30:15to add somebody to my CRM, I just open
- 30:17up Codex, create a new chat inside of
- 30:19this project, and add the CRM details.
- 30:21If I feel like journaling right now, I
- 30:23can journal straight into my second
- 30:24brain, and it will ground the response
- 30:27in what's available in my wiki, past
- 30:29journals, and within my CRM. If you want
- 30:30an extra layer of backup, you can also
- 30:33go to GitHub, create a new repository on
- 30:35GitHub. I'm going to go ahead and call
- 30:37this one second brain. I'm going to set
- 30:39this to private, so it's only available
- 30:41to me, and I'll create the repository.
- 30:43Now, if I copy this URL, jump back over
- 30:45to Codex here, I can say commit this
- 30:48current version to my private GitHub
- 30:52repo here. Pasting the URL of the
- 30:54private GitHub repo I just created, and
- 30:56then go ahead and submit it. Now, I've
- 30:58previously attached the GitHub plugin,
- 31:00so it should just work out of the box.
- 31:02You can see I'm already synced with
- 31:04GitHub, but if you haven't done that
- 31:05already, just add the GitHub plugin and
- 31:07go through the motions to get that set
- 31:09up, and you should be good to go. And it
- 31:11went ahead and pushed it to GitHub, so
- 31:12if I open my browser here and refresh,
- 31:15we can see everything I've created is
- 31:17all saved on GitHub now. If I jump back
- 31:19into Codex, I can go to my automation
- 31:21and edit this automation and say if
- 31:24there are any unprocessed files in the
- 31:25raw directory, please process them now.
- 31:28Once everything is processed, please
- 31:29commit and push the current version of
- 31:30the directory to the main branch on
- 31:32GitHub. So, now it's going to process
- 31:33everything in the raw directory, and
- 31:35then once it's done processing, it's
- 31:36going to update GitHub so that backup is
- 31:39constantly happening every hour. And
- 31:41there you have it. There's the whole
- 31:42second brain process. Not only do you
- 31:44have a wiki of all of the information
- 31:46you're finding and saving from around
- 31:47the internet, but now you have a journal
- 31:49and a CRM that's built on top of it as
- 31:51well. And if you ever want to tweak how
- 31:53it operates, you just open up Obsidian,
- 31:55which is your visibility layer to see
- 31:57how everything is built, and you go into
- 31:59agents.md, and you just tweak the
- 32:02instructions. This is all just prompts
- 32:04at the end of the day. You just change
- 32:05how it gets prompted. And in the short
- 32:07amount of time that we've been working
- 32:08on it, this is what our graph view looks
- 32:10like now, and we can start to see all of
- 32:12these things interconnect with each
- 32:13other a little bit more. Do this for a
- 32:16few days and a few weeks, and the next
- 32:17thing you know, you have a vault that
- 32:19looks like this. Uh yeah, pretty insane,
- 32:22crazy vault that just has a ton of
- 32:24information saved inside of it. So, I
- 32:26know that video was long. There was a
- 32:28lot of details. I wanted to make sure it
- 32:29was very clear and you got the whole
- 32:31process, and I didn't skip any steps,
- 32:33but I want to show you how I've been
- 32:35building this sort of second brain
- 32:36concept that I can journal on top of
- 32:38that I have a CRM on top of where all of
- 32:40the wiki elements are interconnected.
- 32:42You can even dial it in more by building
- 32:45in separate folders and telling it to
- 32:47break out people from different pieces
- 32:49of content and break out companies from
- 32:51different pieces of content and really,
- 32:53really dial in that wiki more and more
- 32:55and more. But really, really cool
- 32:57concept. All you really need is Obsidian
- 32:59and Codex. Anthropic's co-work or Claude
- 33:02code also works. Whatever your sort of
- 33:05front-end chat platform of choice is.
- 33:07I've been really liking Codex lately, so
- 33:10that's what I've been using. But yeah,
- 33:11go build it. It's really, really cool
- 33:13and a lot simpler than you think and
- 33:15over time it just gets smarter and
- 33:17smarter and smarter and more and more
- 33:18powerful. So, that's what I got for you.
- 33:20This isn't like my normal videos. I
- 33:22normally make end of week news
- 33:24breakdowns where every single Friday I
- 33:26break down all of the news that happened
- 33:28in the AI world for the week. I drink
- 33:29from the fire hose all week, keep up
- 33:31with all of the news, keep myself
- 33:33completely looped in so that other
- 33:35people don't have to feel overwhelmed.
- 33:37I'll take on the overwhelm and just
- 33:39report what I think is the most
- 33:40interesting. I put those videos out
- 33:42every single Friday. If stuff like that,
- 33:44as well as tutorials like this, are
- 33:46something that interest you, maybe
- 33:47consider liking this video and
- 33:48subscribing to this channel. It really,
- 33:50really helps me out a lot. But again,
- 33:51that's what I got. Thanks for hanging
- 33:52out with me, nerding out with me.
- 33:54Hopefully, I'll see you in the next one.
- 33:55Bye-bye.
About this transcript
This page contains the full transcript of Build An AI Second Brain Knowledge Base (Step-By-Step) by Matt Wolfe, generated from the public captions YouTube serves with the video. The transcript has 7,371 words across 1,030 segments, with the original timestamps preserved so you can click any line to jump to that moment in the embedded player.
What you can do with it
Use the transcript to take notes, quote the speaker, build a study guide, generate a summary with ChatGPT or Claude via the YouTube Summary tool, or export it as a timed subtitle file with YouTube to SRT. You can also re-open it in the transcriber to translate the transcript into 100+ languages.
Free YouTube transcript tool
YouTube2Text is a free YouTube transcript generator — no signup, no daily limit. Paste any YouTube link and get the full transcript instantly, with timestamps, click-to-jump, translation to 100+ languages, AI prompts for ChatGPT, Claude, and Gemini, and exports to TXT, SRT, VTT, or Markdown.