Why Apple Will WIN The AI Race.. — Transcript
Full transcript
- 0:00Yo, Greg. What's good, bro? How you
- 0:01doing?
- 0:02I'm [snorts] great, man. It's warm and
- 0:04nice in California.
- 0:05Nice, bro. I finally got some good
- 0:07weather over here in New York, bro. We
- 0:09had like our first 90° day a few days
- 0:11ago. It was a brutal winter for us this
- 0:13year. It's bad.
- 0:14>> Yeah, it's really bad. Really bad, bro.
- 0:16Gorgeous in in East Bay, San Francisco.
- 0:20Mediterranean weather.
- 0:22I wish I could like port that weather
- 0:23here and have it 24/7. It'd be amazing.
- 0:26Um
- 0:26>> Just move. I love New York too much,
- 0:29bro. I can't. I can't. Um but yeah,
- 0:32great to have you on. I'm psyched
- 0:34psyched about this conversation.
- 0:36Um I think a lot of people have either
- 0:39heard about Akash in the past or don't
- 0:41know what you guys have been up to. I
- 0:42know I recently when I when I checked a
- 0:44lot of I was really really deep in the
- 0:46Cosmos. So, I followed a lot of the
- 0:48early Cosmos projects and you were got
- 0:50you guys were one of the first Cosmos
- 0:51projects that I checked when I was
- 0:53looking. That was probably back in like
- 0:542021, 2022. So, I know you guys have
- 0:56been around for a while.
- 0:57Um can you tell us a little bit about
- 0:59your background and like what Akash
- 1:01Akasha is, how you guys have grown over
- 1:03the years?
- 1:05So, my background I've been
- 1:07open source
- 1:08developer from most of my life. Um
- 1:12and
- 1:13focused heavily on distributed systems.
- 1:16Mhm.
- 1:17Working mostly for startup companies,
- 1:19high growth companies here in Silicon
- 1:21Valley.
- 1:22Um
- 1:23Uh before Akash, I founded a company
- 1:25called AngelHack which defined the
- 1:27modern day hackathon. At peak, we had
- 1:29200,000 developers, 50 cities around the
- 1:31world.
- 1:32Uh it was largely responsible for the
- 1:34web two acceleration in San Francisco.
- 1:37Oh, wow.
- 1:37>> It's funny because
- 1:39we founded that company peak in 2012.
- 1:42And what's happening now in San
- 1:44Francisco reminds me of those golden
- 1:46days of web two era.
- 1:49But just
- 1:5110x more intensity with AI. Mhm. So, uh
- 1:55I would say like this is my third I
- 1:57would say like second big San Francisco
- 1:59boom
- 2:01I I was part of.
- 2:02Um
- 2:04and the vision really you know been in
- 2:07the cloud for a very long time in 2006 I
- 2:10was
- 2:11I designed Kaiser Permanente days.
- 2:13Um
- 2:14a cloud architecture before cloud was a
- 2:16thing
- 2:17that's when I discovered Amazon and I
- 2:19fell in love with AWS um
- 2:21being a big proponent being a big
- 2:23advocate for uh
- 2:25for for cloud only to realize all the
- 2:27problems cloud has right so that led me
- 2:30to embark on an open source initiative
- 2:33to build a supercloud essentially
- 2:36minimizing cloud providers um
- 2:39to just to resource providers and sort
- 2:41of bringing building a cloud of cloud
- 2:43right so that eventually led to
- 2:45uh what Akash is. Uh yeah.
- 2:49So you see Akash is kind of like a a
- 2:51decentralized
- 2:53uh version of AWS or
- 2:55like in in what way do you are they
- 2:57comparable?
- 2:59Akash is a first supercloud so
- 3:02to go back a little bit history of
- 3:04clouds right like
- 3:05>> Mhm. uh you know when the internet began
- 3:08every company was running their own data
- 3:10center or you know colos or whatever
- 3:14you own your own hardware.
- 3:15And owning hardware is not the easiest
- 3:17thing to do and got
- 3:19you know
- 3:20you can't just deploy hardware easily
- 3:22takes a long time then cloud came and
- 3:24gave us an amazing comfort solution that
- 3:27you know where
- 3:28you don't need to own the hardware but
- 3:30just lease it so instead of owning a
- 3:31house rent the house that's our model
- 3:33phenomenal greatest scale they
- 3:36really proved out that you can scale
- 3:38very fast and web two is all about uh
- 3:41just meeting demand in just in time so
- 3:43scaling when you have scale kind of
- 3:45thing it worked great for web two. Um
- 3:48but the problem with with a cloud is
- 3:50well um if you take the
- 3:52the TCO the total
- 3:54uh uh uh cost ownership cost model, it
- 3:58actually is way more expensive than
- 3:59running your own hardware.
- 4:01Because they nickel and dime you for
- 4:02every little thing. On top of that, the
- 4:05world was going more towards an open
- 4:06source
- 4:07first model, whereas cloud was taking
- 4:11open source software and closing them
- 4:12down and reselling them all. There were
- 4:13a lot of problems with cloud.
- 4:15And we also noticed this is a massive
- 4:19increase in in data consumption, right?
- 4:21So, the rate at which it was increasing
- 4:23was I think it was doubling or or
- 4:26quadrupling every every year or
- 4:27something.
- 4:28And we we laid out a model and we
- 4:31predicted that there's no way in hell in
- 4:3310 years cloud be able to keep cloud
- 4:35will be capable of actually handling the
- 4:38demand. So, that then we were and
- 4:43another big trend we noticed was there's
- 4:45a lot of computer out there just
- 4:46everywhere. It's not like in a central
- 4:47place, right? So, that led us to on an
- 4:51idea. It was not us, it was just whole
- 4:53industry all together on an idea of a
- 4:56super cloud in the sense. Can we
- 4:57actually build a cloud provider that is
- 4:59not a single provider, but it can
- 5:01connect to all all cloud providers and
- 5:03become like a a layer on top of it.
- 5:05And that was proposed by Cornell in
- 5:082015, I believe.
- 5:11We we liked that idea.
- 5:13And we implemented the first ever super
- 5:16cloud. So, the Akash is not a cloud
- 5:19provider, but a cloud of clouds, right?
- 5:22So, Akash in Sanskrit means the sky. Sky
- 5:25is where the the clouds live.
- 5:27It's what we call a super cloud. That
- 5:29means AWS, you know, could be a part of
- 5:32Akash network as an offering.
- 5:35What Akash gives you that the other
- 5:37traditional cloud providers don't is
- 5:39freedom. Freedom in terms of choosing
- 5:41what provider you want
- 5:43based on whatever metric you want to
- 5:45you want to base on be it cost, be it
- 5:47reliability, be it efficiency, be it
- 5:48speed and whatnot, it gives you this
- 5:50incredible choice of, you know, moving
- 5:54between different cloud providers,
- 5:56um and uh
- 5:58or even distributing your workloads
- 5:59across different providers. It could be
- 6:01cloud provider, it may not be cloud
- 6:02provider, could be compute. Now with
- 6:04home node, it could be a home compute.
- 6:06So, the idea is to bring all the compute
- 6:08that's available and offer a single
- 6:10place for you to for the user to to
- 6:12shop.
- 6:14Think of Akash like a mall, you know,
- 6:15instead of going to a single store, you
- 6:17go to a mall, you can get lot of
- 6:18varieties.
- 6:20Um that's sort of thing.
- 6:21Interesting. That That makes a ton of
- 6:23sense. That's That's a great great
- 6:24explanation. Um yeah, I used to be a
- 6:26software engineer. Um I actually went to
- 6:28school for for comp sci and was a
- 6:29software engineer after I graduated. So,
- 6:31I know a little bit about about that. I
- 6:33know So, if people were to go to
- 6:36um I don't If you deploy application,
- 6:38people would deploy their application
- 6:40across different like AWS instances and
- 6:42there's a UI for doing all of that. And
- 6:44going back and forth, so people could do
- 6:46that the same way just through Akash and
- 6:49then you guys route them to wherever
- 6:50else?
- 6:52Yeah, so compute in Akash is not on AWS.
- 6:54I mean, I said AWS could be. Uh and
- 6:56there's an initiative to bring Actually,
- 6:58there was an initiative uh to bring Aka-
- 7:00AWS onto Akash. Okay. Uh and I think
- 7:03it's going to continue, but right now
- 7:05most We have about 70 odd providers and
- 7:07most of them are independent data
- 7:09centers or independent
- 7:11uh companies uh that have this compute.
- 7:14Um uh because, you know, you know, uh
- 7:19I think the big advantage right now for
- 7:21Akash is cost and access, right? So, if
- 7:23you buy Amazon, you're not going to see
- 7:24a cost difference. Although, there is a
- 7:27uh initiative to bring Amazon reserve
- 7:28compute. Reserve compute is
- 7:31um
- 7:32compute that's purchased by people ahead
- 7:34of time for much cheaper than what you
- 7:36would otherwise pay on demand. And most
- 7:38of the time, this computer is just
- 7:40sitting dormant. So, it's AWS compute,
- 7:42but it's not being used. So, there's a
- 7:44there's a case to be made to put that
- 7:46computer on a cache and offer what exact
- 7:49same Amazon computer for significantly
- 7:50cheaper. So, arbitraging essentially.
- 7:53Got it. Got it. Greg, hello. I'm I'm I'm
- 7:56Banks. We're having a little bit of
- 7:57technical difficulties. I'm the um
- 7:59I'm the resident [ __ ] here at Market
- 8:01Bubble. So,
- 8:03I represent the average layman. A lot of
- 8:05people in my chat, a lot of people that
- 8:06follow the show um
- 8:08aren't well equipped to have to follow
- 8:10the type of conversation that you guys
- 8:11are having. To those types of people,
- 8:14what would you say and how would you
- 8:15describe your product and what you're
- 8:16building? And how does it relate to
- 8:18them? How does it affect them? Why
- 8:19should they care? Yeah.
- 8:22The simplest analogy which I absolutely
- 8:24hate, but I'm going to do it anyway, is
- 8:26Airbnb for compute.
- 8:28Okay, so you can rent out your compute.
- 8:30Everybody has compute, you can rent it
- 8:31out.
- 8:32Yes, you can if you have dormant
- 8:34compute, you can rent it out. Why do you
- 8:36hate that analogy? I think that's really
- 8:37really strong. I like that. I hate
- 8:39analogies in general.
- 8:42>> [laughter]
- 8:43>> But, this particular one is very
- 8:44simplified and
- 8:45it's been abused by so many other people
- 8:48and
- 8:48you know whatever. You've talked about
- 8:51the the demand side a lot on how like
- 8:52the demand has gone gone up a lot and
- 8:55it's going to continue to go up a lot.
- 8:57Um I guess where is a lot of the the
- 8:59revenues that you're currently seeing
- 9:01with Akash? Like what are the the use
- 9:02cases that are that people are using
- 9:04their um is using for? Like I know AI
- 9:07inference has been a big one that people
- 9:09have been their spare um GPUs for. Um
- 9:13how do you guys feel feel like you fit
- 9:15in with like the open source AI
- 9:16community and open router and those
- 9:18platforms? Oh, yeah. The biggest uh
- 9:21use we are seeing I mean Akash we we
- 9:23Akash is a decent trust computer
- 9:25network. So, we don't exactly know what
- 9:27people are running on because we have no
- 9:29access into their computer. But, we only
- 9:31know what people tell us, right?
- 9:34Uh because use is inference any any day.
- 9:36I think like nine over 95% is inference,
- 9:40right? Um especially now when you have
- 9:42so many of these open source models and
- 9:45um you know, there are uh
- 9:48there's a lot of effort on like using
- 9:50smaller models, using mixture of experts
- 9:52and whatnot. Mhm. Uh so, there are a lot
- 9:54of lot of small, large, all kinds of
- 9:57inference uh
- 9:59uh models that are doing inference on
- 10:00Akash. Um uh from a customer's
- 10:03standpoint, uh like uh historically,
- 10:05Venice has been Venice actually started
- 10:07on Akash. Oh, wow. Yeah. Uh um they uh
- 10:12went to a different model, but now now I
- 10:13think they're coming back. I think now
- 10:14they're using some some Akash, but I
- 10:16think they diversified their their
- 10:18supply quite a lot. Um we have like
- 10:20Venice like people, a lot of them, that
- 10:23use Akash quite a lot today. Uh there
- 10:25are a lot of the inference players. Um
- 10:26>> Mhm.
- 10:27lot of uh
- 10:29uh AI products actually. There's there's
- 10:31you know, one of my favorite use cases
- 10:32which does uh imaging. So, the scope
- 10:35quite a lot of
- 10:36uh
- 10:37uh
- 10:38uh image generation, video generation
- 10:40stuff happening on Akash. Yeah.
- 10:42I would say 87%
- 10:45of usage on Akash comes from
- 10:49non
- 10:50wallet users. Akash has two ways to pay.
- 10:52You can pay using a credit card that
- 10:54becomes that converts into crypto in the
- 10:57background or you can pay directly with
- 10:59crypto. Um we are seeing 87 most usage
- 11:02coming from non-crypto uh on or on on uh
- 11:06non-crypto payment uh and that's mostly
- 11:08AI.
- 11:09So, we're uh retooling a lot of our
- 11:11tools to be a lot more mainstream more
- 11:13than crypto
- 11:15friendly. That's impressive. That's
- 11:17that's cool. Um and uh so, if for people
- 11:20who do have some spare GPUs, um if they
- 11:23wanted to rent them out to you guys,
- 11:26like what do the economics on that look
- 11:28like? And I guess
- 11:29what does it look like to do like uh can
- 11:31I also use when can I use the GPU? Like
- 11:33how long do I have to give it to you
- 11:34guys for? Like what is the Yeah, uh
- 11:37great depends on the GPU obviously,
- 11:38right? So, I mean if you're if you're
- 11:40having H100s, mhm,
- 11:43um which are really in high demand right
- 11:45now. Yeah.
- 11:47If you bought H100s about a year ago, uh
- 11:50putting that on Akash right now will
- 11:52amortize you within 9 months.
- 11:54Oh, wow.
- 11:55>> [laughter]
- 11:56>> What?
- 11:56>> The economics are not. That's crazy.
- 12:00It's not because I I saw
- 12:01>> That's insane.
- 12:02Uh that was not the case all the time.
- 12:04For some reason H100s are out. No one
- 12:06has H100s right now. They're super high
- 12:08demand.
- 12:09And
- 12:11it is crazy how these economics are like
- 12:13turning out. I don't even know what to
- 12:14make of it because, you know, you have
- 12:16your depreciation cycles, right? Your
- 12:17standard, you know, whatever
- 12:18depreciation cycles, yep, you know,
- 12:205-year depreciation, you you go to near
- 12:22zero after 5 years.
- 12:24Uh
- 12:26H100s are reversed.
- 12:29The value is actually going up. They're
- 12:30like Rolex watches right now. How?
- 12:32>> There's no
- 12:33It's crazy, I know. Uh
- 12:35I remember buying H100s uh about a year
- 12:37ago for 210 210 a 8X node. Now, the
- 12:42minimum used node is going for 275.
- 12:45What [laughter] the [ __ ]
- 12:46>> And
- 12:48I saw quotes for like 300k. Like it's
- 12:50just nuts. How is that
- 12:53Why?
- 12:55It's I have no idea. Uh I really I mean
- 12:58I have some some
- 13:00uh assumptions, but I have no idea why
- 13:03there's a sudden [laughter] drop in H100
- 13:06supply that's in the last
- 13:08I would say
- 13:102 weeks, maybe 3 weeks. Uh-huh. So, Um
- 13:15Yeah.
- 13:15So, I know that you spoke on how the
- 13:18depreciation cycles of GPUs, they're
- 13:19always building the next newest what
- 13:22next best one, next more efficient one.
- 13:24Um and I know there's like a a a
- 13:26lack of ability availability to do that
- 13:29like it's very difficult in how many
- 13:30they can make.
- 13:32Um
- 13:33I guess with all the investment that's
- 13:35happening there, do you think that the
- 13:37depreciation cycle is going to be like
- 13:38less
- 13:40aggressive or
- 13:41No, let me put some numbers to you,
- 13:42okay? So
- 13:44No, there are two ways to use AI. There
- 13:46is vanilla, which is using ChatGPT. You
- 13:48can ask questions, you get answers.
- 13:50Uh-huh.
- 13:50>> The second way is agent tech, right?
- 13:52>> Right. So agents running cloud code, uh
- 13:54mass uh open cloud, those are agent
- 13:57tech. Mhm. Um
- 13:59agent tech usage is exponentially
- 14:02greater in terms of tokens usage uh on
- 14:05on on um on charge on on the models,
- 14:08right? Like exponentially. Mhm.
- 14:10>> Order of magnitude of magnitude of in
- 14:12order of magnitude, right? Um
- 14:14I think I burned through
- 14:16a
- 14:17my entire So Claude gives you limits as
- 14:19to how much you can you know there's
- 14:20daily and weekly limits. I think I've
- 14:22burned my weekly limits in 2 days. Cuz
- 14:24my wife is visiting uh you know her mom.
- 14:26>> [laughter]
- 14:28>> That's how it would be, bro.
- 14:29>> Amazing. My wife and
- 14:30I'm I'm goblin mode right now, so I
- 14:33by myself in the garage at home and just
- 14:35coding a lot. That's [ __ ] funny. And
- 14:39agents are just significantly different,
- 14:41right? You can do so many things you
- 14:42can't really do with regular I can't
- 14:44imagine doing things without agents now.
- 14:46And it turns out I mean AI users
- 14:49globally, there are about a billion
- 14:50users using AI including ChatGPT,
- 14:53including Gemini,
- 14:54including Google AI itself, which most
- 14:56people don't know they're actually
- 14:57using.
- 14:58Out of that, only 2.4 million people use
- 15:01agents.
- 15:03I don't know, do you guys use agents to
- 15:04do anything?
- 15:04>> course. Of course. Yeah, we uh
- 15:07We use it to do everything. We do we we
- 15:09have like this show prep. I'll I'll
- 15:10share my screen with you. There you go.
- 15:13Yeah.
- 15:14That looks like Claude code. Yeah, we do
- 15:15a whole
- 15:16Yeah, we do a whole
- 15:18run a show like it's We have We have
- 15:20imaginations and dreams of eventually
- 15:22building like an AI co-host that joins
- 15:25us on the show and kind of real-time
- 15:27sites Right. examples and content. We
- 15:30can ask it in real time like, you know,
- 15:32what markets are doing and
- 15:34have it build a personality and Are you
- 15:36familiar with Joe Rogan show, obviously?
- 15:38Of course, yeah. Yeah.
- 15:39>> He has like an off-screen like co-host
- 15:41and his name is Jamie. You never see
- 15:42him.
- 15:43>> Sure. And occasionally you'll hear him
- 15:44and he'll come chime in when it's
- 15:45appropriate.
- 15:46>> Jamie agent. Yeah, Jamie agent. Jamie
- 15:48agent.
- 15:49>> Perfect. Bubbles. We're going to make
- 15:50our ours like a hot girl, I think. But
- 15:53>> [laughter]
- 15:53>> Um eventually we want to ultimately
- 15:55build it to the point where the entire
- 15:57show is produced by these agents.
- 16:00So you can understand the benefits of
- 16:01agents. It's incredible, right? It's my
- 16:03thing. It's unreal. 2.4 million people
- 16:06are using agents and that is causing the
- 16:08crunch. I had to pay a four times more
- 16:10for my memory. The same memory I paid
- 16:12like about last year.
- 16:13>> No, I'm getting [ __ ] whacked, too.
- 16:15Claude flipped it and I don't know. It
- 16:17was
- 16:18It was super affordable at first and now
- 16:19I'm spending [ __ ] three, four
- 16:20thousand dollars on on AI a month. But
- 16:23it's well worth it for for me and just
- 16:25just even the sake of tuition, learning
- 16:27it. Exactly. You mentioned all the
- 16:30options. Obviously, there's a
- 16:31endless amount of options and what it
- 16:33feels like for the average consumer and
- 16:35user of AI, user of agents is
- 16:37there's no really discernible
- 16:38difference. Like for the average person
- 16:40like
- 16:41Z was talking about how his mom uses AI
- 16:43and like the average Joe who's looking
- 16:45up [ __ ] recipes for banana bread and
- 16:46how to get to his favorite coffee shop
- 16:48and what the UV is outside and what the
- 16:50price of Solana is. You're not going to
- 16:51notice a real difference, but obviously
- 16:53for somebody like you who's building in
- 16:54it and as you said, I can't even imagine
- 16:56not using it. Which one do you prefer?
- 16:58Which which is your favorite?
- 17:00Uh depends on what I'm doing. Uh really
- 17:02depends. If I'm thinking
- 17:03>> Gun to your gun to your [ __ ] head,
- 17:06Anthropic, OpenAI. Which one? Uh
- 17:09Anthropic Claude, 4.7. I mean, Anthropic
- 17:11OpenAI. With with the quickness, by the
- 17:13way.
- 17:14>> Yeah, that was fast. It's
- 17:16It's Anthropic on this side, baby. You
- 17:17already [laughter] know.
- 17:19My Codex is amazing. Codex is really
- 17:21good too for coding. So, really depends
- 17:23what I'm doing, right? There's no one
- 17:24model that fits all, right? I'm not
- 17:26going to use
- 17:27Like, for example, for thinking, when
- 17:29I'm like brainstorming and coming up
- 17:30with ideas, I use, you know, um
- 17:33Opus 4.7. When I'm actually coding, I
- 17:36use a different model because writing
- 17:38Once you plan out and actually executing
- 17:40the plan to to code, you don't need
- 17:42Opus. Opus is like extremely intelligent
- 17:46overkill
- 17:47for just writing coding tasks, right? I
- 17:49use a cheaper model. I actually use
- 17:50Akash ML for like actual coding, Oh,
- 17:53cool. um our own like, you know, service
- 17:56because it's significantly cheaper than
- 17:57using Opus, right? So,
- 18:00but overall, I think general-purpose
- 18:01Opus 4.7 would be my Is it Hermes or
- 18:04Hermes? Do you use that over Open Claw?
- 18:06Like, what's the deal?
- 18:07>> Hermes all the way, baby. Well, I mean,
- 18:09I love Nous. I mean, I mean, disclosure,
- 18:11I'm an early investor in in Nous as
- 18:13well.
- 18:14And Nous is a big user of Akash, at
- 18:16least in the early days. Nous Research
- 18:17built Hermes.
- 18:19Um so, a lot of Hermes training was done
- 18:21on Akash, too, early days. Um so, I love
- 18:24Hermes. It's just night and day for me.
- 18:27And they ship really well. The team is
- 18:28incredible. Um you know, yeah. So, It's
- 18:32interesting. Obviously, you're a power
- 18:33user of AI again. Um I have a more
- 18:35normie friend. Some of the audience may
- 18:37or may not know him. It's It's honestly
- 18:39um
- 18:39It's irrelevant to the topic, but he
- 18:42exists in like traditional like music.
- 18:44He's a music exec, and he manages
- 18:48artists, and that's the field that he's
- 18:49in. And I originally put him on to Open
- 18:52Claw. I'm like, "Yo, you can automate so
- 18:53much shit." And just even just like
- 18:56the way [clears throat] that I use it in
- 18:57meetings and and and just sharing
- 18:59transcripts and documents and emails and
- 19:01all that [ __ ] Like, the bare-bones
- 19:02stuff. Put him on early earlier, and we
- 19:05went for a walk 2 days ago and kind of
- 19:07caught up on things, and he was pilling
- 19:08me hard on um
- 19:10Hermes? Yeah, Hermes. Hermes. Yeah,
- 19:13yeah, yeah. Hermes got great memory. Uh
- 19:14I also use Hermes with my Obsidian
- 19:17walls. Obsidian's [ __ ] Obsidian's
- 19:19goated.
- 19:20It is. It is. I mean, I'm like random I
- 19:22take my
- 19:23my phone to my shower now because random
- 19:25thoughts and just like talking
- 19:27[laughter] to
- 19:28That's sick, bro. You're locked in, bro.
- 19:30You're locked in. I'm just like Yeah, we
- 19:32know. We we know what kind of random
- 19:33thoughts are going through your head in
- 19:34the shower now.
- 19:35>> [laughter]
- 19:36>> Hey hey Grok, suck me, baby.
- 19:40Cuz showers are my best time, you know,
- 19:41the best time to think, right? But you
- 19:42want to take it down. I'm working on
- 19:44like five, six projects at the same
- 19:45time, right? Like I'm always like I'm
- 19:47always talking, always talking.
- 19:49I'm a talking so much now
- 19:51like I don't type anymore, right?
- 19:52Because, you know, typing is like Yeah,
- 19:55slow. four four K minute at this point.
- 19:57Frank T. God hit me with a [ __ ] bar
- 19:59when he was filling me on and onboarding
- 20:01me into like Open Claw and all this [ __ ]
- 20:03and he said um
- 20:05English is the new coding language. I
- 20:07maybe I botched that, but it's like I
- 20:10don't know, it's a bar.
- 20:11>> Yeah, it's it's it's
- 20:12>> Yeah.
- 20:13I have
- 20:15I have a hierarchy system for my agents
- 20:17like
- 20:18you know, because it can get extremely
- 20:20chaotic. Imagine all this system, so I
- 20:22develop my own system. I think
- 20:24everybody's developing their own system.
- 20:25I think there's a new like abstraction
- 20:27stack that's being built on top of
- 20:28agents that is kind of forming. We're
- 20:30not seeing that yet as products, but
- 20:33but I can totally see where that's
- 20:34going. Um
- 20:36uh it's incredible. So anyway, coming
- 20:37back to my 2.4 million. Only 2.4 million
- 20:40have experienced agents. Imagine if that
- 20:43number is 10x. What's that going to
- 20:44matter? You're going to see. Yeah. 2.4
- 20:46million is leading to the current crisis
- 20:48where we have no H100s available at all.
- 20:51Right. Uh what is 24 million going to
- 20:53look like? I don't know. Like I think
- 20:55we're in uncharted territory. Um
- 20:59uh you know, if you look at the supply
- 20:59chain, you have obviously have the
- 21:01compute, you have inference, you have
- 21:02the chips, and then you have the energy,
- 21:04which is where I'm focused quite a lot.
- 21:05I testified before Congress on energy
- 21:08about a year ago. I called called it
- 21:09out. I said energy is going to be a big
- 21:10challenge and you know, turns out energy
- 21:13is a big challenge. People like Elon or
- 21:15not their first principle thinking,
- 21:17they're not they're going to space to
- 21:19solve the energy crisis. I think there's
- 21:21a lot more we can do on Earth too to
- 21:23solve the crisis. I've made some bets
- 21:26early bets on distributed training,
- 21:28distributed inference systems that can
- 21:30leverage a distributed grid to show
- 21:33energy
- 21:34home node for example we we launched
- 21:36with intention of actually tapping into
- 21:38a distributed uh
- 21:40a grid, right? So it's just going to get
- 21:43worse. I mean now even if you look at
- 21:44the energy, right? Like most energy most
- 21:47new data centers are using LNG which is
- 21:50liquid natural gas because you can't
- 21:52really have any other way to power these
- 21:54systems.
- 21:55So that led to another crisis with
- 21:58turbines and transformers. Now we have a
- 22:00four-year lead time to get a transformer
- 22:02and a 14-year lead time to get a
- 22:04turbine. To get a turbine
- 22:07It's nuts. I can't like any if you look
- 22:09at the entire supply chain
- 22:11every
- 22:12part of the supply chain is constrained
- 22:13right now.
- 22:15I've never seen anything like this
- 22:16before. Yeah, no you talked a lot we've
- 22:18we've been look talking a lot about
- 22:20energy and how US is so like slow on
- 22:22building it. Do you think that China I
- 22:25don't know if you have a good answer to
- 22:26this. Do you think that China is in like
- 22:27a better place energy-wise as far as
- 22:29building out their capacity? And
- 22:31I know Jensen I don't know if you if you
- 22:33watched the Jensen Huang
- 22:34interview did you watch saw that?
- 22:36Yeah, well he he was talking about how
- 22:38Nvidia they should be selling to China.
- 22:41And it seems like there might be some
- 22:43kind of way for I guess it seems like we
- 22:46have the chips and they have like the
- 22:48energy capacity. Like do you do you
- 22:50think there's anything that could happen
- 22:51there or what do you think about Well, I
- 22:53mean
- 22:54theoretically yeah, but I think it's
- 22:56it's mostly geopolitical and
- 22:59Trump did approve us selling H200s and
- 23:0359 days, but China didn't want them
- 23:05because they want their own stack now.
- 23:06Oh, wow. It was actually under the Chips
- 23:09Act and the sorry, the under Biden
- 23:10administration we started export
- 23:12controls on chips. Now that led to a
- 23:14local
- 23:15chip industry by Huawei. Huawei I think
- 23:17is doing 7 nanometer nanometer chips and
- 23:20they're going to catch catch up to 3
- 23:21nanometer very soon. Yeah. But China is
- 23:24forcing
- 23:25China is like aggressively building
- 23:27local stack. And that's that's a risk
- 23:30and that's a challenge because now
- 23:31you're going to have a China stack and
- 23:33you're going to have a western stack.
- 23:34China makes four times more energy than
- 23:37than than US. They have eight terawatt.
- 23:40>> Eight terawatt installed capacity. US
- 23:41has about two terawatt installed
- 23:42capacity. Four times. Damn. China
- 23:45produces China puts
- 23:47adds about 36
- 23:50sorry, adds about a gigawatt of solar
- 23:53capacity every 36 hours.
- 23:55A gigawatt. Gigawatt is [laughter] what
- 23:57a
- 23:58nuclear uh power plant produces.
- 24:01And you know, so a gigawatt can house
- 24:04Every 36 hours?
- 24:05Every 36 hours. Oh, [laughter] [ __ ]
- 24:07They have the and it's they have the
- 24:09energy and we're talking about energy
- 24:10infrastructure they have the battery
- 24:11infrastructure, they have the rare
- 24:12earth. They have Yeah. the entire supply
- 24:15chain to build batteries, to build solar
- 24:17panels and we don't have We lost control
- 24:20of the supply chain a long time ago. So
- 24:22I don't know if that's ever going to
- 24:23come back, right? Like
- 24:24>> Yeah. We can't produce batteries in
- 24:26America anymore and you need batteries
- 24:28for for solar.
- 24:29I think we're starting to onshore
- 24:31the
- 24:33the panels now, but you need rare earth
- 24:35minerals. Rare earth minerals are
- 24:37controlled by China, so there's there's
- 24:38another you know, bottleneck there. I
- 24:40don't know, it's it's kind of a crazy
- 24:42place right now. Uh
- 24:43There's a massive re-indust-
- 24:45industrialization effort by the current
- 24:47current administration to bring back the
- 24:48rare earth minerals. The reason why we
- 24:50want to
- 24:51uh what do you call
- 24:53not invade, but I guess like well, let's
- 24:56call it invasion invade Greenland is for
- 24:58rare minerals. Right, yeah. There's a
- 25:00new deal with the Ukraine for rare
- 25:01minerals.
- 25:03All this is classified information. We
- 25:05don't exactly know how much quantities
- 25:07these countries have but but yes,
- 25:09there's a big push. You'll see any
- 25:11geopolitical issue and you it really
- 25:13comes down to rare minerals
- 25:15for for America. Yeah, we we talked
- 25:17about a little bit MP like MP materials.
- 25:19I don't know if you know that company.
- 25:21Like what MP they they're one of the
- 25:23companies in the US that is trying to
- 25:25fix that problem like
- 25:27the rare earth metals that we do have
- 25:29here. It's the I think that it's the
- 25:30Mountain Pass mine in California but
- 25:32Trump invested in them because of that
- 25:34that situation that you're talking
- 25:35about.
- 25:36But it it seems like the biggest risk
- 25:38for like tech and the US stock market is
- 25:42that dynamic that we have. China has an
- 25:44advantage in energy
- 25:46and an advantage also. Don't you think
- 25:48they're ahead on like the open source
- 25:49side or do you not agree with that?
- 25:51>> They are. They are leading
- 25:52I mean all the all the open source
- 25:53models are from China. Yeah, so leading
- 25:56in so many different things.
- 25:57Where is the US leading then?
- 25:59>> Well, our our I think our tech companies
- 26:01and the close source models are much
- 26:03better.
- 26:04Well, I'll have to ask you this. What do
- 26:05you think that how do you think the gap
- 26:07exists right now between like the close
- 26:09source models the US tech companies like
- 26:12Anthropic Open AI and then the open
- 26:14source models which is I think it's
- 26:16Alibaba who's releasing Qwen.
- 26:19Qwen there is Minimax 2.6
- 26:22there's there's a bunch of these. Yeah.
- 26:24Yeah. So
- 26:26the Qwen 2.6 apologies
- 26:29so
- 26:30how far behind? They're not very far
- 26:32behind. Like Qwen 2.6 is better it's an
- 26:35open source model
- 26:36from China is better at coding than Opus
- 26:41uh
- 26:424.6.
- 26:44Wow.
- 26:44>> So the previous generation
- 26:46of Opus. 4.7 is still number one for
- 26:49agentic use cases. I think it can run
- 26:53I think 3,000
- 26:55parallels sessions I can't remember I
- 26:57can't remember the stats but anyway so
- 26:59but the point is for me
- 27:01software coding model which is what most
- 27:04agent take agents want they they just
- 27:08one maybe one more one version behind
- 27:11because like you can have like Entropic
- 27:14can come the close models can
- 27:16launch and the open models are just
- 27:18going to steal from the close models.
- 27:20Right.
- 27:20>> There's nothing you can stop
- 27:21distillation, right?
- 27:23>> once they're out it's easier to make the
- 27:24the open source version of it, right?
- 27:26>> Yeah, once you have a really good close
- 27:28model you distill from that close model
- 27:30to an open one.
- 27:32Yeah. So
- 27:34open source is going to win, right? Like
- 27:36there's no way in hell
- 27:38you I mean there's like lots of
- 27:39conversations about banning open source
- 27:41now like during
- 27:44Biden administration that was a thing
- 27:46then Trump said he's not going to do it.
- 27:48Now there's another conversation in the
- 27:49White House to to regulate open source
- 27:52AI quite a lot because of this problem.
- 27:55I want to go back to that I want to go
- 27:56back to that 2.4 million figure cuz it
- 27:59seems obviously quite low for what this
- 28:01tech is offering in terms of just like
- 28:04helping people be productive and
- 28:06optimizing their lives and and the way
- 28:08that they do things day-to-day. There's
- 28:10a couple interesting like angles and
- 28:12pieces to this for me and kind of in
- 28:14line with what you were just saying. The
- 28:16first one being
- 28:17why is that number so low and like
- 28:20I don't know I guess I guess Open Claw
- 28:22and Hermes feel like how I would imagine
- 28:25computers and and internet felt 70s 80s.
- 28:28Uh-huh. Flow the barrier to entry is
- 28:29quite thick.
- 28:31Um
- 28:32I don't know what's your what's your
- 28:33opinion on that? Who do you think has
- 28:35the best chance to win in that regard in
- 28:36terms of like mass distribution mass
- 28:39adoption really onboarding the average
- 28:41person to kind of you know whatever the
- 28:43iPhone equivalent is what Apple did for
- 28:45compute computers traditional computers,
- 28:48who is, you know, who is
- 28:50kind of in the leading position to do
- 28:52that, put AI truly in the hands of
- 28:54everybody. Um, that's the first piece. I
- 28:56want to talk about like the
- 28:58general general sentiment around AI
- 28:59after that and how negative people,
- 29:01specifically Americans, are around that.
- 29:03How do How do you think that'll affect
- 29:04legislation moving forward and how
- 29:06that's a really [ __ ] bad thing,
- 29:07obviously, for
- 29:08the US and and this race to AGI.
- 29:12Mhm. All that [ __ ] There's just a lot
- 29:14to unpack there. Yeah.
- 29:15Yeah.
- 29:16It Now,
- 29:18this is a
- 29:20very fast-moving uh this space moves
- 29:23very fast, right? Who's in the best
- 29:24position to succeed? I'm going to take a
- 29:27contrarian take here. I think it's
- 29:29Apple. I think it's Apple, too. I said
- 29:31that Yes! And you're clearly a [ __ ]
- 29:33genius. Did you guys hear that?
- 29:35>> [laughter]
- 29:35>> Look at that one. I think it's Apple,
- 29:36also. Why? Cuz they're already
- 29:38>> Why? Because
- 29:39their
- 29:41UI is exceptional. They're They know how
- 29:44to
- 29:45>> right? They're already in everyone's
- 29:46phone. Yes, dude. Yes. But along with
- 29:48the distribution
- 29:49>> too.
- 29:50Put it next to this one. I'm a [ __ ]
- 29:51genius. No, I'm just kidding. I [ __ ]
- 29:53>> No, I don't know if you use the Apple
- 29:54intelligence. It's horrible
- 29:56horrible models, but the experience
- 29:57[laughter] is phenomenal, right? Like,
- 30:00if you use Siri, terrible in terms of
- 30:03quality, but the experience is great. Uh
- 30:06the the intelligence where you can
- 30:07proofread and whatnot, I use that quite
- 30:08a lot on my phone. Um experience is
- 30:12great, terrible model, right? But if you
- 30:14can replace a model, Yeah. uh you're
- 30:17going to get an excellent And there's
- 30:18another Why thing? Yeah. I feel like if
- 30:21Apple tomorrow released Siri AI and it
- 30:24was even 20% as capable as Opus 4.7 or
- 30:28Chat GPT, what's the what's the most
- 30:30up-to-date, 5.5 or whatever?
- 30:31>> Yeah. I think if it was even 20% as
- 30:33capable, your grandma could do her
- 30:34birthday card and it'll tell you what
- 30:36the price of Bitcoin is and all that
- 30:38good [ __ ] Um
- 30:40and they just pinned it to the top of
- 30:41your iMessage and you can talk to Siri
- 30:43the way that you talk to your friends
- 30:44and type with that way and you can give
- 30:46it access to your phone and it can help
- 30:48you organize that. It can reply to
- 30:49people for you and it just became an
- 30:51extension of iOS and iMessage. I think
- 30:53they just won on the spot though, like
- 30:56at least US. And the ecosystem power
- 30:59they have, they have every Apple TV.
- 31:01Literally.
- 31:02>> All the You wake up your phone updates
- 31:04one your phone updates one day and their
- 31:06chat GPT or their Claude is just pinned
- 31:08right there in your messages. Yeah,
- 31:09yeah. I mean, it's already here. It's
- 31:11just like terrible more I don't know
- 31:12what they did whatever. I think they
- 31:13fired the guy who did it now they have a
- 31:15new CEO and all that, right? So, but
- 31:18they have the best chance to succeed and
- 31:20they're also pretty good. They've been
- 31:21doing AI for a lot. The MLX thing they
- 31:24have the the machine learning you know,
- 31:26libraries they have in Apple's really
- 31:27good. The Mac Studios the the M5s come
- 31:32with 141
- 31:35unified memory gigabytes of unified
- 31:37memory which is actually really powerful
- 31:39to run local models. The Mac Mini the
- 31:41Mac Mini meme meme. That's where I have
- 31:43all my [ __ ]
- 31:43>> the mini the the studio
- 31:45the the bigger machine
- 31:47the M 12. Yeah. Uh
- 31:49>> Well, that's some [ __ ] that you're on.
- 31:50You're [ __ ] taking over the world
- 31:51with AI. I'm talking to it about [ __ ]
- 31:54So, so so minis are small, right? The
- 31:56the studio is the bigger one and they're
- 31:59very powerful. You can run local models
- 32:01really good. Imagine
- 32:03clustering the studios. A lot of people
- 32:04are buying studios because I have a
- 32:06studio, too. Because in my home when I'm
- 32:09using AI try to use local AI more than
- 32:12cloud AI because of privacy. I do a lot
- 32:14with with my AI. I mean, my AI is
- 32:16connected to my camera feeds, my
- 32:18microphone feeds. It has access to my
- 32:20entire life. And I don't don't want that
- 32:23on the cloud. No no way in hell, right?
- 32:24So, I use a lot of local models and
- 32:27imagine all this local everybody having
- 32:28Mac minis, Mac Studios can connect those
- 32:31local local models or connect those
- 32:33those computers using a cache or
- 32:35something where you can like, you know,
- 32:37sell. Imagine the the power Apple has to
- 32:40create an incredible network of these of
- 32:43these like local machines and use that
- 32:45for AI. I mean, there's a lot of
- 32:47opportunity Apple has.
- 32:48If they don't [ __ ] it up, I think
- 32:49they're going to be massively
- 32:50successful.
- 32:51You You said you think that open source
- 32:53is going to win. I think that's a a
- 32:54really
- 32:55That's an interesting take. If If you do
- 32:57think that open source is going to win
- 33:00the race in AI, um I guess what areas do
- 33:05you think are currently underexplored
- 33:07that are going to become more popular in
- 33:09the future? I know you talked a little
- 33:10bit about distributed training and
- 33:11distributed inference.
- 33:13Um and then also, how do you um
- 33:16how do you feel that like crypto is
- 33:18going to fit into that realm of like
- 33:20open source AI? Cuz it seems like crypto
- 33:21should benefit from open source AI a
- 33:23lot.
- 33:24>> yeah, I have a thesis on that. So, the
- 33:26biggest unex I mean, under invested and
- 33:28underexplored area is distributed
- 33:30training. I think it's such a big such a
- 33:32big opportunity and there's a lot of
- 33:33companies that I'm really excited about.
- 33:35Pluralis is one. Uh they haven't
- 33:36launched yet, but I'm really excited
- 33:37about Pluralis. Yep. Uh Zeus was working
- 33:40on something. I don't I don't know how
- 33:41far uh I haven't caught up with them on
- 33:43the
- 33:43on the distributed training piece. And
- 33:45then Gensyn, which is a another I think
- 33:47it's a crypto It's crypto token device.
- 33:49They're very very good. They're They've
- 33:50been working on distributed training as
- 33:52well. No one has quite figured out the
- 33:54incentive structure, which I think is
- 33:55going to be uh
- 33:57a big unlock once we figure out the
- 33:59technology. Technology is very hard.
- 34:01Um like Pluralis uh is able to achieve
- 34:05something called heterogeneality in
- 34:07training. So, what that means is
- 34:09uh I don't want to go too technical, but
- 34:11right now training uh the big limitation
- 34:13for training is you got to have the same
- 34:14chips, no matter what. So, if you're
- 34:16training 8100s, you got to have 8100s.
- 34:18Yeah.
- 34:19So, you can't mix and match them, and
- 34:20that's a big big challenge for a lot of
- 34:22companies because
- 34:23um
- 34:25uh
- 34:27uh
- 34:28Sorry.
- 34:29Um so, a big challenge for a lot of
- 34:31companies because, you know, you're
- 34:32going to have different chips, but if
- 34:33you can do heterogeneality, you can
- 34:35unlock
- 34:36uh distributed training from homes where
- 34:38you have different types of chips,
- 34:39right? Like I might have 4090, someone
- 34:41have 5090, someone have H100. You can
- 34:44combine all that to actually train. The
- 34:46efficiency is only efficiency difference
- 34:48is only 1.6x
- 34:51uh compared to a centralized model,
- 34:52which is not a bad thing, which is not
- 34:55as great as a centralized train model,
- 34:56but it's really good good
- 34:59for as a model. So, I think that's one
- 35:01area. Um uh and second area, I mean,
- 35:04it's it's being talked about from like
- 35:06big labs like Anthropic talks about it
- 35:09quite a lot. The you know, Anthropic
- 35:10co-founder, I I I've talked to the head
- 35:12of research for Anthropic who's been,
- 35:14you know, at the company since the
- 35:15beginning.
- 35:16Um they are also looking very deeply
- 35:19into distributed training. They don't
- 35:20talk about publicly, but I know talking
- 35:22to labs and talk talking to people on
- 35:24the frontier, uh they're developing
- 35:25these frontier models, distributed
- 35:27training is going to be a big deal. And
- 35:29they're already seeing challenges to
- 35:30compute, right? They have to. Um I think
- 35:33second area that is uh
- 35:36underexplored is provenance. Like as you
- 35:39get a lot of
- 35:43um
- 35:44fake
- 35:46AI generated content AI slop, how do you
- 35:49the the there's enormous need for
- 35:51provenance like to to verify that uh you
- 35:54know
- 35:55the goods that are created are legit,
- 35:57not created by AI, right? Because the
- 35:59value will be players, I believe uh you
- 36:01know, just like, you know, if you
- 36:03compare like if you have you two
- 36:04paintings, they look exactly the same,
- 36:06one is AI generated, one is human
- 36:07generated, if you try to sell them,
- 36:10which do you think is going to sell?
- 36:11Human generated, right? Obviously.
- 36:13There's value in human generated stuff.
- 36:15Uh it's not the quality in the outcome
- 36:17of the product, but it's the effort that
- 36:19goes into producing something that
- 36:20people value. Like I value things that
- 36:22are handmade versus things that are
- 36:24machine made, right? Because there's
- 36:25effort and there's uh talent that goes
- 36:27into it. I think that's another area
- 36:29providence area is under explored. Um
- 36:32and uh
- 36:33and privacy is under explored, too. You
- 36:36know, in in we're looking at TEEs and
- 36:38all that stuff, but
- 36:40the a lot of
- 36:41like challenges with trusted execution
- 36:43environments, right? Like side channel
- 36:45attacks and whatnot. I'd love to see ZK.
- 36:47I'd love to see
- 36:49FHE the the you know, federated the
- 36:52uh
- 36:53homomorphic encryption like in in AI. I
- 36:55think that's severely under explored
- 36:57under explored. Um
- 37:00Yeah, I don't know. There are a lot of
- 37:01deep technical problems that that are
- 37:03that are that I can think of. But these
- 37:05three are on my top top of my head.
- 37:07Awesome. Uh that's interesting. That's
- 37:09that's really helpful context. That's
- 37:11cool. I've heard of Pluralis. Kel
- 37:12actually, I don't know if you know Kel
- 37:14on Twitter Kel XYZ, he talks
- 37:15>> Okay, yeah, yeah. Yeah, yeah, he's smart
- 37:17super smart dude. Pluralis is amazing.
- 37:19Really good team. They've been silent. I
- 37:21mean, they're like a research team,
- 37:22right? They're they've been silent, but
- 37:23I know they're coming up with an amazing
- 37:26thing in a few weeks. Mhm. Uh and
- 37:28they're going to be using a lot of
- 37:28compute from Akash, so I'm excited.
- 37:30Gotcha.
- 37:31>> For Pluralis. Um
- 37:32>> Yeah.
- 37:33Yes, I guess I'll ask questions
- 37:34specifically about Akash. I know you
- 37:36guys partner with Venice. Um Venice
- 37:38seems like they've gotten a lot of the
- 37:40attention over the past um few weeks
- 37:42over there
- 37:43in the chat. Um it seemed like they have
- 37:45a really cool integration of like their
- 37:47token and the platform. So, how do you
- 37:50think about the You know, you have also
- 37:52have a token with your platform. How do
- 37:53you think about the integration between
- 37:54the two and like the advantages of being
- 37:56a a crypto platform?
- 37:59Right now with AI, I wouldn't call it an
- 38:01advantage. Or disadvantage. I was going
- 38:03to say or disadvantage.
- 38:05Also,
- 38:05the token was serious.
- 38:09The good things and bad things. The good
- 38:10things is tokens give us a lot of
- 38:12leverage in terms of
- 38:14uh
- 38:15subsidies in terms of behavioral like
- 38:19engineering or whatever you want to call
- 38:21it. There are incredible ways you can
- 38:23use tokens to bootstrap networks and
- 38:24there are a lot of good things. But the
- 38:26bad thing is the user experience is
- 38:28terrible, right? I mean, you like
- 38:29initially Akash was just token. Like if
- 38:32you go to console, you have to have AKT
- 38:34in order to
- 38:35>> Yeah. uh use compute and that uh
- 38:38severely limit
- 38:39>> I mean, crypto and AI, it sounds like
- 38:42you're jumping you're jumping through
- 38:43[ __ ] 25 hoops to get there, right?
- 38:46Like for the It's so challenging. I
- 38:47mean, we would have like our conversion
- 38:49rates would be like less than like 1%
- 38:51like from from the people from people
- 38:53that want to use Akash to like people
- 38:54that actually end up using Akash. It was
- 38:56terrible. Uh and we had we lost so many
- 38:58big deals. Uh we lost a big deal with
- 39:00Nvidia because nobody wants to have
- 39:02tokens because they their finance teams
- 39:05Huh.
- 39:06Nvidia was using Akash in the through an
- 39:08acquisition was using Akash in the
- 39:09beginning. Um
- 39:11you know, and then uh we had their CF
- 39:14their finance teams just basically blew
- 39:16up saying that they don't want to use
- 39:18anything with crypto. Cuz they can't
- 39:20hold AKT
- 39:21on a balance sheet. Yeah.
- 39:23>> Just as far as like general sentiment to
- 39:25the average person, the average layman,
- 39:26you're fighting two battles, right?
- 39:27Obviously, the overwhelming kind of
- 39:29feedback from the average person anti-
- 39:31anti-AI. And I feel like while most
- 39:33people are kind of just unbothered,
- 39:35unconcerned, uninterested in crypto,
- 39:37crypto is kind of
- 39:39for the average person, at least where I
- 39:41come from, my corner of the internet,
- 39:42crypto equals scam. Like the two words
- 39:44are like synonymous.
- 39:45>> It is. And it's sadly, yeah. unfortunate
- 39:47cuz you're fighting cuz as you said, the
- 39:49tech stuff, you know, you see it.
- 39:51Obviously, there's a ton of [ __ ]
- 39:52benefit there, but
- 39:53Yeah. if nobody's coming through the
- 39:54front door, it's like [ __ ] Yeah. It's
- 39:57night and day. So, we have another
- 39:58product called Akash ML where we removed
- 39:59crypto completely. Still got the brand
- 40:01name and that is hitting all-time high
- 40:04usage. I mean, even today we hit
- 40:05all-time high on tokens there. So, when
- 40:07you remove crypto
- 40:09Akash ML is the inference uh as a
- 40:11service from Akash. Uh-huh. Uh it is for
- 40:13uh basically, you can get all the all
- 40:14the good models. Uh you can use Akash ML
- 40:17with your cloud code or your open code.
- 40:19You can switch like your back-end model
- 40:21to use Akash ML. I use Akash ML quite a
- 40:23lot for my coding where I use Opus 4.6
- 40:274.7 for thinking and writing a plan on
- 40:28what I want to do. Once I have a solid
- 40:30plan, I switch to Akash ML. I save a lot
- 40:32of money like a lot of tokens. So, it's
- 40:35a very very very good. Um
- 40:37Uh and so it's an inference as a service
- 40:40and we get a lot of usage there
- 40:41especially if you don't want to go
- 40:42through all the pain of setting up a
- 40:43model. Running a model is very
- 40:45expensive, right? And if you're running
- 40:46like a big model, it costs you like I
- 40:47don't know like thousands of dollars a
- 40:49month just to run it for yourself. But
- 40:52if you use the shared model like Akash
- 40:54ML where you you can use a model that's
- 40:56shared with other people, it's
- 40:57significantly cheaper. So, Akash ML is
- 41:01designed for AI devs and non-crypto
- 41:03folks, right?
- 41:04And that is our biggest growing product.
- 41:06Um And that directly translates to to to
- 41:11to you know, that hosts on Akash and it
- 41:13drives usage to Akash. From a token
- 41:15model standpoint, right?
- 41:17I think the advantage is
- 41:20the way Akash token is tied to the usage
- 41:22is burned. Like every time
- 41:24every time you know, you you use
- 41:26computer on Akash, a portion gets burned
- 41:29using a BME model. So, there's a there
- 41:31is a usage-based economic model and we
- 41:35have more more burns than than mints now
- 41:37because of usage that's going up and up,
- 41:39right? So, if this continues, I think
- 41:42it'll be incredible thing from economic
- 41:44standpoint. Um but it also gives us
- 41:47an ability to create incentives, right?
- 41:50Now now there's a big challenge for
- 41:52onboarding providers using token
- 41:54economics, we can actually create
- 41:56attractive incentives for providers to
- 41:58get to be competitive and whatnot. So, a
- 42:00lot of things you can do really well
- 42:01with tokens. And especially if you're
- 42:02doing distributed training, I'm very
- 42:04excited for token. Yeah.
- 42:06Uh you can see a world where let's say
- 42:08Pluralis, okay? Good example. Pluralis
- 42:10where
- 42:11if I contribute my computer on model,
- 42:14right? If there's a model somebody wants
- 42:15to try, say you you know Ansem wants to
- 42:17train a model. You don't have computer
- 42:19but you have an idea. You have the code,
- 42:20you have the data, but you need you know
- 42:22millions of dollars to compute, right?
- 42:23You can go to Pluralis and be like, "Hey
- 42:25look, I'm willing to pay I need a
- 42:27million dollars worth of compute. I
- 42:29don't have a computer right now, but I'm
- 42:30willing to share my future profits with
- 42:32with the people that provide compute."
- 42:34Oh. So, Pluralis running nodes or
- 42:36whatnot, I'm a node runner. I'm you know
- 42:38I have nodes. I have 590s at home. I can
- 42:41then participate in this model training,
- 42:43get some token that represents my
- 42:45ownership or my contribution, and when
- 42:47the model goes to inference where you're
- 42:48making money, hosting on Akash Amel or
- 42:50whatever,
- 42:51you can get a portion of that
- 42:54portion of that revenues directly for
- 42:57participation.
- 42:57>> Wow. Now that I see as a It's really
- 42:59cool. extremely disruptive model. No one
- 43:01has done this so far and think the
- 43:03people are starting to look into it. We
- 43:06call this op closed weights open source
- 43:08model where the model itself is open
- 43:10source, but the weights are closed only
- 43:12accessible for
- 43:13for people that are doing inference.
- 43:14There's a lot of opportunity for this
- 43:16incredible tokenism token mechanism
- 43:18design that are going to that are going
- 43:20to come with like
- 43:22with with distributed training. I'm
- 43:24really excited about and that's going to
- 43:26be very disruptive. In second uh
- 43:29VVV has done a phenomenal job Venice
- 43:31with with their DM model, right? They
- 43:33they really understood that you can give
- 43:35out free like free inference
- 43:38and you can get really good inference
- 43:39when you can actually use Opus directly
- 43:41using Venice. Not too many people know
- 43:43this, but using your DM you can actually
- 43:46get free
- 43:47free
- 43:48um free compute free inference that you
- 43:51are otherwise have to pay money for for
- 43:52a cloud. So, I sometimes use Venice, you
- 43:55know, when when I want to when I want to
- 43:56use
- 43:58when I have I have some VVV that got air
- 44:00dropped to me super early that is worth
- 44:03a lot of money [laughter] now. Yeah.
- 44:05So, and that I use that as staking and I
- 44:07get my DMs and I do all kinds of cool
- 44:09things. Very very good product if you
- 44:11haven't used it. I was a big user.
- 44:14I use Venice
- 44:15quite a lot. Um
- 44:17Uh I use I mean I used to talk about
- 44:19Venice about few years ago quite a lot
- 44:21before before uh all this hype. Uh for
- 44:24anything medical related I used Venice
- 44:26quite a lot, you know. Uh
- 44:27>> [snorts]
- 44:28>> anything that I want privacy I use
- 44:29Venice. I don't really trust
- 44:31uh Claude or Oh, by the way, if you
- 44:33Claude will use your data to train. So,
- 44:35you just be very careful what you give
- 44:36it, right? So, don't give anything you
- 44:37want to you want to be become a a part
- 44:40of a training set, right? Um
- 44:43So,
- 44:44and they'll report things that they find
- 44:46suspicious. It doesn't matter. You can't
- 44:48It doesn't have to be suspicious for
- 44:49you, but if they think it's like I don't
- 44:51know. I mean, well, that's concerning.
- 44:53I've I've literally sent Claude pictures
- 44:54of my my penis.
- 44:56>> [laughter]
- 44:57>> Yeah, that's part of your training For
- 44:59medical medical reasons. I'm like it's
- 45:01like, you know, it's like my It's like
- 45:03my best friend. He's like my accountant,
- 45:04my lawyer, my doctor, all of it. Be very
- 45:07careful. It's going to snitch on you.
- 45:08Yeah, it's going to leak. Uh so, so
- 45:10whatever you do, Claude.
- 45:12But Venice is going to be great because
- 45:13Venice doesn't retain data. Privacy I
- 45:14think privacy is is a big uh
- 45:17big challenge with AI and love Venice.
- 45:19It's It's a great tool. So,
- 45:21that that It seems like to me like if
- 45:22you believe two things that open-source
- 45:25AI is going to dominate in the future,
- 45:26continue to be more popular, and also
- 45:28that AI demand and the demand for
- 45:30agentic
- 45:31um AI is going to continue to go up, it
- 45:34seems like there's a lane for really
- 45:36really cool token mechanism design,
- 45:38which is what you were talking about. Um
- 45:40and that like a lot of the issues that
- 45:42crypto projects have had in the past is
- 45:43there was like there wasn't a lot of
- 45:45revenues tied to these tokens. Like it
- 45:47was a future growth story that you were
- 45:48betting on something happening in the
- 45:50future. But now it's like the demand is
- 45:51real,
- 45:53um and it seems like you can tie tokens
- 45:54to that demand in a really
- 45:57um clear way. So, that's that's awesome
- 45:58to hear. I think that's that's really
- 45:59dope. Uh you said this token token
- 46:02economics models are going to be a
- 46:03winners, right? Because you can like
- 46:04helium direct from the job B and me
- 46:07with the cash we kind of adopt a similar
- 46:09models
- 46:10with with the demand that's going crazy
- 46:12now. I think time that back to the token
- 46:14economics is going to be beneficial.
- 46:16Yeah, I'm actually very excited. Now
- 46:18that things are slowing down a little
- 46:19bit. There's a lot of capitulation a lot
- 46:21of like market correction and protocols
- 46:24dying what not. I think the real
- 46:25economic no longer you're going to have
- 46:26just speculation just like hey I have a
- 46:28token for governance. I think that's not
- 46:30going to fly much. It's not it's not
- 46:32going to work anymore. You got to tie
- 46:33down. You got to have some metric that
- 46:35you're going to optimize for and and pay
- 46:36attention to.
- 46:38I'm I'm very excited for this new new
- 46:40wave of token economic design. I think
- 46:42it's all like
- 46:44We see this quite a lot, right? Like
- 46:45every time there's a boom and a bust,
- 46:47you know, you see the fundamentals go
- 46:48up. I only hope that this time
- 46:51it looks like market is recovering quite
- 46:52a bit now. At least the the fundamental
- 46:55projects are gaining some some you know,
- 46:59some attention. Yeah. I really hope that
- 47:01we don't diverge into pure gambling like
- 47:03we always do after this first and then
- 47:05meme coins. I have no idea what what
- 47:07this is going to be. I really really
- 47:09pray that the gambling won't return.
- 47:12>> Yeah.
- 47:13You know.
- 47:14Yeah, I also I also would prefer the
- 47:17real project. I mean, it's interesting
- 47:18for me cuz I as a trader I kind of
- 47:20identify with the areas I think are
- 47:22going to get a lot more attention.
- 47:24And at one point that was NFTs at one
- 47:26point that was meme coins. But like I
- 47:27think it's really really important is
- 47:29like why I really enjoy having you on
- 47:31and having other people on the pod is
- 47:32like to talk about the projects that are
- 47:34really doing doing well and have like
- 47:36real fundamentals behind them.
- 47:38So yeah, I do think the market's
- 47:39turning. I mean, stocks are [ __ ] at
- 47:41all-time highs, bro. Everything else is
- 47:42ripping. Crypto is down and everything
- 47:44else is ripping and we're just now
- 47:46starting to see the few really solid
- 47:48crypto protocols start to do well like
- 47:50hype all-time highs today. Zcash has
- 47:52been doing well. So I do I do think that
- 47:54there's a like there's a lot of projects
- 47:57that weren't solid and now we're seeing
- 47:58like the quality ones do well, which I
- 48:00think is going to continue for sure. So
- 48:02>> Yeah, and I think another point about
- 48:04how crypto and AI are going to win
- 48:07together. Like the crypto stuff is very
- 48:09hard to use, right? Like you know Akash
- 48:10stuff. If you remove the credit card
- 48:12stuff, it's very hard to use in general
- 48:13speaking. There's a lot of things that
- 48:14you don't get
- 48:16that you get with with traditional
- 48:18application you don't get with crypto.
- 48:20Agents don't have the problem.
- 48:21>> [clears throat]
- 48:21>> Agents can
- 48:22>> [laughter]
- 48:23>> Exactly. very easily. Yeah. I was
- 48:25surprised how well agents were using
- 48:27Akash. It's like remarkable different.
- 48:30Um and I use Akash with agents now, only
- 48:32with agents now. I don't I don't deal
- 48:33with the command line directly. But
- 48:35we're able to build so much now, so so
- 48:38fast. It's unbelievable speed. Before
- 48:42like I'm talking about 6 months ago Mhm.
- 48:44or even 3 months ago, our mode was
- 48:46focus, focus, focus. Yeah, even though
- 48:48we have a million ideas, really good
- 48:49ideas, right? Uh you have to stay
- 48:52focused on single doing one thing, one
- 48:54thing only. Yeah.
- 48:55>> But that has flipped now.
- 48:57Um because the cost the failure cost is
- 48:59low. Right? You can put you have an
- 49:01idea, you can prototype that quickly, go
- 49:03to market very quickly,
- 49:05fail or succeed, you you'll know very
- 49:07quickly. Yeah. Yeah, and the failure
- 49:10cost has gone down, but the opportunity
- 49:11cost has gone up. Cuz if you don't do
- 49:13it, someone else is going to do it.
- 49:15>> Somebody else is, yeah. Right? Because
- 49:16the AI cuz you can produce this thing so
- 49:19you know, the world has flipped now.
- 49:21What is that going to look like in terms
- 49:22of businesses and how they're exploring
- 49:24opportunities? For us, we want to
- 49:27uh
- 49:29if you have an idea, we want to go to
- 49:30market as quick as possible.
- 49:32Um you know, and then
- 49:34uh you know, whether we fail or succeed,
- 49:36I'll proceed our way instead of
- 49:38rejecting ideas. So we're now a lot more
- 49:41open-minded to a lot more and incredible
- 49:43things are happening across the team. Um
- 49:45all engineers now use our token maxing
- 49:48basically. Mhm. And we measure their uh
- 49:52uh their their performance based on how
- 49:54much tokens they use.
- 49:55>> Really?
- 49:56I mean, you see the outcomes, but
- 49:57everybody's producing outcome. I mean,
- 49:58there's a lot of outcomes that's that's
- 49:59very impressive. But also, like if
- 50:01you're not using tokens efficiently,
- 50:04uh you no longer have a place in the
- 50:05company. Like we are very very hardline
- 50:08on it. Um uh and if you ask me a
- 50:11question that you didn't ask Claude or
- 50:13AI before, that's another red flag on
- 50:15your uh
- 50:17on your thing. That's hardcore.
- 50:19Yeah, we I mean, because I don't know
- 50:21how much you use it. You can connect
- 50:22using MCPs, you can connect every every
- 50:24data source. Like we use linear for our
- 50:27management, we connect that, we use
- 50:28HubSpot for whatever CRM, we use
- 50:31uh Google Analytics, we use uh Postgres
- 50:33database, Metabase. We have so many
- 50:35tools that we use. You can all of them
- 50:37to Claude. You can just ask it
- 50:38questions. Oh, what is our conversion
- 50:40rate? How is our conversion rate
- 50:41affecting our revenues? What is our All
- 50:44these questions that business questions
- 50:45that you normally have to go and ask
- 50:47your data guy to go build up your uh you
- 50:49know, build build up your dashboards or
- 50:51whatever. That's no longer the case. You
- 50:53literally go and ask. If you're a
- 50:55marketing person, you have a question
- 50:56about data, you go to uh you go to
- 50:58Claude and you ask Claude uh before you
- 51:01approach an engineer to to to pull the
- 51:03report for you. So, the amount of
- 51:06friction is so low in terms of getting
- 51:09data, the amount of asymmetry is so
- 51:11little in terms of information. There's
- 51:13no excuse for you
- 51:15uh
- 51:16uh to not get the information that you
- 51:18need if you haven't tried. So, our bar
- 51:20has increased a lot now for anybody that
- 51:22comes uh and works for us, you have to
- 51:24learn how to use the systems, and you
- 51:27have to um now we're already we're also
- 51:30like evolving our systems in a way
- 51:32It's going to sound a little technical,
- 51:34but I think it's important. Um
- 51:36How you know,
- 51:38Brian uh uh
- 51:41Coinbase uh allegedly
- 51:43uh is uh
- 51:45you know, having non-developers develop
- 51:47production code. Um you did you see that
- 51:50thing? They fired a bunch of people. And
- 51:52that's funny and a little dangerous
- 51:53because you you don't really have I
- 51:55think AI is not yet there in terms of uh
- 51:59uh having a non-developer just push
- 52:01production code. I mean, non-developers
- 52:03can build apps easily now with AI, but
- 52:06to build a production quality app, it
- 52:08takes a lot of effort. But, I started
- 52:10asking the question, uh why does it
- 52:12matter? Does it matter? Do you have good
- 52:15good good good quality?
- 52:18So,
- 52:18uh turns out it does matter if your
- 52:22systems are built in a way that are
- 52:24brittle. But, what if you rebuild this
- 52:26>> on them. Yeah. No, so what if you build
- 52:28your internal architectures to be more
- 52:31modular, more fault tolerant in the
- 52:33sense like oh, you know, how how to
- 52:36build a gigantic like ERP system we're
- 52:37building, right? Uh to
- 52:40to connect all your diverse all your
- 52:42data sources and like sort of visualize
- 52:43and all that stuff. If we made
- 52:45individual modules independent so that
- 52:48even if they fail, they can fail
- 52:50independently without taking down the
- 52:52whole system. Yeah. So, if you
- 52:53modularize and if you box your
- 52:55applications and you make them small
- 52:57applications, you can actually have
- 52:59non-engineers build your applications.
- 53:01Like, you can. Yeah. But, you just need
- 53:03to understand the the the the the
- 53:06failure surface. If you reduce the
- 53:08failure surface because AI is really
- 53:10good for like starting new projects and
- 53:12shipping them quickly, but it's not so
- 53:13good at retrofitting into old projects.
- 53:16Um especially if an old project has more
- 53:18than 2,000 lines of code, AI goes really
- 53:19down. The bigger the context, right? So,
- 53:22what if you can what if you can create a
- 53:25system where you have very small
- 53:26context, smaller code bases, uh small
- 53:30failure surface,
- 53:31uh very strong validation uh criteria,
- 53:34and very strong hyper modularity. I
- 53:36think there is a new uh this is what I'm
- 53:39talking about, new architectures for
- 53:40software engineering are emerging with
- 53:42this agents as the first users or first
- 53:45builders.
- 53:46Agent first building and we developing
- 53:48all these things are I'm just enjoying
- 53:50because all these
- 53:52knowledge you gain over time like 25
- 53:54years of writing software, right? All
- 53:56this knowledge you gain over time are
- 53:58coming back now all this modularity, all
- 54:01these like services oriented
- 54:03architectures, all these architectures
- 54:04that lost long time are coming back with
- 54:07these agents it's it's a lot of fun to
- 54:09be in the market. services architecture
- 54:11>> [laughter]
- 54:12>> Microservices remember that stuff
- 54:13that thing is gone but That's what I
- 54:15used to do.
- 54:17Right, right. So there's a big hype
- 54:18about it but no they went to monetary
- 54:20policy where it's too hard to maintain
- 54:22microservices but you need microservices
- 54:24now because
- 54:25you want an individual service to fail
- 54:28instead of the whole whole whole system.
- 54:30That's actually cool.
- 54:31>> So
- 54:32exactly. So it's it's kind of fun to go
- 54:35back to the old concepts.
- 54:37Well yeah, we we talked about a lot man.
- 54:39I me and my we kind of align with you
- 54:41like how you said it's it's
- 54:43non-developers can now build things. We
- 54:45talk about it all the time like the the
- 54:46way that you change your your work
- 54:48professionally.
- 54:50We got we got Maine waiting in the back.
- 54:53He's going to hop on with us in a
- 54:54second. I appreciate you coming on. This
- 54:56has been great and appreciate it. This
- 54:58has been great. Yeah, it's been awesome
- 54:59talking to you. We got to bring you back
- 55:01on in like a couple months see how much
- 55:03stuff has changed. Let's do it.
- 55:05>> Cool bro.
- 55:07Yo later. Love Greg.
About this transcript
This page contains the full transcript of Why Apple Will WIN The AI Race.. by Market Bubble, generated from the public captions YouTube serves with the video. The transcript has 10,815 words across 1,700 segments, with the original timestamps preserved so you can click any line to jump to that moment in the embedded player.
What you can do with it
Use the transcript to take notes, quote the speaker, build a study guide, generate a summary with ChatGPT or Claude via the YouTube Summary tool, or export it as a timed subtitle file with YouTube to SRT. You can also re-open it in the transcriber to translate the transcript into 100+ languages.
Free YouTube transcript tool
YouTube2Text is a free YouTube transcript generator — no signup, no daily limit. Paste any YouTube link and get the full transcript instantly, with timestamps, click-to-jump, translation to 100+ languages, AI prompts for ChatGPT, Claude, and Gemini, and exports to TXT, SRT, VTT, or Markdown.