YouTube2Text

Why Big Corporations are Secretly Shifting to Chinese AI Models — Transcript

by Nick Saraev · 2,463 words · 368 segments · language en · Watch on YouTube

Full transcript

  1. 0:00Big corporations are shifting to Chinese
  2. 0:01models. Uh Coinbase now runs on Chinese
  3. 0:04AI. They split their ad bill by
  4. 0:05approximately half by doing this.
  5. 0:07Airbnb's customer service runs on
  6. 0:09Chinese models. More than half of all
  7. 0:11open router tokens are currently on
  8. 0:13Chinese models. In this video, I'm going
  9. 0:15to explain why. So, the first thing you
  10. 0:16got to understand is the scale. Most
  11. 0:17people think it's just a couple of
  12. 0:18startups here and there using these, but
  13. 0:20it's only a few people that have
  14. 0:21actually talked about it. Big chunk of
  15. 0:23American companies are now using Chinese
  16. 0:25AI models for a variety of reasons. Um
  17. 0:27one of them being privacy, another being
  18. 0:28security. We're going to talk that in a
  19. 0:30second. You know, OpenRouter, for those
  20. 0:32of you guys that don't know, is a
  21. 0:33marketplace that people use to call a
  22. 0:36bunch of different AI models through one
  23. 0:38API. They basically simplify the process
  24. 0:41of dealing with AI models by giving your
  25. 0:43agents a simple replaceable API call
  26. 0:45format that allows you to swap it out
  27. 0:47for whatever model you think might
  28. 0:49necessitate the task. About a year ago,
  29. 0:51American models were about 70% of all of
  30. 0:53the traffic on OpenRouter. Today, it's
  31. 0:56about 30%. In July, Chinese models
  32. 0:59actually took all five spots of token
  33. 1:02volume. And they also carried
  34. 1:03approximately 58% of all tokens that US
  35. 1:07companies sent through it. That means
  36. 1:08that American companies were
  37. 1:09preferentially using Chinese models
  38. 1:11versus their own. If you compare that to
  39. 1:13Hugging Face, where people download and
  40. 1:15reshare open models, um Quen had over 2
  41. 1:19billion downloads this year. That's 2
  42. 1:21billion. That's about a quarter of the
  43. 1:22total number of human beings in
  44. 1:24existence. Meta, on the other hand, had
  45. 1:26only about 230 million. Because of this
  46. 1:28divide, a massive amount of
  47. 1:30infrastructure has actually been built
  48. 1:31on top of Quen. We have over 150,000
  49. 1:35models that have been post-trained,
  50. 1:36fine-tuned, and ultimately modified from
  51. 1:38the initial Quen branch. Coinbase,
  52. 1:40Airbnb, DoorDash, Cursor, um the search
  53. 1:43engine Ecosia, all of these use Chinese
  54. 1:45models right now. Amazon, Google, and
  55. 1:47Microsoft are also providing Chinese
  56. 1:49models at scale to customers. So, why is
  57. 1:51this happening? Three main reasons. The
  58. 1:53first is price. The Claude family of
  59. 1:56models currently offered by the flagship
  60. 1:58LLM provider Anthropic currently charge
  61. 2:00anywhere from two to $10 per million
  62. 2:04input tokens. OpenAI's flagship models
  63. 2:07cost anywhere from 10 to, assuming you
  64. 2:09use fast mode or ultra-fast mode, $60
  65. 2:13per million input tokens. We're not
  66. 2:14accounting for output tokens here, which
  67. 2:16can go as high as $300 per million. But
  68. 2:18this, for example, is Kimi K3.1 Pro,
  69. 2:21which is Moonshot's newest flagship
  70. 2:23model. Moonshot is releasing the open
  71. 2:25weights on places like Hugging Face and
  72. 2:28a couple of other providers as well. But
  73. 2:30if you want an out-of-the-box
  74. 2:31experience, you can also just pay API
  75. 2:32pricing directly to the Kimi team, who
  76. 2:35host the model, optimize it, and then
  77. 2:37also run inference on it for you. And
  78. 2:39right now, they only charge $2 per
  79. 2:43million input tokens. If you go a little
  80. 2:45bit back in time, you could see prices
  81. 2:47even lower at 95 cents per million
  82. 2:49tokens for K2.7 code. I know what most
  83. 2:51people are probably thinking. As of the
  84. 2:52time of this recording, frontier models
  85. 2:54from Anthropic and OpenAI are very close
  86. 2:57to on par with Kimi K3.1 Pro on a
  87. 3:00variety of benchmarks. But here's the
  88. 3:02thing I don't think you fully
  89. 3:03understand. We're already well past the
  90. 3:05point of good enough. Most coding
  91. 3:08applications do not actually need the
  92. 3:10most frontier model of frontier models.
  93. 3:12What they need is they need something
  94. 3:14that's fast, and they need something
  95. 3:15that is reasonably performant to act as
  96. 3:18the fingers of a broader hand that
  97. 3:19orchestrates things.
  98. 3:21In this way, Kimi K3.1 Pro and other
  99. 3:23models like it are a much more
  100. 3:25cost-effective way to do the same thing.
  101. 3:27And you can even fine-tune these models.
  102. 3:29The base model intelligence you get out
  103. 3:31of the box on Kimi K3.1 Pro might look
  104. 3:33just a tad lower on benchmarks than,
  105. 3:35let's say, Opus. And you can download
  106. 3:37these. I'm currently on Hugging Face
  107. 3:39here, which is a website where you can
  108. 3:41download a variety of open models.
  109. 3:43Moonshot says that the full K3.1 Pro
  110. 3:45weights will land here on exactly
  111. 3:48November the 4th. Kimi K3, their
  112. 3:50previous model, is up right now if you
  113. 3:52guys wanted to download that. But on
  114. 3:54November the 4th, you'll also be able to
  115. 3:55download K3.1 Pro, assuming you have
  116. 3:58enough hardware, and then even fine-tune
  117. 3:59it to the specific tasks that your
  118. 4:01company needs it to. Now, historically,
  119. 4:03this would cost a lot of money, but big
  120. 4:04corporations have both the funds and the
  121. 4:07wherewithal to take one of these models,
  122. 4:09spin up their own GPU clusters, or be
  123. 4:11more economical in who they're sending
  124. 4:13their hard-earned money and time to, and
  125. 4:15then fine-tune it and train it on tasks
  126. 4:17that they specifically need. Things
  127. 4:19like, you know, Airbnb's customer
  128. 4:20service, Lindy, which is an AI
  129. 4:22automation tool that lets you automate a
  130. 4:24bunch of business processes, recently
  131. 4:26moved their whole stack off of
  132. 4:28previously Western models to
  133. 4:30significantly more performance Chinese
  134. 4:31models. Bunch of people asked why, the
  135. 4:33founder Flo explicitly said, "Well, you
  136. 4:35don't need God to write your email, do
  137. 4:37you?" And that's more or less what we're
  138. 4:39getting at. You don't need the greatest
  139. 4:41and best generation of models in order
  140. 4:43to do most business tasks. And people
  141. 4:45are slowly waking up to the fact that
  142. 4:46the capability has moved far beyond what
  143. 4:49people are using it for, especially in
  144. 4:51most consumer applications. The next big
  145. 4:53reason is control. One thing that a lot
  146. 4:55of big companies are worried about is
  147. 4:57large language model companies in the
  148. 4:59West like Anthropic, OpenAI, Google
  149. 5:02DeepMind, and so on and so forth,
  150. 5:04technically have access to every query
  151. 5:06that any developer has ever sent to
  152. 5:08them. If you're working on something
  153. 5:10that is extraordinary data-intensive,
  154. 5:12let's say something that is super
  155. 5:14private and something that you don't
  156. 5:15necessarily want to share. It's your own
  157. 5:17intellectual property, it's your own SOP
  158. 5:19or process, and it's very unique to your
  159. 5:21company, it's how it makes money. Well,
  160. 5:23you might just be in a situation where,
  161. 5:26by working on what you want to work on
  162. 5:27with an American model, you're actually
  163. 5:29giving it all of your sensitive IP and
  164. 5:32information. It's not rare. This has
  165. 5:34happened a couple of times now where,
  166. 5:36you know, a set of researchers or a set
  167. 5:38of theoreticians were working on answers
  168. 5:40to very difficult problems, like a
  169. 5:41recent Millennium math prize problem,
  170. 5:43and then a couple days ago a large
  171. 5:45frontier lab posts the solution, almost
  172. 5:47like it's a magical coincidence. In that
  173. 5:49way, large language model companies are
  174. 5:51actually actively soaking up all of the
  175. 5:52moat, and then using that moat to train
  176. 5:54the next generation of models. Well, the
  177. 5:56reality is big companies have a lot of
  178. 5:58financial incentives, and they don't
  179. 6:00necessarily want to share those
  180. 6:01incentives or upside with AI companies
  181. 6:04like Anthropic or OpenAI or Google
  182. 6:06DeepMind. What they would prefer to do
  183. 6:08is keep their intellectual property,
  184. 6:10keep their SOPs, and sort of private
  185. 6:12workflows and ways of doing things, and
  186. 6:14instead just download open weights
  187. 6:15models like Kimiko 3 and have them run
  188. 6:17for them. Because they're open weights,
  189. 6:19because they're on their own devices,
  190. 6:21because they control the whole
  191. 6:22fine-tuning stack, they don't need to
  192. 6:23worry about somebody, I don't know,
  193. 6:24leading the legal department at one of
  194. 6:27these large language model companies
  195. 6:28creating some new legal product based
  196. 6:30off of their own legal workflows.
  197. 6:32Basically, despite the fact that
  198. 6:33everybody, myself included, calls them
  199. 6:34Chinese AI models, you don't actually
  200. 6:36have to send your data to China in order
  201. 6:38to use the AI model. Contrast that with
  202. 6:40Anthropic, OpenAI, Gemini, and so on and
  203. 6:43so forth, and you kind of have to send
  204. 6:45your data at least outside of the bounds
  205. 6:46of your business, maybe not the country,
  206. 6:48but certainly outside of the bounds of
  207. 6:50your company in order to use it. Now, if
  208. 6:51you don't believe me, you can actually
  209. 6:53go and use these Chinese AI models right
  210. 6:56now, and you can test it for yourself.
  211. 6:58I'm currently on the Kimi homepage. You
  212. 7:00can get to that at kimi.com or kimi.ai.
  213. 7:03And just like you see ChatGPT,
  214. 7:06Anthropic's Claude, and so on and so
  215. 7:07forth, you actually have an interface
  216. 7:09that looks just like this. So, hey, how
  217. 7:11is it going? And you can see they have a
  218. 7:12cute little thing that's kind of
  219. 7:14reminiscent to X's Grok bot. I'm going
  220. 7:16to ask it to build me a simple landing
  221. 7:19page for a hypothetical coffee mug. You
  222. 7:22can actually click the thinking tab and
  223. 7:24see what is going on under the hood
  224. 7:26reasoning-wise.
  225. 7:28And yeah, there's really nothing special
  226. 7:29going on here. I'm currently running
  227. 7:31this using the Kimi chat app, which
  228. 7:33means that the data that I am working on
  229. 7:35is technically leaving the confines of
  230. 7:37the country. It is currently being sent
  231. 7:38over to, presumably, China. Depends on
  232. 7:41where they have their GPUs and their
  233. 7:42inferences being done. Um, but this is
  234. 7:45something that you guys could very
  235. 7:46quickly internalize in your company,
  236. 7:48assuming that you are a big corporation
  237. 7:49with a few hundred thousand dollars to
  238. 7:51spend on localizing and making inference
  239. 7:53run within the confines of your
  240. 7:55business. Now, you can see it's actually
  241. 7:56going through and writing all of the
  242. 7:58code. It's even designing the SVGs in a
  243. 8:01super clean, extraordinarily succinct
  244. 8:03way. None of this stuff is coming to me,
  245. 8:05by the way. This is all just a reasoning
  246. 8:07tokens. One of the reasons I like using
  247. 8:09Kimiko 3.1 Pro specifically is because
  248. 8:11the reasoning is a lot clearer to me
  249. 8:13than a lot of what's going on with, you
  250. 8:16know, Open AI's models, let's say, or
  251. 8:17Anthropic's models. If you guys have
  252. 8:19ever looked at like GPT-OSS-120B
  253. 8:21and expand the reasoning, it is freaking
  254. 8:23bonkers. I have no idea what this thing
  255. 8:25is saying. But this is still very much
  256. 8:26like in English. Okay, so it's actually
  257. 8:28going through and it's building me the
  258. 8:29SVG of the landing page. As you see,
  259. 8:31it's pretty cute there. We got a little
  260. 8:32coffee mug. And this is actually being
  261. 8:34built directly in the browser
  262. 8:35experience. I mean, you know, obviously
  263. 8:38I'd prefer an actual image of some
  264. 8:39hypothetical mug. I'm not going to lie,
  265. 8:41this is pretty damn clean. If your job
  266. 8:44is just designing simple and
  267. 8:45straightforward interfaces like this for
  268. 8:47a company internally, do you really
  269. 8:48need, you know, the next latest and
  270. 8:50greatest Gemini model? Or is something
  271. 8:53like Kimiko 3.1 Pro totally fine? So not
  272. 8:56only is it cheaper and faster, you also
  273. 8:58get it totally 100% localized. Anyway, I
  274. 9:00know most people are going to accuse me
  275. 9:01of glazing at this point, but yeah,
  276. 9:03Kimiko's awesome deep seek pretty cool.
  277. 9:06Obviously, they have some quirks and
  278. 9:07there are some questions as to how these
  279. 9:08were trained initially, but models like
  280. 9:10this are fueling the next generation of
  281. 9:13corporations. And because we're
  282. 9:14fine-tuning them, you actually achieve
  283. 9:16far better results on specific tasks,
  284. 9:18usually tasks that are highly wrote, of
  285. 9:20which a big corporation will have a lot
  286. 9:21of data and examples of of of being
  287. 9:23done. So what should you actually do?
  288. 9:25Okay, here's how I would decide if I
  289. 9:27were running AI inside of a mid-sized
  290. 9:30maybe big big company today. Um first, I
  291. 9:32would build infrastructure inside the
  292. 9:35company that allows me to swap models at
  293. 9:37will. So I'd actually build some layer,
  294. 9:39just like Open Router, within the
  295. 9:40business that at any point in time I
  296. 9:42could press one button and then all
  297. 9:43requests could be sent to a different
  298. 9:45model provider, presumably with the same
  299. 9:47request structure, reasoning tokens,
  300. 9:49efforts, and so on and so forth. The
  301. 9:51idea is you want to be able to choose
  302. 9:53the best and highest performing model
  303. 9:55for your needs. Second, I would start
  304. 9:57all of my requests with the most
  305. 9:59intelligent models possible. What I mean
  306. 10:01by that is just look at whatever new
  307. 10:03benchmark or new model drop just
  308. 10:05occurred and try routing a request to
  309. 10:07that smartest model. Then I would
  310. 10:09evaluate and see, can that smartest
  311. 10:10model do my task? If the answer to that
  312. 10:12question is yes, then what I do is I'd
  313. 10:13roll it back one generation. And then
  314. 10:15see, okay, now we're back one
  315. 10:17generation, things are probably cheaper
  316. 10:18and probably a little less performant.
  317. 10:20Can the model still do my task? If the
  318. 10:22answer to that question is yes, then
  319. 10:23roll it back another generation.
  320. 10:25Continue doing this process until you
  321. 10:27get to a point where the model can no
  322. 10:29longer do your task at the level of
  323. 10:31quality you within your organization
  324. 10:33believe it needs to. And then if the
  325. 10:34level of model that is doing that,
  326. 10:36presumably a Western model, is at or
  327. 10:38below the level of the best Chinese
  328. 10:41model on the market that is also open
  329. 10:42source, then make it open source. It
  330. 10:44really doesn't have to be more
  331. 10:45complicated than that. Go download, you
  332. 10:48know, the open weights of Kimmy.
  333. 10:49Obviously verify you have the
  334. 10:50infrastructure or the means to acquire
  335. 10:52the infrastructure in the first place,
  336. 10:53but go go get it, actually get it up to
  337. 10:56speed on some infra, optimize it if you
  338. 10:58need for speed or performance, and then
  339. 11:00even fine-tune it if you want for better
  340. 11:02performance on a variety of tasks. Not
  341. 11:04only are you not going to be beholden to
  342. 11:06a major large language model company in
  343. 11:07the West, you won't be beholden to
  344. 11:09anybody. Essentially, you will have your
  345. 11:11own brain operating in your own server
  346. 11:13acts. And that is worth more than
  347. 11:14virtually any intelligence upgrade
  348. 11:16because anybody could pull the plug on
  349. 11:18you at any point in time. Better to rely
  350. 11:21on your own hardware or software than
  351. 11:23somebody else's. Hopefully, you enjoyed
  352. 11:25this video and market opportunities are
  353. 11:26increasing in both frequency and
  354. 11:28magnitude. They're also occurring a lot
  355. 11:30faster and for shorter periods of time.
  356. 11:32If you want to learn how to take
  357. 11:33advantage of these market opportunities
  358. 11:34and build a business doing so,
  359. 11:36definitely check out Maker School down
  360. 11:38below. It's my 90-day accountability
  361. 11:39program where I'll guarantee you your
  362. 11:41first paying customer for an AI
  363. 11:42automation service in that time period
  364. 11:44or I'll give you your money back. Aside
  365. 11:45from that, please like, subscribe, and
  366. 11:47leave a comment down below with what you
  367. 11:48want me to talk about next. See you
  368. 11:50later.

About this transcript

This page contains the full transcript of Why Big Corporations are Secretly Shifting to Chinese AI Models by Nick Saraev, generated from the public captions YouTube serves with the video. The transcript has 2,463 words across 368 segments, with the original timestamps preserved so you can click any line to jump to that moment in the embedded player.

What you can do with it

Use the transcript to take notes, quote the speaker, build a study guide, generate a summary with ChatGPT or Claude via the YouTube Summary tool, or export it as a timed subtitle file with YouTube to SRT. You can also re-open it in the transcriber to translate the transcript into 100+ languages.

Free YouTube transcript tool

YouTube2Text is a free YouTube transcript generator — no signup, no daily limit. Paste any YouTube link and get the full transcript instantly, with timestamps, click-to-jump, translation to 100+ languages, AI prompts for ChatGPT, Claude, and Gemini, and exports to TXT, SRT, VTT, or Markdown.