I Built an App for My House With AI — Transcript

Full transcript

1. 0:02Wow, this uh turned out to be a lot bigger than  I thought it would be. [music] Which part do you
2. 0:08mean? Well, the entire app that is running on my  TV, which is basically [music] a control center
3. 0:13for everything that I do on a daily basis and  my house. Well, you asked for it. Yeah, I know.
4. 0:21But I never really thought we'd get to this  point. And it all started with a heat pump graph.
5. 0:27Yeah, we should probably scroll back  to the beginning, shouldn't we? Agreed.
6. 0:34Hey, Exo. Yeah, I kind of need your help with  something here. Happy to assist. Go ahead. Yeah,
7. 0:39I want to know what my heat pump does throughout  the day. Okay. You know, when the compressor
8. 0:43starts, the amount of electricity that is  drawing, and whenever the hot water heats up
9. 0:47and that kind of stuff. Do you mainly want to  check it live or look back at what happened? Uh,
10. 0:53I don't know. I'm going to say both ideally  because you know looking at what the heat pump
11. 0:56does right now is not going to tell me what it  did 3 hours ago. Right. Correct. In that case,
12. 1:02we need to gather and record the  data it provides. Oh, and by the way,
13. 1:05I want to make it attractive. Okay. [sighs]  I assume there would be a logo involved. So,
14. 1:10this was basically how this entire project  started because we have a connected heat pump. So,
15. 1:14it it's capable of showing a bunch of different  graphs and data, but the app that comes with it
16. 1:20is incredibly unintuitive in my opinion. So  I thought to myself, wouldn't it be possible
17. 1:26that together with chat GPT and codeex make my own  app that presents the numbers that I want to see
18. 1:34in a nice way because I haven't been playing  around that much with codec. So I thought it
19. 1:39would be a great start. And before we continue  with the video, how would someone go about to
20. 1:44make a project like this on their own if they want  to? First they'd need to choose what they want to
21. 1:49know. then check whether the equipment gives us  a way to read the information we'd want. Okay.
22. 1:54And uh how are we getting it from mine? Your heat  pump uses something called Modbus. Think of it
23. 1:59as a shared language. Our app asks for the water  temperature and the heat pump sends back a number.
24. 2:05For this project, we're only asking it for  measurements. Oh, so you're basically asking it
25. 2:10questions then? Very repetitive ones. So the first  thing that I recommend you do whenever you want
26. 2:14to start a project [music] like this is to start  small. Like start with one unit. ask one question.
27. 2:19Don't try to create this behemoth that you don't  have control of to begin with because you can
28. 2:26elaborate that later. Um, but it's very good to  kind of inspect the units and all the things and
29. 2:35make sure that the codeex connection is going to  work. And another thing that I actually used a lot
30. 2:40in this project is the Homie Pro, but we're going  to get to that later in the video. So stay tuned,
31. 2:46keep watching. And if you haven't subscribed yet,  I highly recommend you to do so because this is
32. 2:51a fun video and there's going to be more of these  for sure and a lot of other tech stuff in between.
33. 2:59Okay, here's the compressor activity. Put the  temperature underneath it and you can follow both
34. 3:04over the same period. All right, so that's when  it started and then we can see what happened here,
35. 3:09right? Yes. We save each reading with the time  it was taken. That's how we can put the day back
36. 3:14together on a graph. Is there any possibility  to calculate what it costs when it's running?
37. 3:19Eventually, if we verify the electrical  power reading, what is wrong with it? Now,
38. 3:23we're getting a number. We still need to check  exactly what it measures and whether we're reading
39. 3:28the units correctly. Until then, using it to  work out a cost could give you the wrong answer.
40. 3:33Okay. So, don't turn it into cost just yet, then.  Agreed. Multiplication would make it more precise
41. 3:39looking. This is actually a very important  step if you want to try this out yourself.
42. 3:43uh you got to make sure that the readings are  correct so that all the info that you're getting
43. 3:48from the app that you're building is true to  the stuff that you actually have in your heat
44. 3:53pump or whatever kind of [music] device that  you're testing with. You know what would be
45. 3:57very useful though? I suspect we're about to  add something seeing what the rest of the house
46. 4:04is doing at the same time. We can bring  in the solar battery and grid readings.
47. 4:09Can we also separate the garage from the  house? The garage has its own meter. So,
48. 4:13we take what the whole property is using, subtract  the garage, and what's left is the house. We only
49. 4:19show that split when both readings are reliable.  Wait, why can't we just use the readings that we
50. 4:23got now? Because the house can also be running  on solar or battery power. The grid connection
51. 4:28only shows what passes between you and the grid.  So, we could be using quite a lot of electricity,
52. 4:34but we're still buying very little. [music]  Exactly. And what about the car charger? We
53. 4:39can show it. Its consumption is already inside the  total, [music] though. Yeah. So, don't don't add
54. 4:44that again. Okay. Unless you'd like an electricity  bill with a fictional subplot. Nah, I'm good.
55. 4:53Dude, this looks incredible. I agree. It suits  you. Do you think we can make it look a little bit
56. 4:59more like our house? Do you have a reference photo  we could use? Do [snorts] I have a reference?
57. 5:04It's like asking me if I have a drone or a camera.  Of course, I do. Several. I had a feeling you'd
58. 5:09do. Here's a good one for you. Okay, I'll work  my magic on it. Add that in. Done. [snorts]
59. 5:15Okay, that's really cool. So, would it be possible  that if I click the solar panels, it takes me to
60. 5:22all the info about the solar system? Yes, that  would be possible. And maybe we could add a little
61. 5:27bit of a slight glow depending on how much they're  producing beneath them as well. A subtle glow.
62. 5:33Yes, subtle. Not too much. Done. The  more electricity the panels are making,
63. 5:39the stronger the glow. If they're making nothing  or we haven't had a fresh reading, the pulse
64. 5:43stops. That is awesome. So, this is honestly  like what most of the process looked like. I
65. 5:50told Codeex what I wanted to have and then Codeex  made it for me and then I tried everything out
66. 5:56and then I found the loopholes and found the  things that I wanted to adjust and then I told
67. 6:01Codeex again to adjust the things that I wanted  to adjust and so on and so forth. You know,
68. 6:04I do have my 3D printers connected to my homie.  So, do you think it would be possible to get a
69. 6:10estimated finished time of the print into  this as well? They already display the
70. 6:14remaining time. Yeah, I know. But then I'm  doing the maths every time. If we add that,
71. 6:20then I can just see which time stamp the  print is going to be finished. Right. Fair.
72. 6:25We can calculate a finish time from the  printer's estimate. Yes, that's how it should be.
73. 6:30We've successfully removed some mental arithmetic.  [music] Yeah, you can joke all you want, but
74. 6:35I'm still going to use this. And that is  also a very important thing with this project
75. 6:39because all my smart devices that I have in my  house is connected to the [music] Homie Pro.
76. 6:45And since all the devices are already connected to  it, it's possible to create an app for the Homie
77. 6:51Pro [music] and pull all the data to my interface  directly from it. So, it basically gave us
78. 6:57a really good foundation to work from. This would  probably work with Home Assistant, too. But the
79. 7:03reason that I kind of went for Homie is because  everything is connected to it. You have a nice UI.
80. 7:08It's very simple and you can also create a lot of  simple flows and advanced flows with the help of
81. 7:15chat GBT and Codeex because you can connect Chat  GBT directly to your homie. Pretty cool. You know,
82. 7:23I was thinking about one thing. Yes. What is going  to happen if I turn my Mac off? Because everything
83. 7:29is stored locally, right? The part collecting  and saving the readings stops. Shut down the Mac
84. 7:34and we stop building that history. Yeah. So, we  need to find some sort of solution that can run
85. 7:39even though the Mac is turned off. Your Synology  could probably do that job instead. You mean the
86. 7:44box that we use for storage? Yes. It's called  a NAS. A storage computer on your home network.
87. 7:49Yours can also run this app. It already stays  on, so it can keep collecting the readings while
88. 7:54your Mac sleeps. Okay. So what is it that you're  actually going to move over there? We move the
89. 7:58bit that collects the readings, the history we've  already saved, and the saved connections it needs.
90. 8:03Your screens then ask the Synology for that  information. So there's basically two parts
91. 8:08that is worthy to understand here. One is  that we move the data collection point to
92. 8:13the NAS unit where it stores all the data and  saves everything locally on the drive. And then
93. 8:20the MAC is going to be the thing that actually  displays all the data that we have saved on the
94. 8:26NAS unit which I think is pretty cool. We used a  Synology tool called container manager. It runs
95. 8:32a packaged [music] copy of Observatory with the  software it needs. Okay. So we keep the history
96. 8:37when we're updating the app then. Yes. The app  and the saved history live separately. That means
97. 8:42we can replace the app when we update it without  replacing all the readings you've collected. Well,
98. 8:46that sounds important. I guess it tends to become  very important immediately after someone forgets.
99. 8:56We are living in the future. So they say, by  the way, do you think we could get it up on the
100. 9:02TV? The PRMGR Observatory? Yeah, like an actual  installed [music] app. I want to be able to open
101. 9:07it with my remote. Sounds possible. What model is  it? Uh, I don't know. It's an Android TV. Okay,
102. 9:13so it runs Google TV. That's the software behind  its home screen and apps. It's built on Android,
103. 9:19so we can make an Android TV app and install it  on this television. This is actually one of the
104. 9:23first things that you need to check if you want  to do the TV part yourself. Find the exact model,
105. 9:28the operating system, and um how you can unlock  the developer mode or development mode. I don't
106. 9:36know what it's called exactly, but basically need  to uh allow the codeex to actually enter your TV
107. 9:43if that makes sense. Uh let's take a  look. Settings. Okay. Press seven times.
108. 9:55It says that I'm a developer. You've unlocked an  extra settings menu. We still need to switch on
109. 9:59debugging. That's what lets this Mac connect  and install our app once you approve it on
110. 10:04the TV. Oh, okay. [music] So, that wasn't the  entire qualification, I guess. Then, don't worry,
111. 10:08I'll handle it for you. The PRMGR Observatory  is now live on the TV. Would you look at that?
112. 10:15[music]
113. 10:26[music]
114. 10:37I don't know about you, but I think that  this entire [music] thing is bonkers. It is
115. 10:42so incredibly cool at the same time as it's a  little bit scary. But I have no experience in
116. 10:48designing smartphone apps or smart TV apps or  dashboards [music] or whatever. But I do have
117. 10:53experience within smart home and design because  I'm making my own clothes. I'm doing a lot of
118. 10:58work in Illustrator. So to be able to combine that  has been very cool, especially with this project.
119. 11:04And another cool thing that I'm going to do with  this project is that I'm going to give you all the
120. 11:08source files so that you can just download  that and connect your codecs to the GitHub
121. 11:14and then you can create your own dashboard kind of  similar way that I have. So this right here is the
122. 11:19main dashboard that I ended up with. I mean like I  could probably keep [music] tweaking this forever,
123. 11:23but there's no need to keep working on something  that I think is good. Now, it's just to fine-tune
124. 11:29the details, but you can see everything at a  glance here, which makes it very easy and very
125. 11:35simple to know how everything is working with  the house. And when you click on the house,
126. 11:40for example, you get all the data about the  house that you might need. If you click on the
127. 11:45solar panels, you get all the data about the solar  panels straight served on the dashboard as well.
128. 11:52And if you go to the garage, then you're going  to be able to see all my work related stuff
129. 11:58at a glance, which I think is pretty cool.  So, if you go back to the home overview and
130. 12:02scroll down a little bit, uh I can see my  live cameras that is around the property,
131. 12:09my Instagram accounts, my YouTube accounts, and my  latest posts and how they performed as well as my
132. 12:18uh Instagram comments. So I can actually reply  from this dashboard [music] directly because I
133. 12:23use the APIs from Meta and uh I can also go and  see here audience and trends and then you get a
134. 12:30trend [music] report kind of straight up from your  own dashboard which I think is cool and then you
135. 12:36have my 3D printers uh everything else that you  might want to have straight up in the dashboard.
136. 12:43So, I think that being able to see all of  this right in front of your eyes without
137. 12:49having to click in multiple different programs  [music] and tabs and so on and so forth is
138. 12:56like it's so good. And that is one of the reasons  that I created it. And another detail that I
139. 13:01actually did was that the lights outside when it's  night then I can turn on the lights on my house
140. 13:12in real time. So when lights turn on outside, it  turns on on the image as well. And I think that
141. 13:18that is pretty sick. [music] It's a nerdy thing,  but this entire thing is nerdy. So if you like
142. 13:23this video, don't forget to subscribe and um don't  forget to comment like, are you going to use this?
143. 13:28Are you going to try it out? Are you going to  design something yourself? I would love to know.
144. 13:33So do drop a comment down below. And um I hope I  will see you in the next video. And uh stay safe
145. 13:39because it's a crazy world out there right now.  All right, Peter from Sweden is saying goodbye.