YouTube2Text

How Students Are Using AI For Homework: But How Good Is ChatGPT At School? | Talking Point — Transcript

by CNA Insider · 6,964 words · 1,046 segments · language en · Watch on YouTube

Full transcript

  1. 0:00[Music]
  2. 0:08This was me two decades ago as a
  3. 0:11student. But these
  4. 0:13[Music]
  5. 0:23[Applause]
  6. 0:26days, according to a 2024 survey
  7. 0:29conducted in the US, 26% of teens aged
  8. 0:3313 to 17 use the AI chatbot Chat GPT for
  9. 0:37their schoolwork, a twofold spike from
  10. 0:402023.
  11. 0:41[Music]
  12. 0:44Is anyone doing their own homework
  13. 0:46[Music]
  14. 0:49[Applause]
  15. 0:58anymore? There is no similar study done
  16. 1:01in Singapore, which is why Talking Point
  17. 1:04has launched a nationwide survey. We
  18. 1:07reached out to students aged 15 to 25
  19. 1:11from secondary schools all the way to
  20. 1:13institutes of higher learning. With AI
  21. 1:16chatbots literally at their fingertips,
  22. 1:19I want to find out if our students are
  23. 1:21actually doing their homework and what
  24. 1:24the consequences are if they're letting
  25. 1:26AI take over.
  26. 1:29[Music]
  27. 1:36[Music]
  28. 1:39Before I can find out what students are
  29. 1:41using AI for, I need to know what kind
  30. 1:45of AI tools they have at their
  31. 1:50disposal. So, I'm tapping on this
  32. 1:54expert.
  33. 1:57Hey friend, what are the best AI tools
  34. 2:00for English homework? One chat GPT
  35. 2:03that's me one self recommend oneself
  36. 2:07Grammarly Quillbot word tune deepel
  37. 2:10right Google bard what about math
  38. 2:12photomath desmos symbol lab Microsoft
  39. 2:16math solver science wolf from alpha con
  40. 2:19academy buddy labster the pocket lab
  41. 2:23history and social studies perplexity AI
  42. 2:27Google Scholar Chat GPT can't you do
  43. 2:30everything self. Great question. While I
  44. 2:33chat GPT can certainly help with a wide
  45. 2:36variety of tasks, other AI tools often
  46. 2:38specialize in specific tasks that I
  47. 2:41might not handle as perfectly or
  48. 2:42efficiently in certain situations. Some
  49. 2:45AI tools like Photomath or Wolf from
  50. 2:47Alpha are specifically designed to
  51. 2:49handle complex mathematical
  52. 2:51calculations.
  53. 2:54So there's clearly a wealth of AI tools
  54. 2:57that students can tap on for their
  55. 2:59homework. But how much are these tools
  56. 3:02actually being
  57. 3:04used? The results of talking point
  58. 3:07survey are in all of the respondents in
  59. 3:10our survey said that they use AI for
  60. 3:12their homework and 84% of the youngest
  61. 3:16learners, those currently in secondary
  62. 3:18school, use AI for their homework at
  63. 3:20least once a week.
  64. 3:26which is why I've recruited these
  65. 3:28secondary school students. They're
  66. 3:30clueing me in on how deeply AI is
  67. 3:33shaping their grades.
  68. 3:36So, this assignment was to write about a
  69. 3:39time that you regretted. Did you write
  70. 3:41it all yourself? Um, no. So, here was
  71. 3:45mainly where I used AI for. I recall
  72. 3:48cautiously stepping on the wet blade so
  73. 3:50long grass a lot of synonyms and writing
  74. 3:53a more indepth answer beforehand what I
  75. 3:56wrote was I
  76. 3:59stepped onto the
  77. 4:02long muddy grass but I felt like it's
  78. 4:07not the way I wanted to sound so using
  79. 4:09AI I would say make this more in depth
  80. 4:19Yeah, it's definitely more descriptive,
  81. 4:22right? Exactly. Usually, I use AI to
  82. 4:25help generate points for my English
  83. 4:27composition. If I feel I'm really stuck,
  84. 4:30I would just get CHBT to list out some
  85. 4:33ideas just to get the brain juices
  86. 4:35flowing. And how would you do that? So,
  87. 4:37for example, this assignment, people can
  88. 4:40only be happy if they feel they are
  89. 4:42treated fairly. Do you agree? First,
  90. 4:45I'll analyze the question. It's an
  91. 4:48argumentative question. You agree or you
  92. 4:50disagree? So, let's say I agree with the
  93. 4:52question. I'll ask Chad GPT to give me a
  94. 4:57list of reasons that people only feel
  95. 5:03happy when they are treated fairly.
  96. 5:09It seems like you don't write everything
  97. 5:12on your own. But do you feel like
  98. 5:14there's any wrong in using AI for
  99. 5:16homework? No, I do use it for mother
  100. 5:19tang which is Malay. So it's sort of
  101. 5:22similar to how I use for both English
  102. 5:25and geography, but it's how our teacher
  103. 5:28has actually taught us to do it. So So
  104. 5:30your teachers know that you use AI for
  105. 5:33homework? Of course. Yeah, they are
  106. 5:34encouraging us to use AI. So they are
  107. 5:36telling us how to do it and how we
  108. 5:38should go about using it.
  109. 5:42So usually I'll pick out the ones that I
  110. 5:45feel is easiest to elaborate on and then
  111. 5:48write the composition. My English
  112. 5:51teacher, she often encourages us to
  113. 5:54generate ideas for composition, okay?
  114. 5:56And put it in point form because she
  115. 5:59wants us to really think with the points
  116. 6:02that are being generated and then
  117. 6:04elaborate from there. So, it's still
  118. 6:06essentially our own work. How do you use
  119. 6:09AI for your homework? So, I use AI to
  120. 6:13generate answers for my homework when I
  121. 6:15don't really like want to waste my time
  122. 6:17or waste my effort on it.
  123. 6:20Okay. So, we actually do this one, your
  124. 6:22Chinese homework. Yeah. Actually asking
  125. 6:24us to fill in the blanks, which is I
  126. 6:26would say pretty simple, but uh I also
  127. 6:29have a lot of this blanks, which I do
  128. 6:32not want to waste my time on this
  129. 6:34answers.
  130. 6:36Okay. So, it's about efficiency. Which
  131. 6:38which one can we want to do this
  132. 6:40quickly?
  133. 6:41So, we'll screenshot this and then we'll
  134. 6:44put it into chat GBT. Upload the file
  135. 6:46here and then give me answers, please.
  136. 6:50Please. Yes.
  137. 6:54Here are the correct answers to fill in.
  138. 6:56Oh, it knows. So, let's move on to math.
  139. 6:59We have this worksheet right here. I
  140. 7:01find math quite hard. So, like I don't
  141. 7:04even really
  142. 7:06bother. I'm going to take a photo of it
  143. 7:08now. I'm going to send it. Okay.
  144. 7:13So, when you do get your answers, you
  145. 7:15actually put it on. Yeah. Okay. Do your
  146. 7:18teachers know that you use AI for
  147. 7:20homework? Yeah, they they know. They
  148. 7:22know. For Chinese, there was this one
  149. 7:24time a guy like used AI to generate a
  150. 7:27open-ended passage. The answers to the
  151. 7:30question, the teacher was like, you
  152. 7:32know, I can see that this is AI. How do
  153. 7:34they know? There's already like AI
  154. 7:37detectors.
  155. 7:39Are there any rules that the teachers or
  156. 7:41school implement when using AI?
  157. 7:44Actually, they don't give any rules.
  158. 7:47There's no strict rules against it. more
  159. 7:49of just slight discouragement against
  160. 7:52using it entirely for your answers.
  161. 7:54Let's say someone copies from AI
  162. 7:57wholesale. Any instances where someone
  163. 7:59was caught? I've heard of teachers
  164. 8:01trying to take their students response
  165. 8:03and putting it into AI. Hey, was this me
  166. 8:05in AI? But caught, I wouldn't say
  167. 8:07caught. They do give us a heads up. Uh,
  168. 8:10hey, I hope you're not using it to give
  169. 8:12you answers, but using it to help you um
  170. 8:14build on your answers. Our school is not
  171. 8:17really too uptight about it.
  172. 8:21Well, definitely not copying wholesale.
  173. 8:23The teachers will be able to tell. I'll
  174. 8:26say yes because most people they have a
  175. 8:30specific writing style. The teachers can
  176. 8:32definitely notice the discrepancies. Do
  177. 8:35you feel like you learn something by
  178. 8:37using an AI tool? I do feel that I
  179. 8:39learned something because it gives me a
  180. 8:42different perspective which HGP does get
  181. 8:44very good points. I definitely would not
  182. 8:46have thought of before. In terms of
  183. 8:48content, my English compensation marks
  184. 8:51has definitely improved. I'd say I'm
  185. 8:53doing a lot better English. I've come to
  186. 8:57learn to be more descriptive thinking in
  187. 9:00ways I never would have thought of
  188. 9:01before. Do you think you learn anything
  189. 9:03from using AI for your homework? No, not
  190. 9:06really. like it doesn't really help me
  191. 9:09with my studies, but it helps me like
  192. 9:12get it done. Yeah,
  193. 9:16it may not come as a surprise that our
  194. 9:18kids are using AI to help them with
  195. 9:20their
  196. 9:21assignments. But what surprised me is
  197. 9:24that teachers know about it and they do
  198. 9:28let the kids use such tools though they
  199. 9:30advise against relying on it entirely.
  200. 9:34AI tools became more mainstream in the
  201. 9:36last decade. Have our schools developed
  202. 9:39clear protocols for their
  203. 9:41use? Jonathan Sim has been leading the
  204. 9:44charge to embrace proper AI use in
  205. 9:47schools. I have been speaking to some
  206. 9:50secondary school students about their
  207. 9:52use of AI in their homework and I'm
  208. 9:55honestly quite surprised at how much AI
  209. 9:58they use for their work. So I want to
  210. 10:01understand is there any sort of
  211. 10:02guidelines put in place for teachers on
  212. 10:05how they get their students to use AI?
  213. 10:08To my knowledge there isn't any very
  214. 10:10strong clear guidance across the board.
  215. 10:12Part of it has to do with the sentiment
  216. 10:13on the ground with the teachers. It's
  217. 10:15actually a big broad spectrum. Like on
  218. 10:18one end you have some teachers who are
  219. 10:19very excited. They want to encourage
  220. 10:21their students to use AI. On the other
  221. 10:24end of the spectrum you also have some
  222. 10:25who are like don't know how to deal with
  223. 10:27it. Let's just pretend it doesn't exist.
  224. 10:29And then there are some small minority
  225. 10:31who are like ah AI is bad you know and
  226. 10:33they're going on a beach hunt. Yeah.
  227. 10:35What sort of guidance do you think is
  228. 10:37important? Minimally we should make
  229. 10:39clear how much AI should be used. I
  230. 10:42discovered this thing called the AI
  231. 10:43assessment skill. It's done by a couple
  232. 10:45of academics outside of Singapore. It
  233. 10:47helps to clarify all these ambiguities
  234. 10:50and gray areas about AI use. So what
  235. 10:52this does is that we tell the students
  236. 10:54that for this particular assignment how
  237. 10:56much or how little AI you can use. There
  238. 10:58are five levels. At the lowest level, we
  239. 11:00can say no AI. Why? Because we want the
  240. 11:03students to acquire something very very
  241. 11:04basic, something very fundamental. So
  242. 11:06they have to do it themselves. So if the
  243. 11:07AI helps in any way, they're not going
  244. 11:09to learn that. At the second level, we
  245. 11:11have AI assisted idea generation and
  246. 11:14structuring. So we can say, okay, maybe
  247. 11:16you want to write about this thing, but
  248. 11:17oh, you know, you're not too familiar
  249. 11:18with the subject. So we can use this to
  250. 11:20expand your horizons. So this would be
  251. 11:23when the teachers tell the students to
  252. 11:25use AI to brainstorm ideas for their
  253. 11:28composition. Yes, that's right. We tell
  254. 11:30the student, okay, after you have talked
  255. 11:31to the AI to get all these ideas, you
  256. 11:33write the essay, but then you also share
  257. 11:35the conversation that you have with the
  258. 11:37AI so that we can see the evidence. All
  259. 11:39right. The next level that we have is AI
  260. 11:41assisted editing. You know if our focus
  261. 11:43is not on developing grammar but rather
  262. 11:46on writing in a certain style then we
  263. 11:48can say okay you can use the AI to
  264. 11:50assist you in the editing so that you
  265. 11:52can concentrate on uh how do you format
  266. 11:54how do you structure the report. The
  267. 11:56next level is this thing that we call AI
  268. 11:58task completion human evaluation. So
  269. 12:00they use the AI to complete something
  270. 12:02but the main learning objective is to
  271. 12:04exercise the evaluative judgment. How do
  272. 12:06you judge the work? Is it good? Is it
  273. 12:08bad? Where do you want improvements to
  274. 12:10be made? So would this be when they use
  275. 12:13AI to rewrite certain lines so that it's
  276. 12:16more poetic or to expand their
  277. 12:17vocabulary? Yes. So this exercise
  278. 12:19actually helps the students to start to
  279. 12:20develop an eye on what is like good
  280. 12:22communication, good writing, poetry.
  281. 12:24What's what's a touching analogy or
  282. 12:27something that they can use they also
  283. 12:28learn from what the AI is generating.
  284. 12:31That's right. And of course the last
  285. 12:33level is full AI. We can say okay you
  286. 12:36can use any and every AI tool uh at your
  287. 12:38disposal. So you know full creativity
  288. 12:40really just go and have fun with it.
  289. 12:42This will teach them mastery and also to
  290. 12:45develop the eye. What is good AI used to
  291. 12:48put together that wonderful package or
  292. 12:50presentation? Okay. Is this already
  293. 12:52implemented in secondary schools for
  294. 12:54example? Well I know some secondary
  295. 12:56schools that are using it but this is
  296. 12:58not something that's put across the
  297. 12:59board at the moment. Minimally we should
  298. 13:01make clear how much AI should be used
  299. 13:03and we should also be clear with our
  300. 13:06students what they can achieve by doing
  301. 13:08the assignment because one thing AI has
  302. 13:10done is that it has actually taken away
  303. 13:12a lot of the motivation for learning you
  304. 13:13know so what's the point in doing this
  305. 13:15what's the point in learning this right
  306. 13:16I could take the shortcut you know we
  307. 13:18actually met this student who showed us
  308. 13:22how she can very easily just snap and
  309. 13:25upload her assignment to generate
  310. 13:27answers so it feels to me like AI was
  311. 13:31doing her homework for her. She wasn't
  312. 13:33doing any work at all. Did she get
  313. 13:34caught?
  314. 13:36According to her, the teachers can also
  315. 13:39sort of have a sense on whether they
  316. 13:41they do use AI or not. And her teacher
  317. 13:44does run their homework through an AI
  318. 13:46detector. Well, there's no good measure
  319. 13:50that's out there. There are some people
  320. 13:51who say, "Oh, I can look at this piece
  321. 13:53of writing and I can tell who use an
  322. 13:55AI." And there are also, you know, all
  323. 13:57these AI detection tools that claim to
  324. 13:59be 99% accurate, but actually, truth be
  325. 14:02told, uh, they're all very, very
  326. 14:03valuable and prone to mistakes. Don't
  327. 14:05just take it from me. Why don't you
  328. 14:06maybe get an AI written sample and a
  329. 14:08human written sample and put it to the
  330. 14:10test? Okay, challenge accepted.
  331. 14:14[Music]
  332. 14:26[Music]
  333. 14:33I'm putting AI detectors to the sword.
  334. 14:37This is a typical composition question
  335. 14:39for secondary four
  336. 14:43students. I roped in my producer who's
  337. 14:46chilling at home to attempt the question
  338. 14:49with nothing but AI.
  339. 14:54Meanwhile, I'm responding to the same
  340. 14:56question with nothing but my brain
  341. 14:59juice.
  342. 15:03Time to assess our work for AI use.
  343. 15:07All right, Jonathan. Hello. You have our
  344. 15:11compositions. I worked very hard on mine
  345. 15:14while my producer Den didn't do any
  346. 15:17work. He just used AI for his
  347. 15:19completely. He was basically the lazy
  348. 15:21student. Ah, I see. All right. So, let's
  349. 15:24see what you can detect. Okay. So, we're
  350. 15:26going to use two different uh AI
  351. 15:28detectors. They are very popular and
  352. 15:31wellknown. Let's start with the first
  353. 15:32one by Dean. I think it will be quite
  354. 15:35obvious that he used AI. There we go.
  355. 15:3874% here. AI generated. And then if we
  356. 15:41put in through another AI detector,
  357. 15:460% AI. That is a lie. He didn't do
  358. 15:51anything. How is that possible? But
  359. 15:53that's a big difference though. 74 and
  360. 15:550%. That's how unreliable it is. Do you
  361. 15:59want to see how your work comes out?
  362. 16:01Yeah. Yes. Okay. I feel like mine will
  363. 16:03be quite obvious that it's written by a
  364. 16:05human just based on how I wrote it. So,
  365. 16:08we start first with GPT0.
  366. 16:10All right. And it comes up to 100% AI
  367. 16:14generated.
  368. 16:16What? Are you sure you didn't use AI?
  369. 16:19I Jonathan I promise you he saw me write
  370. 16:23it. I promise you I was writing it all
  371. 16:26by myself. I put a lot of work into
  372. 16:28this. Well, let's see how it turns out
  373. 16:29on the the other AI detector.
  374. 16:330%.
  375. 16:36Wait, I'm so confused. Yeah. So, who do
  376. 16:40I trust? So, I think the the biggest
  377. 16:42concern is really trust between the
  378. 16:44teacher and the student. Imagine a
  379. 16:46student writes like us and it gets
  380. 16:48constantly flagged. It's not just one
  381. 16:50teacher saying, "Hey, do you use AI?"
  382. 16:52But let's say five teachers that say,
  383. 16:53"Hey, I think you use AI." That's going
  384. 16:55to affect the student and the students
  385. 16:57motivation to learn. Exactly. It hurts
  386. 17:00your confidence. It doesn't make you
  387. 17:02feel like your effort was appreciated.
  388. 17:05Do teachers understand that these tools
  389. 17:07are unreliable? No. We still have a
  390. 17:09problem where many teachers are still
  391. 17:11asking, "How can we detect? How can we
  392. 17:12detect?" But the the truth of the matter
  393. 17:14is we can't. Okay. So the AI detection
  394. 17:16tools don't work. Does that mean that
  395. 17:19teachers have to try and detect AI
  396. 17:21themselves? One thing that we do as
  397. 17:24educators is we do have a sense maybe
  398. 17:27something is not right like you know the
  399. 17:28the students writing quality uh has been
  400. 17:31like this and then suddenly wow then we
  401. 17:33can have a conversation with the student
  402. 17:35you know and say what led you to write
  403. 17:36it like this but other than that you
  404. 17:38know we very fable. We can't. We can't.
  405. 17:41In fact, if if if you like, I have a
  406. 17:43little uh quiz. I have here three
  407. 17:47writing samples. At least one is written
  408. 17:50by a human and at least one is written
  409. 17:52by an AI. Can you tell?
  410. 17:55I want to say A is written by a human.
  411. 18:00B and C are AI. So, final answer. Drum
  412. 18:05roll. Yes. Drum roll. It turns out that
  413. 18:08A is AI. B is also AI. Okay. C is
  414. 18:15actually written by a human. I am just
  415. 18:18like the platform.
  416. 18:20I am no better. Yeah. Oh, okay. So uh
  417. 18:23rather than than than waste a lot of
  418. 18:25time and effort playing this cat and
  419. 18:27mouse game with all these AI
  420. 18:28advancements, we need to really rethink
  421. 18:31how we engage our students, motivate
  422. 18:33them to want to learn with us and also
  423. 18:36how to use the AI not to replace but to
  424. 18:39enhance the learning process. The
  425. 18:42learning process it has two critical
  426. 18:44components. The
  427. 18:47[Music]
  428. 18:49first formative assessments like
  429. 18:54homework. These are spread throughout a
  430. 18:58period of study to help students learn,
  431. 19:01practice, and master a subject matter.
  432. 19:04The
  433. 19:08second, summitative assessments such as
  434. 19:12exams. These are dished out at the end
  435. 19:15of the period of study to evaluate if a
  436. 19:18student has learned and how
  437. 19:20[Music]
  438. 19:26much. According to this study conducted
  439. 19:29more than a decade ago over the course
  440. 19:31of 15 years, any amount of time a
  441. 19:35student spent on homework would have a
  442. 19:37positive effect on their exam results.
  443. 19:40That was before AI chatbots entered the
  444. 19:42market. Now that students are turning to
  445. 19:45AI to assist with their homework, will
  446. 19:48it affect their
  447. 19:51grades? I'm setting up an experiment.
  448. 19:54These secondary four students are my
  449. 19:57subjects. Step one, a homework
  450. 19:59assignment. I've given them three social
  451. 20:02studies questions designed for secondary
  452. 20:05four students. They need to carry out
  453. 20:07research to craft their answers to the
  454. 20:11questions. They're allowed to use any AI
  455. 20:14tool they want in any way they desire to
  456. 20:17complete the assignment. How's it going?
  457. 20:20It's going good. You are so calm and
  458. 20:22collected. I love it.
  459. 20:26It's the end of step one. How
  460. 20:29challenging did you find the assignment?
  461. 20:31I think it was quite easy. It was all
  462. 20:33right. It was quite easy. Do you
  463. 20:35remember anything that you wrote? Um,
  464. 20:40um, not really. Little bit. What did you
  465. 20:45learn?
  466. 20:48Did you learn anything from doing this
  467. 20:50assignment? I don't remember anything. I
  468. 20:52just wrote.
  469. 20:54Step two, a closed book test to see if
  470. 20:58they retain and apply anything they
  471. 21:00learned from their homework.
  472. 21:04I'm closing the book on my experiment.
  473. 21:07Pens
  474. 21:10down. Now to send these off for
  475. 21:14marking. Helping me grade the papers is
  476. 21:17Leah Tan. She's a specialist in
  477. 21:20humanities for secondary school
  478. 21:22students. All right, let's take a look
  479. 21:24at the results of the experiment. Okay,
  480. 21:28we'll start with the assignment first.
  481. 21:30Let's see how they did.
  482. 21:36[Music]
  483. 21:38Oh, is that it?
  484. 21:42[Music]
  485. 21:49All right, let's take a look at the
  486. 21:51results of the experiment.
  487. 21:56Actually, Wayang and F didn't do very
  488. 22:00well. Ah, okay. But Claire got full
  489. 22:03marks. Full marks. Yes. Wow. Claire,
  490. 22:07what I noticed is that she would also be
  491. 22:09reading understanding. The way that she
  492. 22:11structured her points, she developed her
  493. 22:13ideas. It's very systematic and it's
  494. 22:15very obvious that she exercised
  495. 22:17discernment with regards to how she's
  496. 22:19processing the information. On the other
  497. 22:21hand, we see Wang's work here and you'll
  498. 22:25notice that he didn't fully answer the
  499. 22:27question. So perhaps understanding was
  500. 22:30not perfect. Okay. And for Faith, I
  501. 22:33could see that that she might have felt
  502. 22:35too anxious about the time limit and she
  503. 22:37couldn't deliver. She neglected the
  504. 22:39other two sections. It's interesting
  505. 22:41that you said that their test answers
  506. 22:42were not fully developed because after
  507. 22:44the research assignment, I asked them if
  508. 22:47they learned anything at all and they
  509. 22:49were struggling to remember. It's pretty
  510. 22:52obvious here that ultimately having the
  511. 22:54child use AI with discernment to really
  512. 22:56really understand the information rather
  513. 22:58than just vomiting it out. It's
  514. 23:00important and not have it become a
  515. 23:02crutch in our intellect and in terms of
  516. 23:05our cognitive processes. Yeah,
  517. 23:09I like to know just how AI might
  518. 23:12interact or interfere with our brains
  519. 23:14during homework.
  520. 23:17Lee Lin has spent the past nine years
  521. 23:20studying what might be going on in our
  522. 23:22minds when we are learning students. I'm
  523. 23:26showing him how our three subjects used
  524. 23:29AI for their homework.
  525. 23:31One of the thing that I noticed about
  526. 23:35how the students were using Jenny here
  527. 23:38is that at least Claire seemed to
  528. 23:42demonstrate a little bit more
  529. 23:44intentional thought when she saw all the
  530. 23:47output that was given by Jennai. She
  531. 23:49didn't just take it all. She read
  532. 23:52through and decided on hey this point
  533. 23:54seems to be the most important and asked
  534. 23:57Jai to continue elaborating on a
  535. 23:59particular point. The two students on
  536. 24:02the other hand seem to look at all the
  537. 24:04output and seem to come to the
  538. 24:06conclusion like everything seems to be
  539. 24:08important and just took it as it is and
  540. 24:10elaborated on everything at the same
  541. 24:13time. I think the difference between
  542. 24:14them is demonstrating evaluative
  543. 24:17judgment like Claire seemed to exhibit
  544. 24:20whereas we're two students.
  545. 24:23So why is it important? One of the
  546. 24:25points of education is for us to learn
  547. 24:28to develop this ability to actually
  548. 24:30judge whether work in that particular
  549. 24:33domain is actually good quality work or
  550. 24:36not. That's what we call evaluative
  551. 24:37judgments. Learn how to think with AI
  552. 24:41and not just let AI think for them. This
  553. 24:44is easy to say but it's quite hard to do
  554. 24:46because students are time staffed.
  555. 24:48letting AI think for you uh is the
  556. 24:51easiest pathway of least resistance,
  557. 24:54right? Some of the students said that
  558. 24:57their homework is difficult. So, they're
  559. 24:59using AI to eliminate the hard part.
  560. 25:02That's precisely the point, right?
  561. 25:04Learning is difficult and challenging.
  562. 25:07Psychologists call this whole idea
  563. 25:09productive struggle. Think about our
  564. 25:12brain like a muscle. If you're doing a
  565. 25:17exercise and an exercise uh that is too
  566. 25:20light for you, you're using for example
  567. 25:22the weight of a pencil, you can do lots
  568. 25:25of reps, but that probably not going to
  569. 25:27have much of an effect. What you want is
  570. 25:30to have uh a good amount of weight that
  571. 25:33will cause you to struggle somewhat and
  572. 25:36the right frequency as well. I think one
  573. 25:39of the big issues at this moment of time
  574. 25:41is if the students are just using AI and
  575. 25:44going around this difficulty when they
  576. 25:47do that they're able to produce an
  577. 25:49output that as far as the teacher can
  578. 25:53tell shows that they actually understood
  579. 25:55the material and this is harmful for
  580. 25:57everybody. M the student feels that I
  581. 25:59need to pretend all the time that I know
  582. 26:02right and what happens is now they have
  583. 26:04to go back to relying on AI to produce
  584. 26:07work which then perpetuates this
  585. 26:09illusion and his teacher is also
  586. 26:11operating under an illusion like I'm
  587. 26:13doing such a great job all my students
  588. 26:15are all learning so well at some point
  589. 26:18uh the illusion is going to break right
  590. 26:22and that creates unfortunately huge
  591. 26:24amounts of stress and anxiety for the
  592. 26:27individual student.
  593. 26:34Besides the illusion of learning, some
  594. 26:36AI tools are also known to project the
  595. 26:38illusion of fact. According to an open
  596. 26:42AI technical report released in April
  597. 26:452025, newer models of chat GPT are more
  598. 26:48prone to hallucinations compared to
  599. 26:51older models.
  600. 26:53But just how much will these tools trip
  601. 26:56up on secondary school
  602. 26:58[Music]
  603. 27:02subjects? I'm running them through the
  604. 27:07ringer. All right. So, I'm looking for a
  605. 27:10set of books called 10year series which
  606. 27:12had all the past OLE papers. And this is
  607. 27:15what I used to prep for my O levels.
  608. 27:29Okay, I need to breathe because I'm
  609. 27:30getting a bit of PTSD from being all
  610. 27:33around the 10ear
  611. 27:35[Music]
  612. 27:44series. Okay, I'm ready. Let's go study.
  613. 27:50I'll be feeding questions from these
  614. 27:52books to the top AI tool recommended by
  615. 27:55chat GPT for each subject. Starting with
  616. 27:59chat GPT itself for
  617. 28:11English, math, physics and chemistry
  618. 28:14with
  619. 28:15wolfre and finally history and social
  620. 28:19studies using perplexity.
  621. 28:24We are
  622. 28:25done. Now to find out if putting all
  623. 28:28these questions through a machine will
  624. 28:31give me top
  625. 28:32marks. I've asked these educators to
  626. 28:35assess the quality of my
  627. 28:38work. Well, not quite mine, but they
  628. 28:42don't know that yet.
  629. 28:49[Music]
  630. 28:53I'm about to discover my grades.
  631. 28:59Hi, Una. I'm done with your papers.
  632. 29:01Okay, let's go.
  633. 29:05How did I do for my papers? Let's start
  634. 29:08with math first. It's actually not bad.
  635. 29:11You got 62 out of 90. B3. I got a B3.
  636. 29:16Yep. I used to get an A. So, this is not
  637. 29:20what I expected. So there are many
  638. 29:23careless mistakes. Okay. There are some
  639. 29:25formulas that you have used wrongly.
  640. 29:28This
  641. 29:29one you have got the front part of it
  642. 29:32correct but it's not really written with
  643. 29:36the correct formula and that's why you
  644. 29:40actually derive the wrong answer. I
  645. 29:42think there was a lack of understanding
  646. 29:46how to derive the height of the
  647. 29:48this question you forgot to put a
  648. 29:52negative or positive in front of the
  649. 29:54actual numerical value. Okay. As well as
  650. 29:57you have to show your working. Yeah.
  651. 29:59Because in the exam if you get the right
  652. 30:02answer but you do not have a working
  653. 30:05they can actually mark you wrong for
  654. 30:07that. Okay. All right. So maybe we move
  655. 30:10on to chemistry. How did I do? So you've
  656. 30:13got 45.5 out of 75. So that's a B4. This
  657. 30:18is all wrong. Why is that? This is
  658. 30:22completely wrong. The solutions given uh
  659. 30:25the actual compound is wrong. It did not
  660. 30:28even heat close to the mark. You're
  661. 30:31missing a lot of the key words. So you
  662. 30:34can see this you have to be very
  663. 30:35specific as to how much concentration of
  664. 30:38the acid. Yeah. And for this one you
  665. 30:42have to tell me what kind of energy it
  666. 30:44has to be. And when you talk about
  667. 30:46collisions, you have to describe to me
  668. 30:48how is this collision. Like this part is
  669. 30:51actually missing a lot of details. This
  670. 30:55diagram that you have showed is
  671. 30:57different from the ideal setup. But even
  672. 31:01so, you can see that this part it
  673. 31:04doesn't have a stopper. Okay. Which
  674. 31:06means that the gas that's produced will
  675. 31:08be able to just flow out to the
  676. 31:10atmosphere. And if you look at this
  677. 31:13question, I don't see any working at
  678. 31:15all.
  679. 31:17Yeah. So, let's move on. How did I do
  680. 31:19for my physics?
  681. 31:22[Music]
  682. 31:33[Music]
  683. 31:39How did I do for my physics? NF. Really?
  684. 31:44How how is that possible? So in physics
  685. 31:49again just like in chemistry it is also
  686. 31:52looking out for certain keywords. I
  687. 31:55don't see any of the key words in this
  688. 31:57for the drawing of diagrams. The arrows
  689. 32:01are all pointed wrongly and even the
  690. 32:05working I think the formula used is
  691. 32:09wrong here. Okay, I see a lack of
  692. 32:11working as well. That's a lot of wrong
  693. 32:14answers. Yeah,
  694. 32:16so tell me how did I fare for my
  695. 32:19English? It was a D7.
  696. 32:22[Music]
  697. 32:24That's not too good. Maybe it was
  698. 32:26because you didn't really capture what
  699. 32:29the questions wanted. Okay. History C6
  700. 32:33only. Yeah. Okay. Well, your answers
  701. 32:36were completely perfectly logical,
  702. 32:38right? They didn't capture the idea of
  703. 32:40having cross referencing which is a
  704. 32:43skill that the examiners really want.
  705. 32:46Okay, let's take a look at social
  706. 32:47studies then. What is my grade? social
  707. 32:49studies. Um, unfortunately, it was also
  708. 32:52a C6. Oh, yeah. Once again, for
  709. 32:56questions like these, cross referencing
  710. 32:59is a must. In order to even pass the
  711. 33:01question, we're lacking in concrete
  712. 33:03examples. You need to really elaborate
  713. 33:05and quote. I do have to tell you
  714. 33:07something though. Yes, I used AI for all
  715. 33:11of them.
  716. 33:15Okay. Oh, okay. Was AI
  717. 33:19at all.
  718. 33:22These are the grades that I scored for
  719. 33:23these subjects when I gave AI free
  720. 33:29[Music]
  721. 33:32reign. With AI so prone to mistakes,
  722. 33:36I'll need to look for some remedies and
  723. 33:38safeguards against
  724. 33:41them, which is what Danish Lowski offers
  725. 33:44his students as a generative AI
  726. 33:46lecturer. I scanned a bunch of Olevel
  727. 33:50exam papers into AI tools and I got the
  728. 33:54worst results of my life. How did you
  729. 33:57even use AI to solve any of these
  730. 33:59papers? What did you do? I snapped a
  731. 34:02photo of the questions, uploaded it, and
  732. 34:05then just copied whatever responses were
  733. 34:07generated.
  734. 34:09Okay. So, there's a few things that
  735. 34:11could have gone wrong when you were
  736. 34:12snapping it with your phone. If you were
  737. 34:14a little shaky, uh, a lot of the words,
  738. 34:17the numbers, the diagrams could have
  739. 34:18been very blur. So the AI might not even
  740. 34:20know what it was looking at. Another
  741. 34:22thing is that if you were just telling
  742. 34:23AI to solve it, it didn't expect or know
  743. 34:26that you needed those workings as well.
  744. 34:27It just thought you needed the answer
  745. 34:28and just gave it to you. And the most
  746. 34:30important part, you also didn't kind of
  747. 34:32double check what those answers were
  748. 34:33before copying it over, right? So that's
  749. 34:35also a very important step because AI is
  750. 34:37not perfect. It will definitely
  751. 34:39hallucinate a little bit. So it is a bit
  752. 34:41of our job to make sure that whatever it
  753. 34:43gives we kind of double check or try to
  754. 34:45get it to explain how we got the answer
  755. 34:46so we know that it really can be the
  756. 34:48correct answer. How would I go about
  757. 34:50that then? So one thing we can do is
  758. 34:52instead of trying to scan all these
  759. 34:53things for example this math question is
  760. 34:55just English with the numbers right? We
  761. 34:57can just type this. So we just make sure
  762. 34:58that we got all the numbers correct and
  763. 35:00we don't introduce any mistakes from the
  764. 35:02start. Then we need to be as explicit
  765. 35:04with the instructions as possible
  766. 35:05telling the AI what you need it to do
  767. 35:08and giving it as much information as
  768. 35:09possible. M there are different
  769. 35:11frameworks that all fall under something
  770. 35:13we call prompt engineering. So for math
  771. 35:15questions I adopted the craft framework.
  772. 35:17It stands for context response action
  773. 35:21format and
  774. 35:23target. If we were to look at wolf so
  775. 35:26setting the context for the question I
  776. 35:28actually mentioned that oh this is a
  777. 35:30question from an ole paper. The response
  778. 35:32I'm also asking for is to give me the
  779. 35:35workings step by step and not skipping
  780. 35:37anything. the format. I wanted to number
  781. 35:39each step so I can see the logical flow.
  782. 35:41And so I'm thinking to a spoiler just to
  783. 35:43hide the answers for me so I can try and
  784. 35:44figure it out first before I see the
  785. 35:46final answer. The target I define myself
  786. 35:48as a 16-year-old student because if
  787. 35:50you're explaining this to a college
  788. 35:51level student, you could use even bigger
  789. 35:53words. If you're explaining this to a
  790. 35:54primary level student, right, then you'd
  791. 35:56have to use simpler terms. And of
  792. 35:58course, the action is to solve it and
  793. 36:00then give me uh how those different
  794. 36:02values would look like. And then I can
  795. 36:05go through and then finally see whether
  796. 36:06or not these final answers are correct.
  797. 36:08Right? But I see here in your paper
  798. 36:10those answers are wrong. Those are my
  799. 36:12wrong answers. So if we try this exact
  800. 36:14same prompt to chat GPT. So 911 2733.
  801. 36:19Yeah. This is very important because
  802. 36:21this is how you do crosschecking. Mhm.
  803. 36:23Can we do a diagram? Try out this
  804. 36:25question with the graph. We're
  805. 36:28attempting to use craft again. I'm
  806. 36:30asking it to check with me whether it
  807. 36:32understands the diagram before we
  808. 36:33proceed with actually answering the
  809. 36:34question. Particularly for this question
  810. 36:36because you didn't have it working. We
  811. 36:38are reminding the AI to do that as well.
  812. 36:40Right. So let's give it a go. Now we're
  813. 36:43making sure we understand that the
  814. 36:45connection is correct. We actually have
  815. 36:47to do the work. Yeah. Right. To read the
  816. 36:50graph myself. Okay. So it's attempting
  817. 36:52to think that maybe we'll need to
  818. 36:54calculate the area under the graph. So
  819. 36:55then the final answer would be a to b is
  820. 36:584.94 m. But the answer key is saying
  821. 37:02that the distance over A to B is 8.0 m.
  822. 37:08Is there a reason why your answer is
  823. 37:13different? So it explains why the
  824. 37:16previous answer was
  825. 37:17incorrect. And then here's the final
  826. 37:19working. So we did read a little bit
  827. 37:22off, right? Yeah. It also has challenged
  828. 37:25us on whether we read our own graph
  829. 37:26correctly. Yeah. Which we did not. So
  830. 37:29it's on us. Okay. As a student, you do
  831. 37:32learn. You're part of the process.
  832. 37:34You're not you're not just relying on
  833. 37:36correct the AI chatbot. All right. Let's
  834. 37:39move on to English. Same framework as
  835. 37:41the one we used for math. No, not
  836. 37:43really. So instead, I use trace. It's a
  837. 37:45different framework. Why do we have to
  838. 37:46use trace for English and craft for
  839. 37:48math? It's not that you'd have to use
  840. 37:50any of the frameworks specifically for a
  841. 37:52subject. It's more of like understanding
  842. 37:54which framework would make sense for the
  843. 37:56subject. traced. It adds in that
  844. 37:58diversity and inclusion part, the bias
  845. 38:00checking that we need. You can't really
  846. 38:02be very biased in math, right? Math is
  847. 38:04going to still give you an absolute
  848. 38:05answer at the end of the day. If we're
  849. 38:06choosing something argumentative, we
  850. 38:08have to actually start debating about
  851. 38:09certain points. Yeah. So, we're trying
  852. 38:11to make sure that we don't have any
  853. 38:12biases by accident. How would we
  854. 38:14engineer a prompt for an argumentative
  855. 38:16question? Social media does more harm
  856. 38:18than good, right? Do we agree we have a
  857. 38:20task? The next part would then be the
  858. 38:22request. After that would be the
  859. 38:24constraints.
  860. 38:27So from here we also need to give
  861. 38:28chutity some examples maybe your
  862. 38:30personal opinions. Do you or do you not
  863. 38:32agree? Can you explain a bit why I think
  864. 38:35this actually is work.
  865. 38:38So you see right you actually are doing
  866. 38:40a bit of the work. You are doing a bit
  867. 38:41of the thinking and of course checking
  868. 38:43if there are any gender cultural biases
  869. 38:44before I final output. Okay. Just
  870. 38:46reading it feels like it hit every point
  871. 38:49and I don't even have to get it to write
  872. 38:52the full essay. I can just stop here and
  873. 38:54then write it based off the evidence.
  874. 38:56Ultimately, the students need to be
  875. 38:57motivated to want to even use AI in this
  876. 38:59manner because at the end of the day,
  877. 39:01the AI can only help the student as much
  878. 39:03as the student wants to help themselves.
  879. 39:05Yeah,
  880. 39:07we can teach students how they can
  881. 39:08unlock AI's full potential to enhance
  882. 39:11their learning journey. But we also need
  883. 39:15to steer them away from taking the easy
  884. 39:17way out.
  885. 39:19Previously, Jonathan told me that AI has
  886. 39:22taken away the motivation for learning.
  887. 39:26He's showing me how we can use AI to
  888. 39:28bring it back. How do we make sure that
  889. 39:31instead of just copying and pasting and
  890. 39:33not learning anything from their work,
  891. 39:36the students are actually using skills
  892. 39:39so that they do learn something from it.
  893. 39:41One of the difficulties with learning is
  894. 39:42actually having that motivation. If you
  895. 39:44really want to spark that genuine
  896. 39:46interest, we need them to see the
  897. 39:48connections on things that they care
  898. 39:49about. Chat GPT and the, you know, the
  899. 39:51other AI tools, you don't always have to
  900. 39:53use it as an answer generator. It's a
  901. 39:55way for us to discover connections that,
  902. 39:57you know, previously we found it hard to
  903. 39:59discover. I remember as a student,
  904. 40:01right, I don't understand the point of
  905. 40:02learning simultaneous equations. One
  906. 40:05thing we can do is to say something like
  907. 40:07this in our prompts, you know, as as a
  908. 40:08student, I don't see the point of
  909. 40:10learning simultaneous equations. Uh, I
  910. 40:12love anime and I don't see how these two
  911. 40:14are remotely relevant. Show me why I
  912. 40:17should care and be interested.
  913. 40:21And just like this, you know, the AI can
  914. 40:23actually help me discover connections
  915. 40:25that I may not have seen. Trying to make
  916. 40:28it more relatable. More relatable. Yeah.
  917. 40:30Yeah. One thing that I know many
  918. 40:32teachers are doing here in Singapore is
  919. 40:34uh to to get students excited by
  920. 40:36generating images, make their words come
  921. 40:38alive. For example, the writing class,
  922. 40:40we want the students to use rich
  923. 40:42descriptions to learn more more words.
  924. 40:45We can do something like create an image
  925. 40:47about a cat. A prompt like this isn't
  926. 40:50going to get us very far, right? So, so
  927. 40:52we can encourage the students. Don't
  928. 40:53just say create image about a cat. What
  929. 40:56is the cat doing? What's happening in
  930. 40:58the background? The fluffy ginger cat
  931. 41:01taking a stroll in the the streets of uh
  932. 41:05of Singapore. Okay.
  933. 41:09Oh, hello. So cute. Okay, I can see why
  934. 41:14that is quite exciting. Yeah. So, so, so
  935. 41:16that reaction that you have, right?
  936. 41:18Students also will will have this and
  937. 41:20and it excites them to want to to write
  938. 41:22more. Add more to the scene. Ginger cat
  939. 41:25taking a stroll in the streets of
  940. 41:27Singapore looking for
  941. 41:30food and a home and a home. A Okay.
  942. 41:36All right. And then
  943. 41:41It just
  944. 41:43okay not exactly what I had in mind but
  945. 41:46you this is good this is a a good
  946. 41:48learning opportunity okay notice how
  947. 41:51prom earlier there's
  948. 41:53ambiguity looking for food and a home
  949. 41:57really didn't understand the home thing
  950. 41:58right we didn't give our context clearly
  951. 42:01so what more can I say we get them to
  952. 42:04articulate in this steps right then then
  953. 42:07they become more reflective and
  954. 42:08intentional about what elements go into
  955. 42:10here and not not just leaving to random
  956. 42:12chance. Does it help them retain the
  957. 42:14information, what they see, what they
  958. 42:16write? Yes, because then they're they're
  959. 42:17actually thinking about what goes into
  960. 42:19it and you know that that really
  961. 42:20enriches their communicative abilities,
  962. 42:23their language abilities. We don't have
  963. 42:25to restrict ourselves to only chat GPT.
  964. 42:27There are other tools like uh Google
  965. 42:29notebook LM. As an educator, you can
  966. 42:31prepare resource materials that your
  967. 42:33students can upload. Okay. So, here's a
  968. 42:36sample organic chemistry. Create a new
  969. 42:38notebook, upload sources based on the
  970. 42:40materials that you have. You can make a
  971. 42:42study guide. You can do an FAQ. Yes,
  972. 42:44that's right. See over here, deep dive
  973. 42:46conversation. Oh, yes. Yeah. You can
  974. 42:48generate a podcast with two AI voices
  975. 42:52are talking to each other like an actual
  976. 42:55podcast. Yeah. You can use a customized
  977. 42:57feature to tell the AI to focus on
  978. 42:59specific sections. Ready? 35 minutes.
  979. 43:03You send over that PDF unit of an
  980. 43:05introduction chemistry student
  981. 43:07version.pds, right? And our mission
  982. 43:09today basically is to pull out the
  983. 43:11really important stuff, the interesting
  984. 43:13nuggets from this intro, make it
  985. 43:15understandable, maybe even uh exciting.
  986. 43:19It sounds so real. It's so
  987. 43:21conversational. Yes. Even down to the uh
  988. 43:24and the okay and the like chiming in
  989. 43:27together. Genius
  990. 43:31actually. Again we must always remember
  991. 43:34AI may not be accurate. So one thing we
  992. 43:36can do to challenge the learners is
  993. 43:38don't just accept that this is 100% but
  994. 43:41question is there anything wrong with
  995. 43:43the answers compare the reading and this
  996. 43:46this gets them thinking. It can even be
  997. 43:48an activity where we tell the students
  998. 43:50make songs about what we learned as
  999. 43:51summaries. So not just podcast but music
  1000. 43:54as well. How about like something
  1001. 43:56historical? Okay. Okay. Make yourself
  1002. 43:58about three key takeaways about
  1003. 43:59Singapore's history. Hip hop. Hip-hop.
  1004. 44:02And then recreate Lion City Chronicles.
  1005. 44:06Here's the lyrics.
  1006. 44:08Oh,
  1007. 44:20from the jungle to the hustle.
  1008. 44:23Again, you know, wearing the teacher
  1009. 44:25hat, we can tell the students any issues
  1010. 44:27with the lyrics. How can we make this
  1011. 44:29song more accurate, more precise yet
  1012. 44:31poetic?
  1013. 44:33You're right. Even as I was reading
  1014. 44:35through the lyrics when they said Raffle
  1015. 44:36saw the land and laid the design, like
  1016. 44:38how much was him and how much were, you
  1017. 44:40know, other people. If I were a student
  1018. 44:43and I had these tools, I would want to
  1019. 44:46learn every day. I think even if it's
  1020. 44:48not during school time, I would want to
  1021. 44:50just play around with these tools and
  1022. 44:53see what else I can come up with. It's
  1023. 44:55very exciting to me. But the teacher is
  1024. 44:57the one that that needs to drive it. If
  1025. 44:59the teacher is very passionate about
  1026. 45:01using AI for learning, that passion
  1027. 45:04actually spreads. And as they are
  1028. 45:05learning the subject, they're also
  1029. 45:07learning new AI skills, new AI
  1030. 45:09competencies.
  1031. 45:13It's clear that AI is here to stay. But
  1032. 45:16instead of using AI to replace our
  1033. 45:19brains, we can turn it into a productive
  1034. 45:22study buddy with the following steps.
  1035. 45:24One, don't just blindly snap, upload,
  1036. 45:29copy, and paste. You don't want to end
  1037. 45:31up being fed falsehoods. Two, give
  1038. 45:34yourself space to think for yourself and
  1039. 45:38evaluate the responses that AI
  1040. 45:40generates. Most importantly, make sure
  1041. 45:43to check in with your teachers about how
  1042. 45:45you should be using AI for each homework
  1043. 45:48assignment. That way you'll be growing
  1044. 45:51with AI instead of being left behind by
  1045. 45:54machines.
  1046. 45:59[Music]

About this transcript

This page contains the full transcript of How Students Are Using AI For Homework: But How Good Is ChatGPT At School? | Talking Point by CNA Insider, generated from the public captions YouTube serves with the video. The transcript has 6,964 words across 1,046 segments, with the original timestamps preserved so you can click any line to jump to that moment in the embedded player.

What you can do with it

Use the transcript to take notes, quote the speaker, build a study guide, generate a summary with ChatGPT or Claude via the YouTube Summary tool, or export it as a timed subtitle file with YouTube to SRT. You can also re-open it in the transcriber to translate the transcript into 100+ languages.

Free YouTube transcript tool

YouTube2Text is a free YouTube transcript generator — no signup, no daily limit. Paste any YouTube link and get the full transcript instantly, with timestamps, click-to-jump, translation to 100+ languages, AI prompts for ChatGPT, Claude, and Gemini, and exports to TXT, SRT, VTT, or Markdown.