Replicability . 6/8 Characteristics vs Hallmarks . ميزة القابلية للتكرار Research Methods — Transcript

Full transcript

1. 0:00welcome your honors
2. 0:02this episode discuses replicability
3. 0:05which follows the episode of objectivity
4. 0:11and the next episode will be on generalizability
5. 0:15then what is replicability?
6. 0:19we are again examining if it is hallmark,
7. 0:22value added, or a must a characteristic
8. 0:28pay attention because same books will argue
9. 0:30that all of them are hallmarks
10. 0:31and others will say that they are all characteristics
11. 0:34but here we want to differentiate between them
12. 0:36you are not obliged as a researcher except
13. 0:38to think and consider the suitable for you
14. 0:41that you have to do meaning mandatory
15. 0:44or a hallmark added
16. 0:46here we have an example
17. 0:47let's suppose that the researcher/manager
18. 0:50based on the results of the study, the researcher finished
19. 0:55concludes that the participation
20. 0:59in decision making , the example we are always following
21. 1:03is one of the most important factors
22. 1:05factors here means variables
23. 1:07statically there is a different between factor and variable
24. 1:09but here we will keep it , because we agree on it at the first place that it is a variable
25. 1:13that influences the commitment of employees
26. 1:16of the organization
27. 1:18what does most important remember you of?
28. 1:22does it mean that this is a hypothetical statement which has been examined?
29. 1:25yes, because we have conclude
30. 1:28this is a hypothetical statement that was in the research design
31. 1:31the researcher collect data about it
32. 1:32about participation in decision making and collected data about commitment
33. 1:37and analysed it in the step of analysis
34. 1:40and from this analysis objectively the researcher developed a conclusion
35. 1:43and the conclusion states that it is the most important
36. 1:46then where are the relationships here?
37. 1:48yes, there is in here
38. 1:49it states that participation in decision making does affect
39. 1:53number 2, is there an amount?
40. 1:55no, there is none
41. 1:56we do not see any amount neither of time or money
42. 1:59is there positive /negative ?
43. 2:01no it is not mentioned
44. 2:03but what does it state?
45. 2:04it states the most important for us
46. 2:06and this is just an example, most important meaning this is the significance
47. 2:10how he/she measured it?we will see in episodes related to research design
48. 2:14how we measure being significant or not
49. 2:17it sates that this researcher finished as it this is the researcher number 1
50. 2:23finished his/her research
51. 2:25we will place more faith and credence in these findings and conclusion if similar findings
52. 2:31we will believe in the outcome of the first research more
53. 2:36if similar findings or conclusions emerge on the basis of data
54. 2:40collected by others employing the same method
55. 2:47we will believe in the outcome of the first research if we had similar findings
56. 2:54similar conclusion on the basis of a new data
57. 2:58but from other researchers who applied the same methods
58. 3:03the key words that you should concentrate on
59. 3:06are similar findings, these are the conditions for the replicability
60. 3:11others meaning other researchers
61. 3:18employing the same method
62. 3:22what is this same method?
63. 3:23means t he same research design
64. 3:25that is we have more faith in the findings
65. 3:31of the study if the findings are replicated in another study/studies
66. 3:37replication demonstrates that our hypothetical statements
67. 3:43or hypotheses you may have one hypothesis
68. 3:48have not been supported merely by chance
69. 3:51was not only at the rate of this research
70. 3:54how? but are reflective of the true state of affairs
71. 3:58of the population
72. 3:59what is the thing behind the ideas of affairs and population?
73. 4:03we will get back to it
74. 4:05the results of the tests of hypotheses should be
75. 4:08supported again and yet again when the same type
76. 4:13as if it is the same method
77. 4:15of research is repeated in similar circumstances
78. 4:19and here we do not care if it is hallmark or characteristic
79. 4:24let's understand it better
80. 4:25what are the components of replicability ?
81. 4:27they are similar findings, employing the same method
82. 4:32the first researcher has finished tackling commitment
83. 4:36and he/she found that participation in decision making variable is critical
84. 4:39or most important
85. 4:40and then other research came and nine elements or context
86. 4:44changed
87. 4:45and he/she was asked to make another research about commitment
88. 4:48what will he/she do?
89. 4:50let's look at our graph
90. 4:52here is replicability , and i kept objectivity here
91. 4:57i kept on the above objectivity for us to revise along with the principle of replicability
92. 5:03and i am talking about the second researcher
93. 5:09the second research will start thinking about the problem and apply scientific research
94. 5:14how? he/she should make a problem definition
95. 5:16he/ she in the same company, environment , country or in the same industry
96. 5:22does the same mean exact match?
97. 5:23here we say pay attention
98. 5:25if you as a second researcher felt that you are conducting the same research as another one
99. 5:31and there is a sort of exact match
100. 5:33very similar then just use the same conclusion of the first research
101. 5:38it is not logical for a pharmacist to make a new medicine for each person who feels sick
102. 5:45there is similarity between your research and that of the first researcher
103. 5:48or the patient who came before you
104. 5:50the formula and the context of the treatment
105. 5:54are similar so please just take this conclusion
106. 5:58which is model, concept or whatsoever
107. 6:01the researcher here found that it is not exact , if exact he/she could just apply the conclusion
108. 6:07he/she doubted that there are some differences
109. 6:11i have similarity between them similarity meaning it is not 100% match
110. 6:16which means there is a section calling for difference to certain extent
111. 6:20but not every section will have another variables
112. 6:24even if they are the same variables the relations will differ
113. 6:27there will be different amount, direction
114. 6:30significance is there or not and so on
115. 6:34this similarity invited the researcher to review the literature
116. 6:38when he reviewed the literature , he definitely have read this research
117. 6:42since he/she is doing literature review
118. 6:44but he/she decided to with full awareness to use the same method of the first research
119. 6:57here we have case of similarity
120. 7:01even though 6, 7 , 8 the 9 which are not similar but not in their detailed components
121. 7:06and the researcher found similarity in the literature
122. 7:09and liked the research design done by the first researcher and decided to use it
123. 7:12and definitely the data collected will be new
124. 7:17he/she will collect this D new data
125. 7:21and new analysis
126. 7:24because using the old data as if he/she is revising
127. 7:29but here we are not revising we are making new research in another place
128. 7:31and different circumstances even if the same place
129. 7:34the circumstances changed
130. 7:37time is different by attention one of the 9 elements' components is time
131. 7:42with time there is always a call for new research
132. 7:46but you should prove that there is a reason for that in the problem definition
133. 7:49then he/she will collect new data
134. 7:51applying the principle of objectivity
135. 7:52collecting new data necessitates making analysis of it not for the old data
136. 7:59the expected thing is that the results will be different
137. 8:05why? yes, because we collected new data
138. 8:09and this data will give us a different result
139. 8:13or because there is not a matching 100% there is a similarity
140. 8:20part of the matching that is called similarity
141. 8:2470%, 80% general rating
142. 8:27the weird thing is that the result are the same of the first research
143. 8:36what did the first researcher state?
144. 8:38stated that the participation in decision making is the most important
145. 8:43the second researcher got the same result
146. 8:47let's repeat again
147. 8:49suppose that this is the researcher number three and that on the above represents research
148. 8:53one and two
149. 8:55and he/she was invited to conducted the research about the same company
150. 8:59but the company changed over time
151. 9:02there is a change in the 9 elements
152. 9:03administration management, management , decision making have changed
153. 9:07or its processes
154. 9:09and maybe they have changed the structure of ownership
155. 9:13therefore, the legal status changed
156. 9:17as a research with your scientific experience and readings felt that there is a match
157. 9:25just apply the old solution
158. 9:28that already exists it will be suitable
159. 9:30if you felt that there is not a match just continue
160. 9:33what will i do?
161. 9:34define the problem and show us the similarities and the differences with the previous one
162. 9:40and the difference you are going to wok on
163. 9:41and you will find different or new literature
164. 9:43decide if you are going to do your own design or keep the old design
165. 9:47using the old design this is a decision you ought to show it and say why
166. 9:52and explain it in the research design
167. 9:54if you want to do a new design it is your choice
168. 9:57take this risk it is your right and we support that
169. 9:59but make sure that it is done with a methodological design
170. 10:04if you used the old design , it will not be 100% you will have to add things
171. 10:10according to your application or privacy
172. 10:14collecting new data there should be new analysis
173. 10:17if it is different this is the normal
174. 10:21but not replicability
175. 10:22but what makes it replicable? the sections in red
176. 10:26similarity, this is the third research that found the same thing
177. 10:32what does this mean?
178. 10:33it means that the research design done by the first researcher is replicable
179. 10:38meaning that is subject to repetition and gives the same results
180. 10:44similar to a greater degree
181. 10:46very similar conclusions to the extent that we can call it the same
182. 10:50even if there is a difference in numbers
183. 10:55so we believe that the research of the first researcher is subject to repetition
184. 11:00in the same circumstances
185. 11:02but if it is different? no, this is a different case
186. 11:04and if they are the same i will just use the the first conclusion
187. 11:10or we will be doing separate research for each identical case
188. 11:14and this is not the aim of scientific research
189. 11:17we need to read well scientific research to make sure that you are not reinventing the wheal
190. 11:23and give us solution we already know
191. 11:25then we just consumed energy, time
192. 11:28and wasted effort instead of solving real issues we are in need of
193. 11:33instead we kept researching the already solving issues
194. 11:37which is not recommended
195. 11:40replicability is similar context or problem definition
196. 11:44using the same research design previously within the literature
197. 11:49and then generate the same or similar conclusion
198. 11:54if this happened we will start believing that there is replicability
199. 11:59in the first research
200. 12:01we will not know that till a number of researches
201. 12:04are done they can be hundreds or thousands
202. 12:08we can not say the exact number now
203. 12:11but it is not easy or with few numbers like 1, 2, and 3 then we determine it is replicable
204. 12:15replicable means that there was numerousness in the components of the problem definition
205. 12:23to the extent that you started studying similar companies, industries, countries , in the same context
206. 12:31this way we have to think is replicability characteristic, it is a must ?
207. 12:39are the first, second, third researchers obliged to do it?
208. 12:42was it necessary for the first researcher to do a replicable research?
209. 12:46that can be applied in similar circumstances
210. 12:50or a hallmark , if it is done it is a value added
211. 12:53think about it , we will move to the next episode
212. 12:55at the end we will determine which of the 8 are characteristics and hallmarks
213. 12:59thank you so much