YouTube2Text

Dissertation projects: Introduction to secondary analysis for qualitative and quantitative data — Transcript

by UK DATA SERVICE · 6,925 words · 1,172 segments · language en · Watch on YouTube

Full transcript

  1. 0:00hello welcome to this webinar on reusing
  2. 0:03data for dissertation projects my name
  3. 0:05is maureen haker
  4. 0:07and i've worked with the uk data service
  5. 0:09for about eight years doing everything
  6. 0:11from digitizing data to reuse projects
  7. 0:15and i'm here with ellie bloom who is a
  8. 0:17research associate at university of
  9. 0:19manchester
  10. 0:22all right so what we're going to do
  11. 0:23today
  12. 0:24is we're going to go over what secondary
  13. 0:27analysis is
  14. 0:28look a bit closer at some of those key
  15. 0:30methodological issues of of reuse
  16. 0:32projects for qualitative and for
  17. 0:35quantitative data
  18. 0:36but before we get knee deep in that i
  19. 0:38want to give a very brief overview of
  20. 0:40the uk data service for those of you who
  21. 0:42have not had the pleasure of exploring
  22. 0:44the archive yet
  23. 0:46i've tried to pull in some case studies
  24. 0:48throughout so you can see some of our
  25. 0:49data in action
  26. 0:51and i'll
  27. 0:52and we'll end by signposting you to some
  28. 0:54further resources
  29. 0:57which can help if you're planning a
  30. 0:58reuse project
  31. 1:00this is an introductory workshop so
  32. 1:02we've assumed most of you will probably
  33. 1:05have not used archives before
  34. 1:07um
  35. 1:09and may have only had some introductory
  36. 1:11modules on research methods more
  37. 1:12generally
  38. 1:16and before we get too far along
  39. 1:18i just want to address a simple point
  40. 1:20first
  41. 1:21what is secondary analysis
  42. 1:24in short secondary analysis is a method
  43. 1:26which asks new questions of old data
  44. 1:30it's analyzing data that you've not
  45. 1:32collected yourself
  46. 1:33usually researchers collect far more
  47. 1:36data than they actually need to answer
  48. 1:37their own research questions so think of
  49. 1:40national surveys which collect a lot of
  50. 1:42data on a representative sample
  51. 1:44or qualitative studies which will
  52. 1:46contain interviews that could last for
  53. 1:48one or two hours or sometimes more
  54. 1:51these data sets
  55. 1:53have you know lots of information can
  56. 1:56answer a lot of different questions and
  57. 1:58can be analyzed using different
  58. 2:00techniques so secondary analysis makes
  59. 2:02use of that and does just that it reuses
  60. 2:05data that's been collected by someone
  61. 2:07else
  62. 2:09but there is a complicated nuance here
  63. 2:13you may have heard some other terms used
  64. 2:16to describe this method including
  65. 2:18secondary data analysis or reuse
  66. 2:21projects and they all refer to the exact
  67. 2:24same method so don't get too confused by
  68. 2:26this but there is an ongoing debate
  69. 2:28about how to call this method so in 2007
  70. 2:322007
  71. 2:34libby bishop
  72. 2:37wrote about the primary secondary
  73. 2:39dualism and she basically was making the
  74. 2:41argument that there may be a privileging
  75. 2:44of methods where you go out and collect
  76. 2:45the data yourself
  77. 2:47and using terms like secondary analysis
  78. 2:50or secondary data reinforces that
  79. 2:52hierarchy
  80. 2:54but actually primary and secondary
  81. 2:55analysis are a lot more similar than
  82. 2:57different
  83. 2:59if you fully consider the key
  84. 3:00methodological issues of secondary
  85. 3:02analysis as a method
  86. 3:05consequently you'll find an increase of
  87. 3:07the
  88. 3:08use of the term data reuse
  89. 3:11and that's a term that we'll we'll be
  90. 3:12using throughout the workshop too and
  91. 3:14that takes into account the huge range
  92. 3:17of ways that data can be used and reused
  93. 3:19and it doesn't imply that any of those
  94. 3:21projects are secondary to the initial
  95. 3:23use of data
  96. 3:25you can use whatever term comes to mind
  97. 3:27first but just do be aware that there's
  98. 3:29a few different ways of describing this
  99. 3:31process of reusing data
  100. 3:36so now you know what secondary analysis
  101. 3:38is
  102. 3:39um
  103. 3:40but where would you find data that's
  104. 3:42already been collected
  105. 3:44this is where the uk data service which
  106. 3:46holds the largest collection of social
  107. 3:48science data in the uk comes in
  108. 3:51we are a comprehensive resource that is
  109. 3:54funded by the esrc
  110. 3:57and our main job is to be a single point
  111. 4:00of access to a wide range of secondary
  112. 4:03social science data
  113. 4:05the main purpose then is really the
  114. 4:06collection the ingest and the processing
  115. 4:09of data
  116. 4:10and then further dissemination of that
  117. 4:12data for people to use
  118. 4:14in addition to that data infrastructure
  119. 4:16core we also have a service layer which
  120. 4:19provides extensive support training and
  121. 4:21guidance
  122. 4:23who is it for
  123. 4:25um we like to think that it's for anyone
  124. 4:27who has an interest in data
  125. 4:29traditionally our main audience
  126. 4:32and the people who probably both deposit
  127. 4:34and use our data the most tend to be
  128. 4:36academic researchers and students like
  129. 4:38yourselves
  130. 4:40a lot of other groups are well
  131. 4:41represented as well um this could
  132. 4:44include government analysts charities
  133. 4:46foundations
  134. 4:47businesses research centers think tanks
  135. 4:50all give us and use our data
  136. 4:53given the importance of data and how
  137. 4:56it's used and how it's disseminated we
  138. 4:58try to reach out and support a wide
  139. 5:00range of communities
  140. 5:02what kind of data do we hold i know some
  141. 5:05of this language on this slide might
  142. 5:07might be a bit
  143. 5:08might be a bit a bit specific
  144. 5:11um but it's just to say that you know
  145. 5:14the majority of our data at least
  146. 5:16judging by the number of collections is
  147. 5:18quantitative data so we hold over eight
  148. 5:20thousand collections of which six
  149. 5:22thousand six hundred of them are
  150. 5:24quantitative collections and that
  151. 5:26includes the survey micro data
  152. 5:29um
  153. 5:30aggregate statistics uh international
  154. 5:33macro data census data micro data and we
  155. 5:36do also have
  156. 5:38a a
  157. 5:40fairly large collection of qualitative
  158. 5:42and mixed methods data as well
  159. 5:46where does it come from
  160. 5:48uh that varies depending on the data
  161. 5:50type and some of the sources that you
  162. 5:53see here
  163. 5:54which will include agencies and
  164. 5:56statistical time series those are our
  165. 5:59main sources of quantitative data most
  166. 6:01of our qualitative and mixed method data
  167. 6:04comes through individual academics so
  168. 6:06these might actually be some of your
  169. 6:07tutors
  170. 6:08when they get a research grant they may
  171. 6:10well have deposited the data at the end
  172. 6:12of that grant with us
  173. 6:15and we of course hold some originally
  174. 6:17paper-based public records and
  175. 6:18historical sources
  176. 6:21including things like the census
  177. 6:24where can you find information
  178. 6:27about it well we've got a website uk
  179. 6:29dataservice.ac.uk
  180. 6:31and that holds a lot of information and
  181. 6:33from there you can find our data catalog
  182. 6:36and we have hundreds of pages which also
  183. 6:38discuss methodological issues like
  184. 6:41gaining consent anonymizing data storing
  185. 6:44data
  186. 6:45there's also some student specific
  187. 6:47tutorials like our data skills modules
  188. 6:50we've got some exercises based on
  189. 6:52collections that we hold
  190. 6:54and there's a help page if you have
  191. 6:56specific questions about how to use our
  192. 6:59websites
  193. 7:00okay but getting back to dissertation
  194. 7:03projects
  195. 7:05what kind of research projects can you
  196. 7:07do from reusing data in an archive well
  197. 7:10we really need to go back to the
  198. 7:11beginning to answer this and think about
  199. 7:13the research
  200. 7:14process and you're hopefully familiar
  201. 7:17with this model
  202. 7:18it starts out with some kind of
  203. 7:20you know
  204. 7:21topic or general direction for research
  205. 7:24you then do some background research
  206. 7:26into the literature that's already been
  207. 7:28written on your topic from there
  208. 7:30hopefully you're inspired to ask a
  209. 7:33question which builds on that body of
  210. 7:35research and once you've got that
  211. 7:37research question you then decide the
  212. 7:39best way to answer it and design your
  213. 7:41project
  214. 7:42once you've settled on your method you
  215. 7:44then collect the data you analyze it and
  216. 7:47you begin your write-up which is what
  217. 7:49you would submit for your dissertation
  218. 7:52now you might have
  219. 7:53a few extra steps or you might swap
  220. 7:55around a couple of those steps depending
  221. 7:57on your theoretical foundation but
  222. 8:00generally speaking
  223. 8:01this is how we normally think about the
  224. 8:03research process
  225. 8:05when you're doing a project using
  226. 8:07secondary analysis however this process
  227. 8:09looks different
  228. 8:11this model that you're looking at
  229. 8:12clearly shows how the research question
  230. 8:14is built from your chosen topic area
  231. 8:16your per your preliminary search
  232. 8:19possibly the literature you find
  233. 8:21however with a secondary analysis
  234. 8:24project the research question is derived
  235. 8:27directly from the data
  236. 8:29so you start with a topic you're
  237. 8:31interested in but instead of looking for
  238. 8:33literature
  239. 8:34you look for data and start evaluating
  240. 8:36collections when you find a collection
  241. 8:39that intrigues you you then ask a
  242. 8:41question a research question of that
  243. 8:44data and from there you would then find
  244. 8:47what literature exists on that question
  245. 8:50you then would not need to collect data
  246. 8:53you just need to access it which is of
  247. 8:55course one of the key advantages of
  248. 8:57secondary analysis
  249. 8:59the data is already collected you just
  250. 9:01need to get your hands on it either by
  251. 9:03downloading it from a catalog page or
  252. 9:05you may need to actually go into the
  253. 9:07archive if it's only available in paper
  254. 9:09form
  255. 9:11once you have it you then analyze it and
  256. 9:14write up your dissertation
  257. 9:16so the key point i'm making here around
  258. 9:19reusing data for dissertation projects
  259. 9:22is about where your research question
  260. 9:23comes from
  261. 9:25would take a lot of time and inside
  262. 9:27knowledge about data within archives to
  263. 9:29be able to just come up with a research
  264. 9:32question
  265. 9:33and then search for the perfect data to
  266. 9:34answer it you might be searching for the
  267. 9:37right data for a very long time unless
  268. 9:40as i said before you actually already
  269. 9:42have a good existing knowledge about the
  270. 9:44collections
  271. 9:46for a dissertation project when your
  272. 9:48time and resources are limited you'll
  273. 9:50want to look at the data first
  274. 9:53and then from there develop a research
  275. 9:55question which gives a new take on that
  276. 9:57data
  277. 9:58you can of course do it the other way
  278. 10:00around and spend some time looking for
  279. 10:02the right data
  280. 10:03but for a dissertation project you may
  281. 10:05want to actually look and see what data
  282. 10:08exists first in your general topic area
  283. 10:11before actually nailing down what your
  284. 10:13research question is
  285. 10:17with that being said it's probably
  286. 10:19important to have some kind of idea
  287. 10:21about the kind of project you want to do
  288. 10:25while you might be exploring data
  289. 10:27without a specific question in mind
  290. 10:30you may want to give some thought as to
  291. 10:31the kind of research design your project
  292. 10:33will follow
  293. 10:35so there's four different types of reuse
  294. 10:37projects that can lend themselves well
  295. 10:39to dissertation projects
  296. 10:41and these are re-analysis a replication
  297. 10:44study a comparative study or a re-study
  298. 10:49re-analysis is probably the one that
  299. 10:51comes to mind when thinking about what
  300. 10:54secondary analysis is
  301. 10:56and this involves thinking about the
  302. 10:59wide range of approaches you can take in
  303. 11:01the analysis of a data set
  304. 11:03it usually means asking some kind of
  305. 11:05slightly different research question
  306. 11:07from what the original researchers were
  307. 11:09trying to do so for example
  308. 11:12clive seal and charters black did a
  309. 11:15study using comparative keyword analysis
  310. 11:18of illness narratives
  311. 11:20the original illness narratives had been
  312. 11:22looked at exclusively for health
  313. 11:24research so these were interviews that
  314. 11:26were meant to explore how diagnoses were
  315. 11:28made
  316. 11:29when seal and charter is black came
  317. 11:31along to do the comparative keyword
  318. 11:33analysis they were much more interested
  319. 11:36in the analysis of the discussions
  320. 11:38between patients and doctors rather than
  321. 11:40the actual health issues that came up in
  322. 11:42the interviews
  323. 11:44so the question can be very different in
  324. 11:46that kind of way
  325. 11:48or sometimes
  326. 11:49the question can be on a similar topic
  327. 11:51to the original research but have a
  328. 11:53slightly different focus so for example
  329. 11:56joanna bourneau was looking at
  330. 11:58gerontology as a topic and she found two
  331. 12:01different data sets which looked
  332. 12:02specifically at gerontology
  333. 12:05however bornet's research question was
  334. 12:07on racism
  335. 12:09which wasn't the focus of the original
  336. 12:11work but the data set was rich enough to
  337. 12:14allow her to explore that theme within
  338. 12:16the existing data
  339. 12:19if you want
  340. 12:20um
  341. 12:22to use the exact same analysis strategy
  342. 12:25that would be a replication study
  343. 12:28right now there's a real concern about
  344. 12:30reproducibility of research and
  345. 12:32replication studies can reveal the
  346. 12:34messiness that's involved in working
  347. 12:36through data
  348. 12:37so one of the most famous or
  349. 12:40perhaps really infamous
  350. 12:43examples of replication is from thomas
  351. 12:45herndon who was a postgraduate student
  352. 12:47at university of massachusetts
  353. 12:50and he was assigned an assessment to
  354. 12:52replicate results from a published study
  355. 12:55it's a fairly common exercise if you're
  356. 12:57studying quantitative methods
  357. 12:59so he chose reinhardt rogoff's 2010
  358. 13:02paper growth in the time of debt
  359. 13:05basically
  360. 13:07this paper came up with the proportion
  361. 13:09at which your national debt can be
  362. 13:12of your gdp before you see negative
  363. 13:15economic growth
  364. 13:17so thomas herndon pulled the oecd data
  365. 13:20so that it was using this sort of
  366. 13:22international data so he just pulled the
  367. 13:24same data set
  368. 13:26to re-run their analysis as the paper
  369. 13:28had laid out but he got a completely
  370. 13:30different answer
  371. 13:32the paper
  372. 13:33said that debt cannot exceed 90 of gdp
  373. 13:37however he calculated that the debt can
  374. 13:40actually exceed your gdp and even then
  375. 13:43you only see a minimum impact on growth
  376. 13:48contacting the original investigators
  377. 13:50getting the actual data set that they
  378. 13:53had worked from and not just the
  379. 13:54downloaded data set he found that there
  380. 13:56was actually a flaw where they had
  381. 13:58miscopied some cells
  382. 14:02the full story is published in 2013 in
  383. 14:04the new yorker if you're interested in
  384. 14:05reading some of those details
  385. 14:08a replication study hopefully wouldn't
  386. 14:10always find flaws in this kind of way as
  387. 14:13the original study but nonetheless this
  388. 14:15is a study design that's worth
  389. 14:17considering and can help you develop an
  390. 14:19appreciation for the research process
  391. 14:21and you can even develop a project
  392. 14:23whereby you rerun a series of studies on
  393. 14:25the same topic or perhaps you explore a
  394. 14:28complicated data set with missing data
  395. 14:30transforming variables and so on
  396. 14:34you can also do comparative work so you
  397. 14:36might be looking at an international
  398. 14:38comparison between two countries or
  399. 14:41comparing social subgroups of the
  400. 14:42population based on shared social
  401. 14:45characteristics
  402. 14:48our key data page for quantitative data
  403. 14:50sets outlines some of the large national
  404. 14:52surveys that are held at the archive any
  405. 14:55of which would allow you to do some
  406. 14:56comparative work without having to
  407. 14:58actually collect two sets of data
  408. 15:00so you could compare samples across time
  409. 15:03geographic place gender ethnicity
  410. 15:07these characteristics are usually
  411. 15:08collected as standard for these larger
  412. 15:10surveys
  413. 15:13and the final type of reuse
  414. 15:16i'm going to exemplify with a case study
  415. 15:19that i'm going to walk through with you
  416. 15:22and this this is a re-study and this is
  417. 15:24where you replicate the methods of a
  418. 15:27study for purposes of comparison so it
  419. 15:29does a bit of secondary analysis but it
  420. 15:32also allows you scope
  421. 15:34um
  422. 15:36to actually go out and collect some data
  423. 15:38too
  424. 15:39so this kind of reuse project is from
  425. 15:41the collection school leaver study
  426. 15:44the original study was conducted by ray
  427. 15:47paul in the late 70s as part of a much
  428. 15:50wider community study on the isle of
  429. 15:53and as part of that project uh paul
  430. 15:56asked
  431. 15:57teachers to set a particular type of
  432. 15:59essay just before students were due to
  433. 16:02leave school prompting them to imagine
  434. 16:04they were reaching the end of their life
  435. 16:06and something made them think back to
  436. 16:08the time they left school
  437. 16:09they were then assigned to write a short
  438. 16:11essay of what happened in their life
  439. 16:13over the next 30 to 40 years
  440. 16:16in 2009 graham crowe and don lyon
  441. 16:20and that is graham crow on the left
  442. 16:22there with ray paul on the right
  443. 16:25decided to re-analyze that data set
  444. 16:27focusing solely on student aspirations
  445. 16:31and using the very same methodology they
  446. 16:33conducted a restudy of school leavers
  447. 16:35for students on the isle of sheppy in
  448. 16:382009
  449. 16:40and the prompt supply to students
  450. 16:43in 2009 was nearly the same
  451. 16:46imagine you're at the end of your life
  452. 16:48and reflect back on what you've done
  453. 16:49since leaving school
  454. 16:51they then transcribe those essays and
  455. 16:53compare the themes from that set of
  456. 16:55essays to the set of essays that were
  457. 16:57collected by ray paul in the late 70s
  458. 17:00and you can see the wording of the
  459. 17:01prompt and a small snippet of one essay
  460. 17:03here
  461. 17:04and the findings are fascinating and
  462. 17:07they show the difference of young
  463. 17:08people's aspirations after one
  464. 17:10generation 40 years of time has passed
  465. 17:15but how exactly were they different
  466. 17:18in 1978 students expected much more
  467. 17:21grounded and arguably mundane sorts of
  468. 17:24jobs
  469. 17:25career progression was gradual and it
  470. 17:27followed on from hard work
  471. 17:29and sometimes there were talks of
  472. 17:31periods of unemployment or even death
  473. 17:33and you can see a few examples in the
  474. 17:35left column of some of the quotations
  475. 17:37from those essays such as the one on the
  476. 17:39bottom
  477. 17:40i longed for something exciting and
  478. 17:42challenging but yet again i had to
  479. 17:44settle for second best i began working
  480. 17:46in a large close factory
  481. 17:502009 2010 however showed students
  482. 17:54imagining well-paid and instantaneous
  483. 17:56jobs filled with choice but also a lot
  484. 17:59of uncertainty
  485. 18:00crowe and his research team also noted a
  486. 18:03clear influence of celebrity culture in
  487. 18:05those essays so for example you have the
  488. 18:07quote on the bottom of a girl who writes
  489. 18:10in my future i want to become either a
  490. 18:12dance teacher a hairdresser
  491. 18:14or a professional show jumper horse
  492. 18:16rider if i do become a dancer my dream
  493. 18:19would be to dance for beyonce or someone
  494. 18:21really famous
  495. 18:25this study is a larger one than what
  496. 18:27might be realistic for a dissertation
  497. 18:29project but the goal was to engage the
  498. 18:31community alongside the research and
  499. 18:33find
  500. 18:34innovative ways of including
  501. 18:36participants in the research outputs
  502. 18:38and as part of this initiative they
  503. 18:40publish the living and working on cheppy
  504. 18:42website
  505. 18:43which helps to create a shared history
  506. 18:45and memory of what living on the isle of
  507. 18:47chevy means among the community
  508. 18:51so this is quite an ambitious project
  509. 18:53for a dissertation but it's a good
  510. 18:55example of how you can combine a bit of
  511. 18:58data collection and a bit of data reuse
  512. 19:00into one project
  513. 19:02and certainly for those who might be
  514. 19:04doing phd work in future this is
  515. 19:06something that you might actually want
  516. 19:07to consider for one of your projects and
  517. 19:10for others you can design a more
  518. 19:12feasible study with a smaller sample
  519. 19:14and smaller outputs
  520. 19:18so hopefully you are now budding with
  521. 19:20ideas on what you might want to look for
  522. 19:23in the archives or what kind of projects
  523. 19:25that you might want to do reusing data
  524. 19:28and since you're not collecting data
  525. 19:30yourself you'll find that reuse projects
  526. 19:32have very few ethical considerations
  527. 19:34comparatively
  528. 19:36and hopefully you wouldn't hit too many
  529. 19:38snags with ethical review boards
  530. 19:40however
  531. 19:41this doesn't mean that there aren't any
  532. 19:43ethical considerations so there's two
  533. 19:46key points that i want to make before
  534. 19:48diving into qualitative
  535. 19:50and quantitative data so
  536. 19:52first of these starts at the point of
  537. 19:54access
  538. 19:56how do you get permission to use the
  539. 19:57data
  540. 19:58so if you're reusing data that's in an
  541. 20:01established archive like the uk data
  542. 20:03service we've taken a lot of pain out of
  543. 20:06access by negotiating licensing issues
  544. 20:08with the person who collected the data
  545. 20:10so this means that you have to sign
  546. 20:13what's called our end user license and
  547. 20:15this is a really exciting legal document
  548. 20:18which you can see on the left there and
  549. 20:20it lists just these terms of conditions
  550. 20:23things that
  551. 20:24you need to do or that you need to
  552. 20:26consider when you're reusing the data
  553. 20:28and there's two really important things
  554. 20:30that i want to stress here
  555. 20:32the first of these is that there's no
  556. 20:34onward sharing of data and that includes
  557. 20:37with your supervisor so if you need help
  558. 20:40with your analysis and your supervisor
  559. 20:42needs to see the data then he or she
  560. 20:44will need to register and download the
  561. 20:46data for themselves the end user license
  562. 20:49stipulates that you cannot under any
  563. 20:51circumstance share your data or your
  564. 20:54login details with anyone
  565. 20:58all of the data that we have has been
  566. 21:00anonymized
  567. 21:02which is again likely to be the the case
  568. 21:04if you're reusing data from an archive
  569. 21:07however just because it's anonymized
  570. 21:09doesn't mean that it's completely
  571. 21:10impossible to figure out identities of
  572. 21:12participants
  573. 21:14mark elliott has some really excellent
  574. 21:16youtube tutorials which go through
  575. 21:18anonymization theory but in short he
  576. 21:21makes the argument that no anonymization
  577. 21:23strategy will be 100 effective at all
  578. 21:26times
  579. 21:27consequently
  580. 21:28should you inadvertently uncover
  581. 21:31identities of any of the participants
  582. 21:34then this end user license says that you
  583. 21:37will not reveal that identity to anyone
  584. 21:41so those are the key issues to recognize
  585. 21:43when signing the end user license
  586. 21:47so the second point i want to make once
  587. 21:49you have sorted out the access
  588. 21:52you then need to ensure you cite the
  589. 21:53data
  590. 21:54so in short citing archive data helps
  591. 21:57data creators track the impact of their
  592. 22:00study it also supports reproducibility
  593. 22:02and it makes it easier to find the data
  594. 22:04that you used for your project
  595. 22:06and the issue is so important that the
  596. 22:08uk data service has a page on our
  597. 22:10website which goes into a little bit
  598. 22:12more detail about data citation and will
  599. 22:15help you explain why this is an
  600. 22:17important ethical issue
  601. 22:20with the uk data service
  602. 22:22we make this easy again by supplying you
  603. 22:25with the citation that you need on our
  604. 22:27catalog pages
  605. 22:29this citation you'll see underneath the
  606. 22:31box citation and copyright
  607. 22:34on our catalog page and then
  608. 22:36you just need to select what kind of
  609. 22:38citation format you want and you can
  610. 22:40just copy and paste that citation into
  611. 22:43your reference list
  612. 22:46so you've got access you've sorted out
  613. 22:49citation now comes actually doing the
  614. 22:52secondary analysis so first i'll walk
  615. 22:54you through qualitative data and a
  616. 22:56couple of key issues with getting
  617. 22:58started with qual data and then i'll
  618. 23:00pass over to ali who's going to talk
  619. 23:02about quantitative data
  620. 23:04so first i'll talk about reorienting
  621. 23:06yourself to the collection
  622. 23:09recontextualizing that data
  623. 23:11and finally just a couple of points
  624. 23:13about sampling
  625. 23:15so when you first download a data set
  626. 23:18you'll get a zipped folder which looks a
  627. 23:19bit like this
  628. 23:21we've got some folders that are stuffed
  629. 23:22with files
  630. 23:24and most qualitative data is held in the
  631. 23:27folder called rtf rtf is it is a type of
  632. 23:30word document
  633. 23:32so to get to the data you just need to
  634. 23:33go into the rtf folder
  635. 23:37and this folder when you open it will
  636. 23:39look like this
  637. 23:42there's all your data nicely organized
  638. 23:45and clicking on one of those files would
  639. 23:47open up something that looks maybe
  640. 23:49something like this
  641. 23:52and this is this is a snippet of the
  642. 23:54school leavers essays
  643. 23:55um you know what it would look like more
  644. 23:58in its uh entirety and that collection
  645. 24:01contains over 100 of those files but the
  646. 24:04files don't have to just be essays or
  647. 24:06interview transcripts
  648. 24:08you might have for example
  649. 24:10pdfs of handwritten notes like in the
  650. 24:13upper left hand corner or you might have
  651. 24:15ethnographic notes like those on the
  652. 24:17right or some collections might also
  653. 24:19have images or videos like those in the
  654. 24:21lower left hand corner
  655. 24:24more than likely
  656. 24:26you'll end up opening up
  657. 24:28interview transcripts like the one
  658. 24:30that's seen here you should have clear
  659. 24:33turn taking uh in speaker tag so you you
  660. 24:36know who's talking
  661. 24:38um
  662. 24:39and there's you know just a lot of
  663. 24:41different types of data available so
  664. 24:42have a good look through that collection
  665. 24:44first and see what's actually in there
  666. 24:48the next thing you need to do is to
  667. 24:50orient yourself to the project and i
  668. 24:52think the main point to make here
  669. 24:54is to not underestimate the amount of
  670. 24:56time that it would take to get
  671. 24:57acquainted with the data set there might
  672. 24:59be multiple levels of context to get
  673. 25:01through in order to really understand
  674. 25:03the data
  675. 25:04and what i mean by that is you
  676. 25:06you need more than just data collected
  677. 25:09at the time of the interview
  678. 25:11or whatever the data collection is but
  679. 25:14you might also need to consider basic
  680. 25:16social characteristics of the
  681. 25:17participant or the historical time
  682. 25:20period in which the data was collected
  683. 25:22or perhaps where the data was collected
  684. 25:25so the idea is that you need to
  685. 25:27understand the data set as a whole
  686. 25:29in order to really get at the root of
  687. 25:31what it can convey
  688. 25:34every collection that is archived at the
  689. 25:36uk data service
  690. 25:39will hold some documentation
  691. 25:41which is a really useful starting point
  692. 25:43for doing this
  693. 25:44and that might contain information about
  694. 25:46the methodology such as an interview
  695. 25:48schedule or a call for participants or
  696. 25:51sometimes it includes segments from
  697. 25:53publications that were arising from the
  698. 25:55original study or it might even have
  699. 25:57something like funding applications
  700. 26:00and for qualitative data sets this
  701. 26:02documentation is called the user guide
  702. 26:04or the u guide
  703. 26:06and here's an example
  704. 26:08of a user guide this one happens to have
  705. 26:09an interview guide for interviewers
  706. 26:12but there's also a consent form a sample
  707. 26:14profile and so on it's just further
  708. 26:17background information to help you
  709. 26:18understand how the data was collected
  710. 26:23but what if you want to know more about
  711. 26:24the participants themselves
  712. 26:27every qualitative study also have uh it
  713. 26:30has what's called a data listing or a
  714. 26:33new list
  715. 26:35and here's an example of one of these
  716. 26:38and it's a
  717. 26:39table that gives a brief overview of the
  718. 26:41data in the collection
  719. 26:42so each row
  720. 26:44represents a piece of data or a
  721. 26:46participant and each column lists some
  722. 26:49kind of characteristic or attribute of
  723. 26:51that interview so it's a quick way of
  724. 26:54getting to know who took part in the
  725. 26:55study
  726. 26:56basically
  727. 27:00in addition to the context
  728. 27:04of the data you may also need to
  729. 27:06consider the sample
  730. 27:07so for example if the data set is too
  731. 27:09large you may need to take a sub sample
  732. 27:12qualitative collections tend to be
  733. 27:14smaller anyways but many of the archive
  734. 27:16data sets are funded and they can
  735. 27:18collect a considerable amount of data
  736. 27:21for a small dissertation project you'll
  737. 27:23want to be realistic and decide if you
  738. 27:25need to limit the number of participants
  739. 27:27to a smaller sub-sample of those
  740. 27:30you know
  741. 27:31of those that took part within the
  742. 27:33larger collection
  743. 27:34so for example the edwardians collection
  744. 27:37which was put together by paul thompson
  745. 27:40and it's largely considered to be the
  746. 27:42first oral history of britain
  747. 27:44contains
  748. 27:45453 80 plus page interviews it's a huge
  749. 27:50collection
  750. 27:51conversely most dissertation projects
  751. 27:54probably have an expectation of
  752. 27:56you know six to ten interviews
  753. 27:59so you'd want a clear sampling strategy
  754. 28:01to help you choose which of those
  755. 28:03interviews you want to look at
  756. 28:05or you might be interested in a
  757. 28:07particular subgroup of the population so
  758. 28:09again you'd want to think about what
  759. 28:11criteria you're looking for
  760. 28:14you might also want to combine different
  761. 28:16data collections that complement each
  762. 28:18other
  763. 28:19and remember it takes time to sift
  764. 28:21through and find the pieces of different
  765. 28:23data sets to pull together but it's
  766. 28:25another possibility if you feel that all
  767. 28:28of the data speaks to the same topic and
  768. 28:30research question and you've done the
  769. 28:32work of recontextualizing
  770. 28:34to ensure that the interviews work
  771. 28:36together then there's no reason why you
  772. 28:38can't combine some of those and create
  773. 28:41your own custom data set
  774. 28:44so that is it for
  775. 28:46um qualitative i'm gonna pass over to
  776. 28:49ali now so just uh bear with me for a
  777. 28:51moment while we
  778. 28:53um
  779. 28:54yes thank you i'm just gonna switch
  780. 28:56screens um
  781. 28:59okay perfect you should all be able to
  782. 29:01see that so thanks maureen um as maureen
  783. 29:03said i'm going to give a quick rundown
  784. 29:05of the key methodological things you
  785. 29:07need to consider if you are using um
  786. 29:09quantitative secondary analysis or doing
  787. 29:12a quantitative reuse project
  788. 29:14so um i'm going to cover two main areas
  789. 29:18first the things you need to think about
  790. 29:20when you're selecting your data and
  791. 29:22secondly the things you might need to
  792. 29:23think about when you're understanding or
  793. 29:25getting to know your data
  794. 29:28so the first section is on selecting
  795. 29:30your data
  796. 29:32so some of you might already know which
  797. 29:34topic area that you want to look at or
  798. 29:36explore for your dissertation but if not
  799. 29:39i'm just going to give you a brief idea
  800. 29:40of some of the data available
  801. 29:42so the uk data service holds
  802. 29:44quantitative data on a variety of topics
  803. 29:47and if you attended jen's webinar
  804. 29:48yesterday you might know a little bit
  805. 29:50more about them but just to give you an
  806. 29:52idea now there's quantitative data
  807. 29:55available that could allow you to look
  808. 29:56at the environment
  809. 29:59workforce patterns
  810. 30:01health care
  811. 30:02family spending
  812. 30:04attitudes to the police and criminal
  813. 30:06justice system time use during the
  814. 30:09pandemic
  815. 30:10attitudes
  816. 30:12and political opinions and these are
  817. 30:13just a few examples there are many many
  818. 30:15more topics covered
  819. 30:18so once you have a general idea of your
  820. 30:20topic area you can think about the data
  821. 30:22you might use to explore it and the key
  822. 30:25thing for a quantitative reuse project
  823. 30:27is to understand what you are trying to
  824. 30:28measure so think about your topic
  825. 30:30questions topical questions think about
  826. 30:33your key concepts and importantly think
  827. 30:36about how these relate to the variables
  828. 30:38within a data set
  829. 30:41so for example let's say we were
  830. 30:43interested in looking at the
  831. 30:44relationship between fear of crime and
  832. 30:46age
  833. 30:47so we need to find some data that has
  834. 30:49variables that measure these concepts so
  835. 30:51our key concepts fear of crime and age
  836. 30:54that will allow us to formulate and or
  837. 30:56answer a research question about them
  838. 30:59now as maureen said earlier it may not
  839. 31:00be possible to find the perfect data set
  840. 31:03and you could spend a lot of time
  841. 31:04searching so instead you could start
  842. 31:06from data on a general topic and derive
  843. 31:08your key concepts and questions from the
  844. 31:10existing variables once you've gotten to
  845. 31:12know the data
  846. 31:14if you do have a question in mind
  847. 31:15already that's fine too
  848. 31:17but you may just have to be flexible and
  849. 31:19revise it based on the data and the
  850. 31:20variables that are available
  851. 31:24so if you're looking for data on a
  852. 31:26particular key topic there's a few key
  853. 31:28places you can start
  854. 31:30so you can use the theme pages on the uk
  855. 31:32data service website to look for key
  856. 31:34data sets on a particular theme
  857. 31:36you can type keywords you're interested
  858. 31:38in into the data catalog
  859. 31:41or you might want to search the variable
  860. 31:42and question bank for variables on a
  861. 31:44particular topic but please be aware
  862. 31:46that this hasn't been updated for a
  863. 31:48little bit so it might not encapsulate
  864. 31:50all the current variables
  865. 31:52you could also search hasit which is the
  866. 31:55social sciences thesaurus which lets you
  867. 31:57search data sets by key concepts
  868. 32:00and the link to all of these can be
  869. 32:01found on the find data section of the
  870. 32:03website and we will have a little
  871. 32:05practice of this in the practical as
  872. 32:07well
  873. 32:10so once you have found a data set that
  874. 32:12you think might be suitable you need to
  875. 32:13consult the catalog page
  876. 32:15and this will give you an overview of
  877. 32:17the key topics background and a brief
  878. 32:20overview of the methodology
  879. 32:22and you can also access the
  880. 32:23documentation from here including any
  881. 32:25user guides technical reports lists of
  882. 32:28the variables and any notes added by the
  883. 32:30data producers to highlight any changes
  884. 32:33re-weighting or editing to variables
  885. 32:35that might have been made since the data
  886. 32:37was first deposited
  887. 32:39and as maureen said the documentation is
  888. 32:42really
  889. 32:46importantly the list of variables can
  890. 32:48also usually be found what can be found
  891. 32:50in the documentation and this is usually
  892. 32:52in the user guide the variable list or
  893. 32:54the code book or data dictionary and
  894. 32:56this might vary between data sets
  895. 32:59and here you can find important
  896. 33:00information on what the variables
  897. 33:02measure which is how you will help
  898. 33:04relate them to your key concepts
  899. 33:08so back to our example that we were
  900. 33:09looking at earlier we might choose to
  901. 33:11look at the crime survey for england and
  902. 33:13wales
  903. 33:14it's a large important crime survey and
  904. 33:16it's a source of information about crime
  905. 33:18that is independent from police records
  906. 33:21it is an example of a repeated
  907. 33:23cross-sectional survey
  908. 33:25don't worry if you don't recognize all
  909. 33:26these terms we'll go into them a bit
  910. 33:27more in a bit
  911. 33:29it's a survey that's conducted every
  912. 33:31year and it has a large sample size of
  913. 33:3435 000 individuals aged 16 plus and 3
  914. 33:37000 age 10 to 15.
  915. 33:40so from having a look in the
  916. 33:42documentation i can see that the crime
  917. 33:44survey for england and wales has two
  918. 33:46variables which fit our key concepts so
  919. 33:48the first of these is qualify which is
  920. 33:51how much is your own quality of life
  921. 33:52affected by fear of crime on a scale
  922. 33:55from one to ten where one is no effect
  923. 33:57and ten is a total effect on your
  924. 33:58quality of life
  925. 34:01and the next is age the respondents age
  926. 34:05so once you've found your variables and
  927. 34:07it might take you a while looking
  928. 34:09through the documentation looking
  929. 34:10through the different information to
  930. 34:12find the ones that are relevant the
  931. 34:14important step is to think critically
  932. 34:16about what they measure this is
  933. 34:18particularly important for um
  934. 34:21reuse projects because you're not asking
  935. 34:23the questions um
  936. 34:25yourselves
  937. 34:26so you really need to think about what
  938. 34:28your variables um measure so for example
  939. 34:30this quality life one this call life one
  940. 34:33does it really measure fear of crime or
  941. 34:35does it perhaps instead measure how much
  942. 34:37fear of crime affects life
  943. 34:39so you need to think about what the
  944. 34:41question is really asking and to
  945. 34:43understand this you can look at the
  946. 34:44original questionnaire which can usually
  947. 34:46be found in the documentation
  948. 34:50so as well as considering your variables
  949. 34:53and your concepts you also might want to
  950. 34:55consider the kind of
  951. 34:58analysis that you want to do or that you
  952. 35:00can do with the data so for example if
  953. 35:03you were interested in looking at
  954. 35:04individuals in a particular time point
  955. 35:06you might want to use a cross-sectional
  956. 35:08survey
  957. 35:10if you want to look at
  958. 35:12data across multiple points in time you
  959. 35:14might want to use a repeated
  960. 35:16cross-sectional survey so that's like
  961. 35:17the crime survey that we were looking at
  962. 35:20if you are interested in
  963. 35:23data over a long period of time you
  964. 35:25might look at longitudinal data
  965. 35:28if you're interested in small geographic
  966. 35:30areas you could use the census aggregate
  967. 35:32data or flow data
  968. 35:33and if you want to compare countries
  969. 35:35over time you can use international time
  970. 35:37series data and you can search by all
  971. 35:39these different data types on the uk
  972. 35:41data service website
  973. 35:46so as well as this it's also important
  974. 35:49to think about your population so that's
  975. 35:51the group you want to measure
  976. 35:53so for example this might be the
  977. 35:54population of the world the uk or
  978. 35:57perhaps you want to ask questions about
  979. 35:59a particular city or local authority
  980. 36:01area
  981. 36:03and as well as this you need to consider
  982. 36:05your unit of analysis
  983. 36:07are you interested in individual people
  984. 36:09or are you interested in whole
  985. 36:11households and this will affect the data
  986. 36:13you use in the kind of analysis you can
  987. 36:15do in the questions you can ask as some
  988. 36:17data sets are only available for
  989. 36:18particular geographies or for certain
  990. 36:20units
  991. 36:23so finally it's important to remember
  992. 36:25that the process isn't linear you may
  993. 36:27need to go back and forth and realign
  994. 36:29your question with the available data
  995. 36:31you might need to compromise if the
  996. 36:33perfect data set isn't available
  997. 36:35or choose different variables and refine
  998. 36:37your question and this is all part as
  999. 36:39lauren said earlier of doing secondary
  1000. 36:41or analysis or a reuse project
  1001. 36:45so once you've chosen your data set
  1002. 36:47there are a few final things you need to
  1003. 36:49consider
  1004. 36:52so as we said the documentation usually
  1005. 36:54contains information on the variables
  1006. 36:56but it should also have information on
  1007. 36:58the questionnaire used to collect the
  1008. 37:00data
  1009. 37:02using data and to understand your
  1010. 37:04variables it's really important to
  1011. 37:06understand the questionnaire and
  1012. 37:07something that's really particularly
  1013. 37:09important is the routing and that's who
  1014. 37:11was asked which questions
  1015. 37:14and this is because many questionnaires
  1016. 37:15use something called computer-aided
  1017. 37:17interviewing which sends respondents
  1018. 37:19through the questionnaire by different
  1019. 37:20routes depending on their previous
  1020. 37:22answers
  1021. 37:23so therefore many questions in a survey
  1022. 37:25may only be applicable to some of the
  1023. 37:27samples so it's always a good idea to
  1024. 37:29check the documentation to see who was
  1025. 37:31asked about the variables that you're
  1026. 37:32interested in
  1027. 37:35so for example
  1028. 37:36this is a variable called flex 10 from
  1029. 37:38the labor force survey which relates to
  1030. 37:40special working arrangements
  1031. 37:42uh in this catalogue in this
  1032. 37:44documentation entry you can see the
  1033. 37:46exact wording of the question
  1034. 37:47as well as a range of answers and how
  1035. 37:49they're coded and importantly underneath
  1036. 37:52this we can see that the question was
  1037. 37:54asked if a respondent is in work and it
  1038. 37:56also gives information on the variables
  1039. 37:58used to identify who was in work
  1040. 38:01and you'll find that the documentation
  1041. 38:03looks a bit different across different
  1042. 38:04data sets but this gives you a general
  1043. 38:06idea of the kind of thing to expect
  1044. 38:10as well as this you can also find
  1045. 38:12information about how the data was
  1046. 38:14processed after collection
  1047. 38:16so important thing to consider are the
  1048. 38:18derived variables and these are
  1049. 38:19variables created from the raw data
  1050. 38:24the derived variable
  1051. 38:26so this shows how the flex 10 variables
  1052. 38:29which we talked about on the last slide
  1053. 38:30have been used to derive a new variable
  1054. 38:33called flex w7
  1055. 38:35and to those who responded seven on the
  1056. 38:37flex 10 variable indicating they had a
  1057. 38:39zero hours contract and now coded as one
  1058. 38:42on the new flex w7 variable and
  1059. 38:44therefore it's a new variable which
  1060. 38:46measures whether someone has a zero
  1061. 38:47hours contract or not now don't worry if
  1062. 38:49this looks a bit complicated it can take
  1063. 38:51a while to get your head around the
  1064. 38:52documentation but if you are using a
  1065. 38:54derived variable it's really important
  1066. 38:56and you understand this
  1067. 38:58and just to say that not all
  1068. 38:59documentation contains these diagrams in
  1069. 39:02some surveys it might just be the spss
  1070. 39:05or status syntax which show you how the
  1071. 39:07variable variable's been derived but
  1072. 39:09although it looks complicated if you
  1073. 39:11take a bit of time you should be able to
  1074. 39:12get your head around it and understand
  1075. 39:14where the derived variables have come
  1076. 39:15from
  1077. 39:17the final thing you need to think about
  1078. 39:19as with qualitative analysis is sampling
  1079. 39:22so surveys and similar quantitative data
  1080. 39:24sources are almost always based on
  1081. 39:26samples
  1082. 39:28and one important question you need to
  1083. 39:30ask is is your sample representative
  1084. 39:33so you need to know
  1085. 39:35who is included in the sample
  1086. 39:37is it adults is it only those who live
  1087. 39:39in private addresses is it only those
  1088. 39:42who attend school
  1089. 39:45who was the what was the response rate
  1090. 39:47and is there any information about
  1091. 39:49different response across the population
  1092. 39:51and this will tell you potential bias
  1093. 39:55and you also need to know do you need to
  1094. 39:57apply a weight to make the data
  1095. 39:58representative
  1096. 40:00and you'll once again find all this
  1097. 40:01information in the documentation that
  1098. 40:03comes along with the data so in the user
  1099. 40:05guides and the technical reports
  1100. 40:08finally you need to think about whether
  1101. 40:10you have enough cases to make a precise
  1102. 40:12estimate
  1103. 40:13so for example the crime survey for
  1104. 40:15england and wales which we looked at had
  1105. 40:16a very large sample size which should
  1106. 40:18allow you to make precise estimates
  1107. 40:21however with smaller samples an analysis
  1108. 40:24of smaller sub-populations so for
  1109. 40:26example say you're cutting your data set
  1110. 40:27down to study only a particular group of
  1111. 40:30people
  1112. 40:31you might not have enough cases in your
  1113. 40:32sample to make precise estimates
  1114. 40:35now i've just given a very brief
  1115. 40:37overview of sampling considerations
  1116. 40:39and there are more resources available
  1117. 40:41on the uk data service website so we
  1118. 40:43have a guide on survey weights and
  1119. 40:45complex sampling so do look those up
  1120. 40:47when you come to that part of your
  1121. 40:49dissertation to help you understand
  1122. 40:50those more
  1123. 40:52so finally just to summarize for uh
  1124. 40:54quantitative projects you need to think
  1125. 40:56about your key concepts what you're
  1126. 40:58trying to measure and how these relate
  1127. 41:00to the variables in a day
  1128. 41:02important that you check the catalog and
  1129. 41:04the documentation to help you understand
  1130. 41:06your data and the variables and where
  1131. 41:07they came from and you need to consider
  1132. 41:09issues to do with sampling
  1133. 41:14okay so maureen did you just want to
  1134. 41:16talk through some of these additional
  1135. 41:18resources
  1136. 41:20yeah so hopefully you know you've got
  1137. 41:22some inspiration now for a project you
  1138. 41:24could do
  1139. 41:26and um you know this workshop is really
  1140. 41:28just a quick overview and i know there's
  1141. 41:29a lot of information being thrown at you
  1142. 41:32so we just wanted to give you some
  1143. 41:33further resources which will help you
  1144. 41:36navigate your way through a reuse
  1145. 41:38project
  1146. 41:39so there's a few publications out which
  1147. 41:41would be useful if you're doing
  1148. 41:43quantitative work
  1149. 41:44then emma smith's book using secondary
  1150. 41:47data in educational and social research
  1151. 41:50might be useful there's also a chapter
  1152. 41:52in sages handbook of social research
  1153. 41:55methods
  1154. 41:56on secondary analysis of quantitative
  1155. 41:58data sources
  1156. 41:59and we also have some data skills
  1157. 42:01modules uh which will help guide you
  1158. 42:04through you know steps of the of
  1159. 42:05statistical analysis
  1160. 42:08for qualitative projects there's a
  1161. 42:10chapter in silverman's qualitative
  1162. 42:12research textbook on secondary analysis
  1163. 42:15and there's also a working paper series
  1164. 42:17available through the timescapes archive
  1165. 42:20karen hughes and aaron tarrant have also
  1166. 42:22recently published a handbook of
  1167. 42:25qualitative secondary analysis
  1168. 42:27and finally if you need more help with
  1169. 42:29finding accessing your downloading data
  1170. 42:32we have video tutorials which will walk
  1171. 42:34you through the process with
  1172. 42:35step-by-step procedures

About this transcript

This page contains the full transcript of Dissertation projects: Introduction to secondary analysis for qualitative and quantitative data by UK DATA SERVICE, generated from the public captions YouTube serves with the video. The transcript has 6,925 words across 1,172 segments, with the original timestamps preserved so you can click any line to jump to that moment in the embedded player.

What you can do with it

Use the transcript to take notes, quote the speaker, build a study guide, generate a summary with ChatGPT or Claude via the YouTube Summary tool, or export it as a timed subtitle file with YouTube to SRT. You can also re-open it in the transcriber to translate the transcript into 100+ languages.

Free YouTube transcript tool

YouTube2Text is a free YouTube transcript generator — no signup, no daily limit. Paste any YouTube link and get the full transcript instantly, with timestamps, click-to-jump, translation to 100+ languages, AI prompts for ChatGPT, Claude, and Gemini, and exports to TXT, SRT, VTT, or Markdown.