Nested Knowledge

Bringing Systematic Review to Life

User Tools

Site Tools


wiki:guide:qc:qc_checklist

Table of Contents

QC Checklist

  1. Do the studies meet the inclusion criteria?
    1. Are they the primary studies and not secondary studies?
    2. Are there any papers with biased sub-populations? Flag them for further review.
  2. Is the tagging complete?
    1. Check for gap teeth
    2. Check for missing tags
    3. Use the bulk actions to apply missing tags to included studies and go back and add text.
  3. Is extraction done correctly?
    1. Are all the units matching?
      1. Check this using quantitative synthesis
    2. Is the same scale used for a given outcome across papers?
    3. Is there missing data that should have been extracted?
      1. Can standard deviation (SD) be calculated from standard error (SE) or confidence interval (CI)?
      2. Was there data in the results/discussion section that should have been extracted?
      3. Was there data in tables that should have been extracted?
      4. Are there any secondary analyses with extra data we could extract?
        1. If so, make sure you comment where you got the data.
      5. Is there a supplement with useful data?
        1. If so, make sure you comment where you got the data.
      6. Is there data on clinicaltrials.gov?
        1. If so, make sure you comment where you got the data.
    4. Were there errors in the extraction?
      1. Make sure means/medians are not confused.
      2. Make sure SD/SE are not confused.
      3. Make sure IQR and range are not confused.
      4. Make sure LS means are treated separately from (arithmetic) means. Unless otherwise specified it will be an arithmetic mean.
      5. Make sure loss to follow up is reflected in the sample sizes.
    5. Are outcomes extracted at compatible timepoints across papers?
    6. Are blanks and 0s properly differentiated?
    7. Are the definitions of data elements consistent across papers?

If you prefer to have this in a downloadable word doc, here it is!

wiki/guide/qc/qc_checklist.txt · Last modified: 2022/02/09 17:30 by nicole_hardy_alumni.brown.edu