This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision | ||
wiki:guide:research:rob [2021/12/15 16:58] katcow |
wiki:guide:research:rob [2023/05/25 21:46] (current) jthurnham |
||
---|---|---|---|
Line 1: | Line 1: | ||
- | + | **Critical Appraisal** | |
- | + | ||
- | **Risk of Bias ** | + | |
**[[: | **[[: | ||
- | **[[: | + | **[[: |
- | **[[: | + | ==== Introduction to Critical Appraisal ==== |
- | **[[: | + | The extent to which a systematic review/ |
- | + | ||
- | ==== Introduction ==== | + | |
- | + | ||
- | The extent to which a systematic review/ | + | |
The validity of a study may be considered to have two dimensions. The first dimension is whether the study is asking an appropriate research question. This is often described as ‘external validity’, | The validity of a study may be considered to have two dimensions. The first dimension is whether the study is asking an appropriate research question. This is often described as ‘external validity’, | ||
- | Below are procedures for performing RoB assessments for systematic reviews and meta-analyses. | + | ==== Download |
- | + | ||
- | ==== Assign | + | |
- | + | ||
- | - It is the responsibility of the study coordinator to assign the quality control (QC) reviewer and independent RoB reviewers at the beginning of the project start. Typical RoBs require 1 QC reviewer and 2 independent RoB reviewers. | + | |
- | + | ||
- | ==== Determine the correct RoB to use: ==== | + | |
- | + | ||
- | - Different study designs (Case Control, Cohort, etc.) will use different versions of an RoB. Most RoBs will consist entirely of randomized controlled trials and/or cohort studies; however, different study designs may be included depending on the project. If necessary, discuss with the study coordinator (most likely John Pederson, [[jpederson@supedit.com|]]) to determine which RoB should be used. Note that it is the responsibility of the QC reviewer to determine the correct RoB form. | + | |
- | - Familiarize yourself with the different sections of the RoB you are using. Information on the different RoBs can be found in the [[https:// | + | |
- | - Scottish Intercollegiate Guidelines Network ([[https:// | + | |
- | - Randomized Controlled Trial | + | |
- | - Cohort | + | |
- | - Case Control | + | |
- | - Diagnostic Accuracy | + | |
- | - Economic Evaluations | + | |
- | - NOTE: The instructions for the SIGN RoB are quite long (100+ pages!). The good news is that most of the information is not particularly relevant for the majority of SR/MAs. For quick reference, the most important sections to review are page #51 and pages #56-66. Other sections may be useful depending on the project. | + | |
- | - modified Newcastle-Ottawa Scale (mNOS) | + | |
- | - Cohort | + | |
- | - Case Control | + | |
- | - Joanna Briggs Institute (JBI) | + | |
- | - Case Report | + | |
- | - Case Series | + | |
- | - Cochrane | + | |
- | - Randomized Trial | + | |
- | - Non-Randomized Study | + | |
- | - Know which study designs you are including in the SR/MA. Be familiar with these study designs and choose the correct RoB template based on the studies included in the SR/MA. | + | |
- | - Normally, two RoB reviewers will complete an RoB individually. Do not collaborate on one with your fellow reviewer because your RoB assessment would be biased. | + | |
- | - An experienced QC reviewer should adjudicate results of the RoB and resolve any conflicts between RoB results from the independent reviewers. | + | |
- | + | ||
- | ==== Use the correct template: ==== | + | |
- | + | ||
- | - Use the correct template for each study. Different study designs warrant the use of different templates. All templates exist as both Excel files and Google Sheets in the [[https:// | + | |
- | - [[https:// | + | |
- | - Systematic Reviews and Meta-analyses | + | |
- | - [[https:// | + | |
- | - [[https:// | + | |
- | - Cochrane Templates: The Cochrane Templates have the most difficult instructions and will most likely not be used. The Cochrane Templates are applicable for both randomized studies (see [[https:// | + | |
- | + | ||
- | ==== Follow-through ==== | + | |
- | + | ||
- | ---- | + | |
- | + | ||
- | === For independent RoB reviewers === | + | |
- | + | ||
- | Before completing the RoB assessment, //always //ensure that you have the same study design labels and study row ordering as the other independent reviewer. Once this has been confirmed, perform the RoB assessment. Email the QC reviewer and study coordinator when finished, then start on [[https:// | + | |
- | + | ||
- | * Note: If independent reviewers create their RoBs using the // <font inherit/ | + | |
- | + | ||
- | ---- | + | |
- | === For QC reviewer === | + | {{: |
- | - First, combine and compare indepedent RoB responses. This can be performed manually for small projects, but for larger projects, it is recommended to use the methods described in [[https:// | ||
- | - Adjudicate. | ||
- | - Write up the RoB results in the manuscript. See [[https:// | ||
- | ---- | ||