Differences

This shows you the differences between two versions of the page.

--- wiki:synthesis:quantitative:methods [2022/06/30 17:51]
kholub
+++ wiki:synthesis:quantitative:methods [2023/09/07 12:56] (current)
jthurnham [Data Analyzed]
@@ Line 5: / Line 5: @@
 ===== Data Analyzed =====
-Any study included (adjudicated, in dual screening) during [[:wiki:autolit:screening|]] and with Extraction was marked "Complete" is analyzed on QNS. If dual extraction is configured for the nest, only adjudicated data is analyzed in QNS.
+Any study included (adjudicated, in dual screening) during [[:wiki:autolit:screening|]] and with [[:wiki:autolit:meta_analytical_extraction|extraction]] marked "Complete" is analyzed on QNS. If dual extraction is configured for the nest, only adjudicated data is analyzed in QNS.
 ===== Analyses =====
@@ Line 17: / Line 18: @@
 For medians, pooled estimates & inferentials are computed as the Weighted Median of Medians, described in [[https://onlinelibrary.wiley.com/doi/abs/10.1002/sim.8013|McGrath et al.]]
-All computational methods are implemented as a transcription, with minor modifications, of the peer-reviewed work in the R packages [[https://CRAN.R-project.org/package=meta|meta]], [[https://CRAN.R-project.org/package=metafor|metafor]], and [[https://CRAN.R-project.org/package=metamedian|metamedian]]. As these are open source, our modifications are similarly made publicly available for modification & audit in the Javascript package [[https://github.com/holub008/shukra|shukra]]. Pooled estimates specifically are computed by the [[https://github.com/holub008/shukra/blob/master/src/pooling.js|pooling module]]. To ensure correctness, all methods in shukra, and therefore used in QNS, are [[https://github.com/holub008/shukra/blob/master/test/test_pooling.js|tested]] for equality to estimates computed in the upstream packages.
+=== Sources of Computational Methods ===
+All computational methods are implemented as a transcription, with minor modifications, of the peer-reviewed work in the R packages [[https://CRAN.R-project.org/package=meta|meta]], [[https://CRAN.R-project.org/package=metafor|metafor]], and [[https://CRAN.R-project.org/package=metamedian|metamedian]]. As these are open source, our modifications are open source, made publicly available for audit & modification in the Javascript package [[https://github.com/holub008/shukra|shukra]]. Pooled estimates specifically are computed by the [[https://github.com/holub008/shukra/blob/master/src/pooling.js|pooling module]]. To ensure correctness, all methods in shukra, and therefore used in QNS, are [[https://github.com/holub008/shukra/blob/master/test/test_pooling.js|tested]] for equality to estimates computed in the upstream packages.
 ==== Network Meta-Analysis (NMA) ====
-Any multi-arm study with two or more arms extracted are analyzed in NMA. If the user-configured intervention grouping assigns the same intervention to two or more arms in the study, they are pooled; if it assigns the same intervention to all arms in the study, the study is discarded from the NMA.
+Any multi-arm study with two or more arms extracted are analyzed in NMA. If the user-configured intervention grouping assigns the same intervention to two or more arms in the study, they are pooled; if it assigns the same intervention to all arms in the study, the study is discarded from the NMA. Only continuous data elements with mean & SD configured, or dichotomous data elements are eligible for NMA; arms where SD is not extracted are discarded from the analysis.
 Before performing the NMA, connected components of the intervention graph are identified. Each connected component is analyzed in a separate NMA, and the results of the NMAs are combined in outputs and visuals. No effect estimates will be provided for interventions that belong to different connected components.
+Direct effects are computed as Mean Differences (continuous data elements) or Odds Ratios (dichotomous data elements) between all pairs of within-study arms. Consistent indirect effects are computed using the Aitken estimator (described in [[https://journals.sagepub.com/doi/10.1177/0962280211432220|Senn et. al]]), with an pairwise-effect weighting correction for multi (3+) arm studies (described in [[https://onlinelibrary.wiley.com/doi/10.1002/sim.6236|Rücker et. al, 2014]]). For full details on computation of the Aitken estimator see [[https://onlinelibrary.wiley.com/doi/10.1002/jrsm.1058|Rücker et. al, 2012]]. When random effects are specified, between-study variance is estimated using the DerSimonian-Laird estimator. All inferential statistics, at the study (used in forest plots) and intervention level, are computed using Normal approximations (logit transformed, for dichotomous data) on the consistent treatment effects. Intervention rankings are computed with P-scores, described in [[https://bmcmedresmethodol.biomedcentral.com/articles/10.1186/s12874-015-0060-8|Rücker and Schwarzer, 2015]].
+Funnel plots are generated using all contrasts available on the selected intervention. "Comparison-adjusted" effects ([[https://doi.org/10.1371/journal.pone.0076654|Chaimani et. al]]) center all direct effects at a common value using their summary effect estimates, making trending and symmetry analysis feasible on the plot.
+=== Sources of Computational Methods ===
+All computational methods are implemented as a transcription, with modification, of the peer-reviewed work in the R packages [[https://CRAN.R-project.org/package=netmeta|netmeta]] and [[https://CRAN.R-project.org/package=metafor|metafor]]. As these are open source, our modifications are open source, made publicly available for audit & modification in the Javascript package [[https://github.com/holub008/shukra|shukra]]. NMAs specifically are computed by the [[https://github.com/holub008/shukra/blob/master/src/nma.js|nma module]]. To ensure correctness, all methods in shukra, and therefore used in QNS, are [[https://github.com/holub008/shukra/blob/master/test/test_nma.js|tested]] for equality to estimates computed in the upstream packages.

Nested Knowledge

User Tools

Site Tools

Differences

Page Tools