Case study meta ‐analysis in the social sciences. Insights on data quality and reliability from a large‐N case survey
AbstractMeta-analytical methods face particular challenges in research fields such as social and political research, where studies often rest primarily on qualitative and case study research. In such contexts, where research findings are less standardized and amenable to structured synthesis, the case survey method has been proposed as a means of data generation and analysis. The method offers a meta-analytical tool to synthesize larger numbers of qualitative case studies, yielding data amenable to large-N analysis. However, resulting data is prone to specific threats to validity, including biases due to publication type, ...
Source: Research Synthesis Methods - August 23, 2021 Category: Chemistry Authors: Nicolas W. Jager, Jens Newig, Edward Challies, Elisa Kochsk ämper, Henrik von Wehrden Tags: RESEARCH ARTICLE Source Type: research

Researcher ‐librarian partnerships will enhance search literacy skills
(Source: Research Synthesis Methods)
Source: Research Synthesis Methods - August 21, 2021 Category: Chemistry Authors: Kelly Johnson, Kate Ghezzi ‐Kopel, Erin Eldermire, Chris Fournier, Erica Johns, Amelia Kallaher, Matthew Kibbee, Christian Miller Tags: LETTER TO THE EDITOR Source Type: research

Synthesis of evidence from zero ‐events studies: A comparison of one‐stage framework methods
AbstractIn evidence synthesis, dealing with zero-events studies is an important and complicated task that has generated broad discussion. Numerous methods provide valid solutions to synthesizing data from studies with zero-events, either based on a frequentist or a Bayesian framework. Among frequentist frameworks, the one-stage methods have their unique advantages to deal with zero-events studies, especially for double-arm-zero-events. In this article, we give a concise overview of the one-stage frequentist methods. We conducted simulation studies to compare the statistical properties of these methods to the two-stage freq...
Source: Research Synthesis Methods - August 20, 2021 Category: Chemistry Authors: Chang Xu, Luis Furuya ‐Kanamori, Lifeng Lin Tags: RESEARCH ARTICLE Source Type: research

On ratio measures of heterogeneity for meta ‐analyses
AbstractAs a measure of heterogeneity in meta-analysis, the coefficient of variation (CV) has been recently considered, providing researchers with a complement to the very popular I2 measure. While I2 measures the proportion of total variance that is due to variance of the random effects, the CV is the ratio of the standard deviation of the random effects to the effect of interest. Consequently, the CV provides a different measure of the extent of heterogeneity in a meta-analysis relative to the effect being measured. However, very large CV values can occur when the effect is small making interpretation difficult. The purp...
Source: Research Synthesis Methods - August 19, 2021 Category: Chemistry Authors: Maxwell Cairns, Luke A. Prendergast Tags: RESEARCH ARTICLE Source Type: research

Synthesis of evidence from zero ‐events studies: A comparison of one‐stage framework methods
This article is protected by copyright. All rights reserved. (Source: Research Synthesis Methods)
Source: Research Synthesis Methods - August 13, 2021 Category: Chemistry Authors: Chang Xu, Luis Furuya ‐Kanamori, Lifeng Lin Tags: RESEARCH ARTICLE Source Type: research

Training sample selection: impact on screening automation in diagnostic test accuracy reviews
This article is protected by copyright. All rights reserved. (Source: Research Synthesis Methods)
Source: Research Synthesis Methods - August 13, 2021 Category: Chemistry Authors: A. J. Altena, R. Spijker, M. M. G. Leeang, S. D. Olabarriaga Tags: RESEARCH ARTICLE Source Type: research

Measurement error in meta ‐analysis (MEMA)—A Bayesian framework for continuous outcome data subject to non‐differential measurement error
Ideally, a meta-analysis will summarize data from several unbiased studies. Here we look into the less than ideal situation in which contributing studies may be compromised by non-differential measurement error in the exposure variable. Specifically, we consider a meta-analysis for the association between a continuous outcome variable and one or more continuous exposure variables, where the associations may be quantified as regression coefficients of a linear regression model. A flexible Bayesian framework is developed which allows one to obtain appropriate point and interval estimates with varying degrees of prior knowled...
Source: Research Synthesis Methods - August 12, 2021 Category: Chemistry Authors: Harlan Campbell, Valentijn M. T. de Jong, Lauren Maxwell, Thomas Jaenisch, Thomas P. A. Debray, Paul Gustafson Tags: RESEARCH ARTICLE Source Type: research

The age of abundant scholarly information and its synthesis –A time when ‘just google it’ is no longer enough
This article is protected by copyright. All rights reserved. (Source: Research Synthesis Methods)
Source: Research Synthesis Methods - August 11, 2021 Category: Chemistry Authors: Michael Gusenbauer Tags: DISCUSSION PAPER Source Type: research

Examining how meta ‐analytic methods perform in the presence of bias: A simulation study
Standard meta-analysis methods are vulnerable to bias from incomplete reporting of results (both publication and outcome reporting bias) and poor study quality. Several alternative methods have been proposed as being less vulnerable to such biases. To evaluate these claims independently we simulated study results under a broad range of conditions first with no bias, then introducing simulated publication bias, outcome reporting bias, and bias from poor study quality. We then implemented common and the proposed bias robust meta-analysis methods and compared the mean bias and mean squared error (MSE) for four estimates of ef...
Source: Research Synthesis Methods - August 5, 2021 Category: Chemistry Authors: Paul Bramley, Jos é A. López‐López, Julian P. T. Higgins Tags: RESEARCH ARTICLE Source Type: research

Detecting publication selection bias through excess statistical significance
AbstractWe introduce and evaluate three tests for publication selection bias based on excess statistical significance (ESS). The proposed tests incorporate heterogeneity explicitly in the formulas for expected and ESS. We calculate the expected proportion of statistically significant findings in the absence of selective reporting or publication bias based on each study's SE and meta-analysis estimates of the mean and variance of the true-effect distribution. A simple proportion of statistical significance test (PSST) compares the expected to the observed proportion of statistically significant findings. Alternatively, we p...
Source: Research Synthesis Methods - August 3, 2021 Category: Chemistry Authors: T. D. Stanley, Hristos Doucouliagos, John P. A. Ioannidis, Evan C. Carter Tags: RESEARCH ARTICLE Source Type: research

On ratio measures of heterogeneity for meta ‐analyses
This article is protected by copyright. All rights reserved. (Source: Research Synthesis Methods)
Source: Research Synthesis Methods - July 31, 2021 Category: Chemistry Authors: Maxwell Cairns, Luke Prendergast Tags: RESEARCH ARTICLE Source Type: research

Examining how meta ‐analytic methods perform in the presence of bias: A simulation study
This article is protected by copyright. All rights reserved. (Source: Research Synthesis Methods)
Source: Research Synthesis Methods - July 30, 2021 Category: Chemistry Authors: Paul Bramley, Jos é A. López‐López, Julian P. T. Higgins Tags: RESEARCH ARTICLE Source Type: research

Case study meta ‐analysis in the social sciences. Insights on data quality and reliability from a large‐N case survey
This article is protected by copyright. All rights reserved. (Source: Research Synthesis Methods)
Source: Research Synthesis Methods - July 28, 2021 Category: Chemistry Authors: Nicolas W. Jager, Jens Newig, Edward Challies, Elisa Kochsk ämper, Henrik Wehrden Tags: RESEARCH ARTICLE Source Type: research

Measurement Error in Meta ‐Analysis (MEMA) ‐ a Bayesian framework for continuous outcome data subject to non‐differential measurement error
This article is protected by copyright. All rights reserved. (Source: Research Synthesis Methods)
Source: Research Synthesis Methods - July 27, 2021 Category: Chemistry Authors: Harlan Campbell, Valentijn M. T. de Jong, Lauren Maxwell, Thomas Jaenisch, Thomas P. A. Debray, Paul Gustafson Tags: RESEARCH ARTICLE Source Type: research