Estimation of heterogeneity variance based on a generalized Q statistic in meta ‐analysis of log‐odds‐ratio
AbstractFor estimation of heterogeneity variance τ2$$ {\tau}^2 $$ in meta-analysis of log-odds-ratio, we derive new mean- and median-unbiased point estimators and new interval estimators based on a generalized Q$$ Q $$ statistic, QF$$ {Q}_F $$, in which the weights depend on only the studies' effective sample sizes. We compare them with familiar estimators based on the inverse-variance-weights version of Q$$ Q $$, QIV.$$ {Q}_{IV}. $$ In an extensive simulation, we studied the bias (including median bias) of the point estimators and the coverage (including left and right coverage error) of the confidence intervals. Most es...
Source: Research Synthesis Methods - June 29, 2023 Category: Chemistry Authors: Elena Kulinskaya,
David C. Hoaglin Tags: RESEARCH ARTICLE Source Type: research
An open competition involving thousands of competitors failed to construct useful abstract classifiers for new diagnostic test accuracy systematic reviews
In conclusion, we were unable to develop an abstract classifier with sufficient recall for immediate application to new DTA systematic reviews. Further studies are needed to update and validate classifiers with datasets from other clinical areas. (Source: Research Synthesis Methods)
Source: Research Synthesis Methods - June 20, 2023 Category: Chemistry Authors: Yuki Kataoka,
Shunsuke Taito,
Norio Yamamoto,
Ryuhei So,
Yusuke Tsutsumi,
Keisuke Anan,
Masahiro Banno,
Yasushi Tsujimoto,
Yoshitaka Wada,
Shintaro Sagami,
Hiraku Tsujimoto,
Takashi Nihashi,
Motoki Takeuchi,
Teruhiko Terasawa,
Masahiro Iguch Tags: RESEARCH ARTICLE Source Type: research
Comparison of statistical methods for integrating real ‐world evidence in a rare events meta‐analysis of randomized controlled trials
We describe a simulation study that aims to evaluate an array of alternative Bayesian methods for including RWE in rare events meta-analysis of RCTs: the na ïve data synthesis, the design-adjusted synthesis, the use of RWE as prior information, the three-level hierarchical models, and the bias-corrected meta-analysis model. The percentage bias, root-mean-square-error, mean 95% credible interval width, coverage probability, and power are used to measure performance. The various methods are illustrated using a systematic review to evaluate the risk of diabetic ketoacidosis among patients using sodium/glucose co-transporter ...
Source: Research Synthesis Methods - June 13, 2023 Category: Chemistry Authors: Minghong Yao,
Yuning Wang,
Yan Ren,
Yulong Jia,
Kang Zou,
Ling Li,
Xin Sun Tags: RESEARCH ARTICLE Source Type: research
Effect estimates can be accurately calculated with data digitally extracted from interrupted time series graphs
AbstractInterrupted time series (ITS) studies are frequently used to examine the impact of population-level interventions or exposures. Systematic reviews with meta-analyses including ITS designs may inform public health and policy decision-making. Re-analysis of ITS may be required for inclusion in meta-analysis. While publications of ITS rarely provide raw data for re-analysis, graphs are often included, from which time series data can be digitally extracted. However, the accuracy of effect estimates calculated from data digitally extracted from ITS graphs is currently unknown. Forty-three ITS with available datasets and...
Source: Research Synthesis Methods - June 10, 2023 Category: Chemistry Authors: Simon Lee Turner,
Elizabeth Korevaar,
Miranda S. Cumpston,
Raju Kanukula,
Andrew B. Forbes,
Joanne E. McKenzie Tags: RESEARCH ARTICLE Source Type: research
Methodological considerations for novel approaches to covariate ‐adjusted indirect treatment comparisons
AbstractWe examine four important considerations in the development of covariate adjustment methodologies for indirect treatment comparisons. First, we consider potential advantages of weighting versus outcome modeling, placing focus on bias-robustness. Second, we outline why model-based extrapolation may be required and useful, in the specific context of indirect treatment comparisons with limited overlap. Third, we describe challenges for covariate adjustment based on data-adaptive outcome modeling. Finally, we offer further perspectives on the promise of doubly robust covariate adjustment frameworks. (Source: Research Synthesis Methods)
Source: Research Synthesis Methods - June 8, 2023 Category: Chemistry Authors: Antonio Remiro ‐Azócar,
Anna Heath,
Gianluca Baio Tags: DISCUSSION Source Type: research
Re ‐orientating systematic reviews to rigorously examine what works, for whom and how: Example of a realist systematic review of school‐based prevention of dating and gender violence
AbstractConventional systematic reviews offer few insights into for whom and how interventions work. ‘Realist reviews’ examine such questions via examining ‘context-mechanism-outcome configurations’ (CMOCs) but are insufficiently rigorous in how evidence is identified, assessed and synthesised. We developed ‘realist systematic reviews’, addressing similar questions to realist reviews bu t using rigorous methods. We applied this to synthesising evidence on school-based prevention of dating and relationship violence (DRV) and gender-based violence (GBV). This paper reflects on overall methods and findings, drawin...
Source: Research Synthesis Methods - June 8, 2023 Category: Chemistry Authors: Chris Bonell,
Bruce Taylor,
Vashti Berry,
Sidnei R. Priolo Filho,
Andrew Rizzo,
Caroline Farmer,
Ann Hagell,
Honor Young,
Noreen Orr,
Naomi Shaw,
Annah Chollet,
Fraizer Kiff,
Emma Rigby,
G. J. Melendez ‐Torres Tags: REVIEW Source Type: research
The consequences of neglected confounding and interactions in mixed ‐effects meta‐regression: An illustrative example
AbstractAnalysts seldom include interaction terms in their meta-regression model, which can introduce bias if an interaction is present. We illustrate this by reanalysing a meta-regression study in acute heart failure. Based on a total of 285 studies, the 1-year mortality rate related to acute heart failure is considered and the connection to the study-level covariates year of recruitment and average age of study participants are of interest. We show that neglecting a possibly confounding variable and an interaction term might lead to erroneous inference and conclusions. Based on our results and accompanying simulations, w...
Source: Research Synthesis Methods - June 5, 2023 Category: Chemistry Authors: Eric S. Knop,
Markus Pauly,
Tim Friede,
Thilo Welz Tags: RESEARCH IN BRIEF Source Type: research
A real ‐world evaluation of the implementation of NLP technology in abstract screening of a systematic review
AbstractThe laborious and time-consuming nature of systematic review production hinders the dissemination of up-to-date evidence synthesis. Well-performing natural language processing (NLP) tools for systematic reviews have been developed, showing promise to improve efficiency. However, the feasibility and value of these technologies have not been comprehensively demonstrated in a real-world review. We developed an NLP-assisted abstract screening tool that provides text inclusion recommendations, keyword highlights, and visual context cues. We evaluated this tool in a living systematic review on SARS-CoV-2 seroprevalence, ...
Source: Research Synthesis Methods - May 26, 2023 Category: Chemistry Authors: Sara Perlman ‐Arrow,
Noel Loo,
Niklas Bobrovitz,
Tingting Yan,
Rahul K. Arora Tags: RESEARCH ARTICLE Source Type: research
Issue Information
(Source: Research Synthesis Methods)
Source: Research Synthesis Methods - May 5, 2023 Category: Chemistry Tags: ISSUE INFORMATION Source Type: research
Citation tracking for systematic literature searching: A scoping review
AbstractCitation tracking (CT) collects references with citation relationships to pertinent references that are already known. This scoping review maps the benefit of and the tools and terminology used for CT in health-related systematic literature searching. We included methodological studies on evidence retrieval by CT in health-related literature searching without restrictions on study design, language, or publication date. We searched MEDLINE/Ovid, Web of Science Core Collection, CINAHL/EBSCOhost, LLISFT/EBSCOhost, LISTA/EBSCOhost, conducted web searching via Google Scholar, backward/forward CT of included studies and ...
Source: Research Synthesis Methods - April 12, 2023 Category: Chemistry Authors: Julian Hirt,
Thomas Nordhausen,
Christian Appenzeller ‐Herzog,
Hannah Ewald Tags: REVIEW Source Type: research
Comparison and validation of metadta for meta ‐analysis of diagnostic test accuracy studies
This article is protected by copyright. All rights reserved. (Source: Research Synthesis Methods)
Source: Research Synthesis Methods - March 31, 2023 Category: Chemistry Authors: Victoria N. Nyaga,
Marc Arbyn Tags: SOFTWARE FOCUS Source Type: research
Applying and reporting relevance, richness and rigour in realist evidence appraisals: Advancing key concepts in realist reviews
AbstractThe realist review/synthesis has become an increasingly prominent methodological approach to evidence synthesis that can inform policy and practice. While there are publication standards and guidelines for the conduct of realist reviews, published reviews often provide minimal detail regarding how they have conducted some methodological steps. This includes selecting and appraising evidence sources, which are often considered for their ‘relevance, richness and rigour.’ In contrast to other review approaches, for example, narrative reviews and meta-analyses, the inclusion criteria and appraisal of evidence withi...
Source: Research Synthesis Methods - March 15, 2023 Category: Chemistry Authors: Sara Dada,
Sonia Dalkin,
Brynne Gilmore,
Rebecca Hunter,
Ferdinand C. Mukumbang Tags: RESEARCH IN BRIEF Source Type: research
Combining estimators in interlaboratory studies and meta ‐analyses
This article is protected by copyright. All rights reserved. (Source: Research Synthesis Methods)
Source: Research Synthesis Methods - March 14, 2023 Category: Chemistry Authors: Hening Huang Tags: RESEARCH ARTICLE Source Type: research
Issue Information
(Source: Research Synthesis Methods)
Source: Research Synthesis Methods - March 13, 2023 Category: Chemistry Tags: ISSUE INFORMATION Source Type: research
Correct standard errors can bias meta ‐analysis
This article is protected by copyright. All rights reserved. (Source: Research Synthesis Methods)
Source: Research Synthesis Methods - March 7, 2023 Category: Chemistry Authors: T. D. Stanley,
Hristos Doucouliagos Tags: DISCUSSION Source Type: research
