Research indexMeta-analysis
The significance gap: statistical significance rates decrease from primary literature to effects used in ecological meta-analyses
Žanko, Čulina
1 May 2026Open access
The significance gap: statistical significance rates decrease from primary literature to effects used in ecological meta-analyses
Žanko, Čulina · 2026
Free to read at the publisher
You can read the abstract here, or the full text at the publisher.
Abstract
Publication bias is widely considered a major threat to ecological synthesis, yet whether significance rates observed in the general literature are reflected in studies used in metaanalyses remains unknown.Using two large, independent datasets-26,547 results from 359 primary studies and 104,418 effects from 17,879 studies included in 464 ecological metaanalyses-we quantify a "significance gap" across the research-to-synthesis pipeline.In primary studies from the general literature, 49.7% of individual results were statistically significant.However, 98.9% of these studies contained at least one significant result.Among individual effects extracted for meta-analyses, 41.1% were significant, but only 63.6% of the contributing studies contained at least one significant effect.Rarefaction analysis showed that much of the disparity in study-level significance rates between the two datasets diminishes, yet persists, when equalised to the same number of effects per study.These patterns suggest that publication bias operates mainly at the study level: studies apparently need at least one significant finding to be published, but once published, they freely report null results alongside the significant ones.By extracting effects beyond the headline findings, meta-analyses may partly counteract rather than reinforce publication bias.