Evaluation of thresholding methods for activation likelihood estimation meta-analysis via large-scale simulations

Lennart Frahm, Edna C. Cieslik, Felix Hoffstaedter, Theodore D. Satterthwaite, Peter T. Fox, Robert Langner, Simon B. Eickhoff

Research output: Contribution to journalArticlepeer-review

Abstract

In recent neuroimaging studies, threshold-free cluster enhancement (TFCE) gained popularity as a sophisticated thresholding method for statistical inference. It was shown to feature higher sensitivity than the frequently used approach of controlling the cluster-level family-wise error (cFWE) and it does not require setting a cluster-forming threshold at voxel level. Here, we examined the applicability of TFCE to a widely used method for coordinate-based neuroimaging meta-analysis, Activation Likelihood Estimation (ALE), by means of large-scale simulations. We created over 200,000 artificial meta-analysis datasets by independently varying the total number of experiments included and the amount of spatial convergence across experiments. Next, we applied ALE to all datasets and compared the performance of TFCE to both voxel-level and cluster-level FWE correction approaches. All three multiple-comparison correction methods yielded valid results, with only about 5% of the significant clusters being based on spurious convergence, which corresponds to the nominal level the methods were controlling for. On average, TFCE's sensitivity was comparable to that of cFWE correction, but it was slightly worse for a subset of parameter combinations, even after TFCE parameter optimization. cFWE yielded the largest significant clusters, closely followed by TFCE, while voxel-level FWE correction yielded substantially smaller clusters, showcasing its high spatial specificity. Given that TFCE does not outperform the standard cFWE correction but is computationally much more expensive, we conclude that employing TFCE for ALE cannot be recommended to the general user.

Original languageEnglish (US)
Pages (from-to)3987-3997
Number of pages11
JournalHuman Brain Mapping
Volume43
Issue number13
DOIs
StatePublished - Sep 2022

Keywords

  • FWE
  • family-wise error
  • multiple comparison correction
  • neuroimaging meta-analysis
  • significance thresholding
  • threshold-free cluster enhancement cluster extent

ASJC Scopus subject areas

  • Anatomy
  • Radiological and Ultrasound Technology
  • Radiology Nuclear Medicine and imaging
  • Neurology
  • Clinical Neurology

Fingerprint

Dive into the research topics of 'Evaluation of thresholding methods for activation likelihood estimation meta-analysis via large-scale simulations'. Together they form a unique fingerprint.

Cite this