TY - JOUR
T1 - Evaluation of thresholding methods for activation likelihood estimation meta-analysis via large-scale simulations
AU - Frahm, Lennart
AU - Cieslik, Edna C.
AU - Hoffstaedter, Felix
AU - Satterthwaite, Theodore D.
AU - Fox, Peter T.
AU - Langner, Robert
AU - Eickhoff, Simon B.
N1 - Publisher Copyright:
© 2022 The Authors. Human Brain Mapping published by Wiley Periodicals LLC.
PY - 2022/9
Y1 - 2022/9
N2 - In recent neuroimaging studies, threshold-free cluster enhancement (TFCE) gained popularity as a sophisticated thresholding method for statistical inference. It was shown to feature higher sensitivity than the frequently used approach of controlling the cluster-level family-wise error (cFWE) and it does not require setting a cluster-forming threshold at voxel level. Here, we examined the applicability of TFCE to a widely used method for coordinate-based neuroimaging meta-analysis, Activation Likelihood Estimation (ALE), by means of large-scale simulations. We created over 200,000 artificial meta-analysis datasets by independently varying the total number of experiments included and the amount of spatial convergence across experiments. Next, we applied ALE to all datasets and compared the performance of TFCE to both voxel-level and cluster-level FWE correction approaches. All three multiple-comparison correction methods yielded valid results, with only about 5% of the significant clusters being based on spurious convergence, which corresponds to the nominal level the methods were controlling for. On average, TFCE's sensitivity was comparable to that of cFWE correction, but it was slightly worse for a subset of parameter combinations, even after TFCE parameter optimization. cFWE yielded the largest significant clusters, closely followed by TFCE, while voxel-level FWE correction yielded substantially smaller clusters, showcasing its high spatial specificity. Given that TFCE does not outperform the standard cFWE correction but is computationally much more expensive, we conclude that employing TFCE for ALE cannot be recommended to the general user.
AB - In recent neuroimaging studies, threshold-free cluster enhancement (TFCE) gained popularity as a sophisticated thresholding method for statistical inference. It was shown to feature higher sensitivity than the frequently used approach of controlling the cluster-level family-wise error (cFWE) and it does not require setting a cluster-forming threshold at voxel level. Here, we examined the applicability of TFCE to a widely used method for coordinate-based neuroimaging meta-analysis, Activation Likelihood Estimation (ALE), by means of large-scale simulations. We created over 200,000 artificial meta-analysis datasets by independently varying the total number of experiments included and the amount of spatial convergence across experiments. Next, we applied ALE to all datasets and compared the performance of TFCE to both voxel-level and cluster-level FWE correction approaches. All three multiple-comparison correction methods yielded valid results, with only about 5% of the significant clusters being based on spurious convergence, which corresponds to the nominal level the methods were controlling for. On average, TFCE's sensitivity was comparable to that of cFWE correction, but it was slightly worse for a subset of parameter combinations, even after TFCE parameter optimization. cFWE yielded the largest significant clusters, closely followed by TFCE, while voxel-level FWE correction yielded substantially smaller clusters, showcasing its high spatial specificity. Given that TFCE does not outperform the standard cFWE correction but is computationally much more expensive, we conclude that employing TFCE for ALE cannot be recommended to the general user.
KW - FWE
KW - family-wise error
KW - multiple comparison correction
KW - neuroimaging meta-analysis
KW - significance thresholding
KW - threshold-free cluster enhancement cluster extent
UR - http://www.scopus.com/inward/record.url?scp=85129676252&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85129676252&partnerID=8YFLogxK
U2 - 10.1002/hbm.25898
DO - 10.1002/hbm.25898
M3 - Article
C2 - 35535616
AN - SCOPUS:85129676252
SN - 1065-9471
VL - 43
SP - 3987
EP - 3997
JO - Human Brain Mapping
JF - Human Brain Mapping
IS - 13
ER -