Year: 2026
Type: article
Abstract: Researchers apply network psychometric methods across many levels of analysis-from understanding causal pathways (edges) and variable importance (centrality) to uncovering dimensionality (community) and group differences (network similarity).Valid inferences at each level depends on the accuracy of network estimation methods, yet simulation studies have focused almost exclusively on edge recovery using data generating mechanisms that lack known community structures.In this large-scale simulation study, we evaluated four network estimation methods (EBICglasso variants, ggmModSelect, GGMncv, GGMnonreg) across four levels of analysis using stochastic block models with empirically informed edge weight distributions derived from 293 empirical networks in psychology.For most levels, large samples ($1,000) were necessary for adequate recovery, echoing concerns about sufficient evidence for inferences drawn by many published studies.The EBICglasso variants outperformed the other methods in smaller samples (#1,000) and dichotomous data; however, these conditions demonstrated inadequate recovery across methods (including EBICglasso).Most methods achieved adequate accuracy in larger samples ($2,500) and continuous data.Centrality accuracy varied substantially: Network loadings were reliably recovered across all conditions whereas bridge strength was unreliable even under ideal conditions.For node and bridge strength, we recommend reporting raw values rather than rankings, as rank-order recovery required substantially larger samples.We also established interpretation benchmarks for network similarity metrics (s F and Jensen-Shannon similarity) and found community detection to be robust except under challenging conditions (small samples and dichotomous data).Collectively, these findings provide concrete, level-specific guidance for method and measure selection based on sample size and data categories.
Source: Psychological Methods
DOI: 10.1037/met0000853
Authors: Alexander P. Christensen, Jeongwon Choi
Institution: Vanderbilt University
Language: English
Subfield: Experimental and Cognitive Psychology
Field: Psychology
Domain: Social Sciences
Open Access status: hybrid
OpenAlex ID: W7169168000
FWCI:
Cites:
Cited by:
Related to: