Bifactor and other hierarchical models [in factor analysis] have become central to representing and explaining observations in psychopathology, health, and other areas of clinical science, as well as in the behavioral sciences more broadly. This prominence comes after a relatively rapid period of rediscovery, however, and certain features remain poorly understood.
Here, hierarchical models are compared and contrasted with other models of superordinate structure, with a focus on implications for model comparisons and interpretation. Issues pertaining to the specification and estimation of bifactor and other hierarchical models are reviewed in exploratory as well as confirmatory modeling scenarios, as are emerging findings about model fit and selection.
Bifactor and other hierarchical models provide a powerful mechanism for parsing shared and unique components of variance, but care is required in specifying and making inferences about them.
[Keywords: hierarchical model, higher order, bifactor, model equivalence, model complexity]
Figure 1: Hierarchical and related models. (a) Spearman’s (Spearman1904a, Spearman1904b) 2-factor model, a precursor to hierarchical and bifactor models. The 2-factor model includes a general factor (G) as well as systematic specific factors (S) and random error factors (e). As originally formulated, Spearman’s 2-factor model cannot be estimated, but it established the idea of a superordinate general factor plus subordinate specific factors that account for systematic residual influences not accounted for by the general factor. (b) The hierarchical or bifactor model, which includes superordinate general factors (G) as well as subordinate specific factors (S); error factors are not shown. Bifactor models are a subtype of hierarchical model with one superordinate factor and multiple subordinate factors. The 2-factor model and hierarchical model are examples of top-down models, in that subordinate factors instantiate residual effects that are unexplained by the superordinate factor.
Although bifactor and other hierarchical models are now commonplace, this was not always so. Their current ubiquity follows a long period of relative neglect (Reise2012), having been derived in the early 20th century (Holzinger & Harman1938, Holzinger & Swineford1937) before being somewhat overlooked for a number of decades and then being rediscovered more recently. Bifactor models were mistakenly dismissed as equivalent to and redundant with other superordinate structural models (eg. Adcock1964, Humphreys1981, Wherry1959, Reise2012, Yunget al1999); as differences between bifactor models and other types of superordinate structural models became more recognized (Yung et al 199925ya), interest in bifactor models reemerged.
…Summary Points:
Bifactor and other hierarchical models represent superordinate structure in terms of orthogonal general and specific factors representing distinct, non-nested components of shared variance among indicators. This contrasts with higher-order models, which represent superordinate structure in terms of specific factors that are nested in general factors, and correlated-factors models, which represent superordinate structure in terms of correlations among subordinate factors.
Higher-order models can be approached as a constrained form of hierarchical models, in which direct relationships between superordinate factors and observed variables in the hierarchical model are constrained to equal the products of superordinate-subordinate paths and subordinate-observed variable paths.
Multiple exploratory factor analytic approaches to the delineation of hierarchical structure are available, including rank-deficient transformations, analytic rotations, and targeted rotations. Among other things, these transformations and rotations differ in the number of factors being rotated, the nature of those factors, and how superordinate factor structures are approximated.
Misspecification or under-specification of confirmatory bifactor and hierarchical models can occur for multiple reasons. Problems with model identification may occur (1) with specific patterns of homogeneity in estimated or observed covariances, (2) if factors are allowed to correlate in inadmissible ways, or (3) if covariate paths imply inadmissible correlations. Signs of model misspecification may be evident in anomalous estimates, such as loading estimates near boundaries, or estimates that are suggestive of other types of models.
Common model fit statistics can overstate the fit of bifactor models due to the tendency of bifactor and other hierarchical models to overfit to data in general, regardless of plausibility or population structure. Hierarchical models are similar to exploratory factor models in their expansiveness of fit, and, in general, they are more expansive in fit than other confirmatory models.
Future Issues:
Research is needed to determine how to best account for the flexibility of hierarchical models when comparing models and evaluating model fit, given that the relative flexibility of hierarchical models can only partly be accounted for by the number of parameters. Approaches based on minimum description length and related paradigms, such as Bayesian inference with reference priors, are promising in this regard.
More research is needed to clarify the properties of hierarchical structures when they are embedded in longitudinal models and models with covariates. As with challenges of multicollinearity in regression, parsing unique general and specific factor components of explanatory paths may be inferentially challenging in the presence of strongly related predictors, covariates, and outcomes.
More can be learned about the specification and identification of hierarchical models and the relationships between hierarchical models and other types of models, such as exploratory factor models. Similarities in overfitting patterns between exploratory and hierarchical models, approaches to hierarchical structure through bifactor rotations, and patterns of anomalous estimates that are sometimes obtained with hierarchical models, point to important relationships between exploratory and hierarchical models. Further explication of model specification principles with hierarchical models would also help clarify the appropriate structures to consider when evaluating models.