PARAFAC: Parallel factor analysis

https://doi.org/10.1016/0167-9473(94)90132-5Get rights and content

Abstract

We review the method of Parallel Factor Analysis, which simultaneously fits multiple two-way arrays or ‘slices’ of a three-way array in terms of a common set of factors with differing relative weights in each ‘slice’. Mathematically, it is a straightforward generalization of the bilinear model of factor (or component) analysis (xij = ΣRr = 1airbjr) to a trilinear model (xijk = ΣRr = 1airbjrckr). Despite this simplicity, it has an important property not possessed by the two-way model: if the latent factors show adequately distinct patterns of three-way variation, the model is fully identified; the orientation of factors is uniquely determined by minimizing residual error, eliminating the need for a separate ‘rotation’ phase of analysis. The model can be used several ways. It can be directly fit to a three-way array of observations with (possibly incomplete) factorial structure, or it can be indirectly fit to the original observations by fitting a set of covariance matrices computed from the observations, with each matrix corresponding to a two-way subset of the data. Even more generally, one can simultaneously analyze covariance matrices computed from different samples, perhaps corresponding to different treatment groups, different kinds of cases, data from different studies, etc. To demonstrate the method we analyze data from an experiment on right vs. left cerebral hemispheric control of the hands during various tasks. The factors found appear to correspond to the causal influences manipulated in the experiment, revealing their patterns of influence in all three ways of the data. Several generalizations of the parallel factor analysis model are currently under development, including ones that combine parallel factors with Tucker-like factor ‘interactions’. Of key importance is the need to increase the method's robustness against nonstationary factor structures and qualitative (nonproportional) factor change.

References (62)

  • J.D. Carroll et al.

    CANDELING: A general approach to multidimensional analysis of many-way arrays with linear constraints on parameters

    Psychometrika

    (1980)
  • R.B. Cattell

    Parallel Proportional Profiles’ and other principles for determining the choice of factors by rotation

    Psychometrika4l

    (1944)
  • R.B. Cattell et al.

    Factor rotation for proportional profiles: Analytical solution and an example

    British Journal of Statistical Psychology

    (1955)
  • J. DeLeeuw et al.

    A new computational method to fit the weighted Euclidean distance model

    Psychometrika

    (1978)
  • P. Diaconis et al.

    Computer-intensive methods in statistics

    Scientific American

    (1983)
  • P. Diaconis et al.

    Computer-intensive methods in statistics

    Scientific American

    (1983)
  • P. Diaconis et al.

    Computer-intensive methods in statistics

    Scientific American

    (1983)
  • T.R. Dunn et al.

    A multidimensional scaling model for the size-weight illusion

    Psychometrika

    (1982)
  • B. Efron

    The jacknife, the bootstrap and other resampling plans

    The Society for Industrial and Applied Mathematics Monographs

    (1982)
  • A.S. Field et al.

    Topographic component (parallel factor) analysis of multichannel evoked potentials: Practical issues in trilinear spatiotemporal decomposition

    Brain Topography

    (1991)
  • E. Hampson et al.

    Hand movement asymmetries during verbal and nonverbal tasks

    Canadian Journal of Psychology

    (1984)
  • R.A. Harshman

    Foundations of the PARAFAC procedure

  • R.A. Harshman

    Determination and proof of minimum uniqueness conditions for PARAFAC1

  • R.A. Harshman et al.

    An application of PARAFAC to a small sample problem, demonstrating preprocessing, orthogonality constraints, and split-half diagnostic techniques

  • R. Harshman et al.

    Factor analysis of tongue shapes

    Journal of the Acoustical Society of America

    (1977)
  • R.A. Harshman et al.

    The PARAFAC model for three-way factor analysis and multidimensional scaling

  • R.A. Harshman et al.

    Data preprocessing and the extended PARAFAC model

  • R.A. Harshman et al.

    Oblique and still unique? Applying parallel profiles in more general models for factor analysis and multidimensional scaling

    (1991)
  • R.A. Harshman et al.

    Three-way DEDICOM: Analyzing multiple matrices of asymmetric relationships

    (1992)
  • C.B. Horan

    Multidimensional scaling: Combining observations when individuals have different perceptual structures

    Psychometrika

    (1969)
  • J.R. Kettenring

    A case study in data analysis

  • Cited by (430)

    View all citing articles on Scopus
    View full text