More Web Proxy on the site http://driver.im/

article

Lower bounds on sample size in structural equation modeling

Author:

J. Christopher WestlandAuthors Info & Claims

Electronic Commerce Research and Applications, Volume 9, Issue 6

Pages 476 - 487

https://doi.org/10.1016/j.elerap.2010.07.003

Published: 01 November 2010 Publication History

Abstract

Computationally intensive structural equation modeling (SEM) approaches have been in development over much of the 20th century, initiated by the seminal work of Sewall Wright. To this day, sample size requirements remain a vexing question in SEM based studies. Complexities which increase information demands in structural model estimation increase with the number of potential combinations of latent variables; while the information supplied for estimation increases with the number of measured parameters times the number of observations in the sample size - both are non-linear. This alone would imply that requisite sample size is not a linear function solely of indicator count, even though such heuristics are widely invoked in justifying SEM sample size. This paper develops two lower bounds on sample size in SEM, the first as a function of the ratio of indicator variables to latent variables, and the second as a function of minimum effect, power and significance. The algorithm is applied to a meta-study of a set of research published in five of the top MIS journals. The study shows a systematic bias towards choosing sample sizes that are significantly too small. Actual sample sizes averaged only 50% of the minimum needed to draw the conclusions the studies claimed. Overall, 80% of the research articles in the meta-study drew conclusions from insufficient samples. Lacking accurate sample size information, researchers are inclined to economize on sample collection with inadequate samples that hurt the credibility of research conclusions. Guidelines are provided for applying the algorithms developed in this study, and companion software encapsulating the paper's formulae is made available for download.

References

[1]

}}Origins of the limited information maximum likelihood and two-stage least squares estimators. Journal of Econometrics. v127. 1-16.

[2]

}}Estimator of the parameters of a single equation in a complete system of stochastic equations. Annals of Mathematical Statistics. v20. 46-63.

[3]

}}The asymptotic properties of estimates of the parameters of a single equation in a complete system of stochastic equations. Annals of Mathematical Statistics. v21. 570-582.

[4]

}}Balakrishnan, N., and Rao, C. R. Order Statistics: Applications, ser. Handbook of Statistics, Vol. 17, Elsevier, New York, 1998.

[5]

}}The partial least squares (PLS) approach to causal modeling: personal computer adaptation and use as an illustration. Technology Studies. v2 i2. 285-309.

[6]

}}A generalized classical method of linear estimation of coefficients in a structural equation. Econometrica. v25. 77-83.

[7]

}}Bentler, P. M. EQS, Structural Equations, Program Manual, Program Version 3.0, BMDP Statistical Software, Inc., Los Angeles, 1989, 6.

[8]

}}Structural Equations with Latent Variables. Wiley, New York.

[9]

}}Robustness of LISREL against small sample sizes in factor analysis models. In: Jöreskog, K.G., Wold, H. (Eds.), Systems under Indirect Observations, Causality, Structure, Prediction (Part 1), North Holland, Amsterdam. pp. 149-173.

[10]

}}Accuracy of effect size estimates from published psychological research. Perceptual and Motor Skills. v106 i2. 645-649.

[11]

}}Single sample cross-validation indices for covariance structures. Multivariate Behavioral Research. v24. 445-455.

[12]

}}Alternative ways of assessing model fit. In: Bollen, K.A., Long, J.S. (Eds.), Testing Structural Equation Models, Sage, Newbury Park, CA. pp. 116-136.

[13]

}}Cattell, R. B. Handbook of Multivariate Experimental Psychology, Rand McNally Chicago, 1966.

[14]

}}Chin, W. W. The partial least squares approach to structural equation modeling. In G. A. Marcoulides (ed.), Modern Methods for Business Research, Lawrence Erlbaum Associates, Mahwah, NJ, 1998, 295-336.

[15]

}}Structural equation modeling analysis with small samples using partial least squares. In: Hoyle, Rick (Ed.), Statistical Strategies for Small Sample Research, Sage Publications. pp. 307-341.

[16]

}}Sampling Techniques. 3rd edition. Wiley, New York.

[17]

}}Statistical Power Analysis for the Behavioral Sciences. 2nd edition. Lawrence Erlbaum Associates.

[18]

}}A power primer. Psychological Bulletin. v112. 155-159.

[19]

}}User acceptance of computer technology: a comparison of two theoretical models. Management Science. v35 i8. 982-1003.

[20]

}}Econometrics - Statistical Foundations and Applications. Harper & Row, New York, Evanston and London.

[21]

}}Distributed Lags: Problems of Estimation and Formulation. Holden Day, San Francisco.

[22]

}}A comparison of some limited information estimators for dynamic simultaneous equations models with autocorrelated errors. Econometrica. v42 i2. 311-332.

[23]

}}The effects of estimation methods, number of indicators per factor and improper solutions on structural equation modeling fit indices. Structural Equation Modeling. v2. 119-144.

[24]

}}Fitting Linear Relationships: A History of the Calculus of Observations 1750-1900. Springer, New York.

[25]

}}Fèhèr, K. Comparison of LISREL and PLS estimation methods in latent variable models. Introducing latent variables into econometric models, Manuscript SFB 303, University of Bonn, Bonn, 1989.

[26]

}}On the 'probable error' of a coefficient of correlation deduced from a small sample. Metron. v1. 3-32.

[27]

}}Statistical Methods, Experimental Design, and Scientific Inference. Oxford University Press, New York.

[28]

}}Evaluating structural equation models with unobservable variables and measurement error. Journal of Marketing Research. v18. 39-50.

[29]

}}As others see us: a case study in path analysis (with discussion). Journal of Educational Statistics. v12. 101-223.

[30]

}}The effects of sampling error and model characteristics on parameter estimation for maximum likelihood confirmatory factor analysis. Multivariate Behavioral Research. v20. 255-271.

[31]

}}Interpreting the likelihood of ratio statistic in factor models when sample size is small. Journal of American Statistical Association. v75. 133-137.

[32]

}}Nonparametric Statistical Inference. 3rd edition. Marcel Dekker, New York.

[33]

}}Goodhue, Lewis, D. William, and Thompson, Ron. PLS, small sample size, and statistical power in MIS research, HICSS. In Proceedings of the 39th Annual Hawaii International Conference on System Sciences (HICSS'06), Vol. 8, 2006, 202b.

Digital Library

[34]

}}Statistical power in analyzing interaction effects: questioning the advantage of PLS with product indicators (research note). Information Systems Research. v18 i2. 211-227.

[35]

}}The statistical implications of a system of simultaneous equations. Econometrica. v11. 1-12.

[36]

}}Correlation estimation using concomitants of order statistics from bivariate normal samples. Communications in Statistics - Theory and Methods. v38 i12. 2003-2015.

[37]

}}A class of statistics with asymptotically normal distribution. The Annals of Mathematical Statistics. v19. 293-325.

[38]

}}Some contributions to maximum likelihood factor analysis. Psychometrika. v32 i4. 443-482.

[39]

}}A general method for analysis of covariance structures. Biometrika. v57. 239-251.

[40]

}}Jöreskog, K. G., and Sörbom, D. LISREL 8 User's Reference Guide, Scientific Software International, Chicago, 1996.

[41]

}}Exploring the core concepts of media richness theory: the impact of cue multiplicity and feedback immediacy on decision quality. Journal of Management Information Systems. v20 i1. 263-299.

Digital Library

[42]

}}Rank Correlation Methods. 5th edition. Oxford University Press, New York.

[43]

}}Survey Sampling. Wiley, New York.

[44]

}}The estimation of simultaneous linear economic relationships. In: Hood, W., Koopmans, T. (Eds.), Cowles Foundation Monograph, Vol. 14. Yale University Press, New Haven.

[45]

}}Sampling: Design and Analysis. Duxbury.

[46]

}}Correlation and Dependence. Imperial College Press, London, UK.

[47]

}}Confirmatory factor analyses of multitrait-multimethod data: a comparison of alternative models. Applied Psychological Measurement. v15 i1. 47-70.

[48]

}}Goodness of fit indexes in confirmatory factor analysis: the effect of sample size. Psychological Bulletin. v103. 391-410.

[49]

}}An evaluation of incremental fit indices: A clarification of mathematical and empirical properties. In: Marcoulides, G.A., Schumacker, R.E. (Eds.), Advanced Structural Equation Modeling: Issues and Techniques, Lawrence Erlbaum Associates, Inc., Mahwah, NJ. pp. 315-353.

[50]

}}Is more ever too much? The number of indicators per factor in confirmatory factor analysis. Multivariate Behavioral Research. v33. 181-220.

[51]

}}Effect size, confidence interval and statistical significance: a practical guide for biologists. Biological Reviews Cambridge Philosophical Society. v82. 591-605.

[52]

}}Psychometric Theory. McGraw-Hill, New York.

[53]

}}Self-reports in organization research: problems and prospects. Journal of Management. v12. 531-544.

[54]

}}Estimation of economic relationships using instrumental variables. Econometrica. v67. 557-586.

[55]

}}A measure of association based on Gini's mean difference. Communications in Statistics - Theory and Methods. v16. 207-231.

[56]

}}Models with latent variables: LISREL versus PLS. Contemporary Mathematics. v112. 33-40.

[57]

}}Models with latent variables: LISREL versus PLS. Statistica Neerlandica. v45. 145-157.

[58]

}}Consistency at large in models with latent variables. In: Hagen, K., Barthdomew, D.J., Deistler, M. (Eds.), Statistical Modelling and Latent Variables, Elsevier. pp. 299-320.

[59]

}}Shevlyakov, G. L., and Vilchevski, N. O. Robustness in Data Analysis: Criteria and Methods, ser. Modern Probability and Statistics, VSP, Utrecht, The Netherlands, 2002.

[60]

}}Snedecor, and Cochran. Statistical Methods, 8th edition. Iowa University Press, Ames, 1989.

[61]

}}. Kendall's Advanced Theory of Statistics, 1991.5th edition. Edward Arnold, London.

[62]

}}"How big is big enough?": sample size and goodness of fit in structural equation models with latent variables. Child Development. v58. 134-146.

[63]

}}Repeated Least-squares Applied to a Complete Equation Systems. Central Planning Bureau, The Hague.

[64]

}}Estimation and Simultaneous Correlation in Complete Equation Systems. Central Planning Bureau, The Hague.

[65]

}}Economic Forecasts and Policy. 2nd edition. North Holland, Amsterdam.

[66]

}}Thomas, D. R., Lu, I. R. R., and Cedzynski, M. Partial least squares: A critical review and a potential alternative. In Proceedings of the Annual Conference of Administrative Sciences Association of Canada, Management Science Division, Toronto, 2005.

[67]

}}Effects of variable and subject sampling on factor pattern recovery. Psychological Methods. v3. 231-251.

[68]

}}The short-run price-performance dynamics of microcomputer technologies. Research Policy. v36 i5. 591-604.

[69]

}}APA task force on statistical inference statistical methods in psychology journals: guidelines and explanations. American Psychologist. v54. 594-604.

[70]

}}The fix-point approach to interdependent systems: review and current outlook. In: Wold, H. (Ed.), The Fix-Point Approach to Interdependent Systems, North Holland, Amsterdam. pp. 1-35.

[71]

}}Response to D.A. Freedman. Journal of Educational Statistics. v12 i2. 202-205.

[72]

}}Correlation and causation. Journal of Agricultural Research. v20. 557-585.

[73]

}}Asymptotic mean and variance of Gini correlation for bivariate normal samples. IEEE Transactions on Signal Processing. v58 i2.

Cited By

Jalo HPirkkalainen H(2024)Effect of user resistance on the organizational adoption of extended reality technologiesInternational Journal of Information Management: The Journal for Information Professionals10.1016/j.ijinfomgt.2023.10273175:COnline publication date: 1-Apr-2024
https://dl.acm.org/doi/10.1016/j.ijinfomgt.2023.102731
Dinh CPark S(2024)How to increase consumer intention to use Chatbots? An empirical analysis of hedonic and utilitarian motivations on social presence and the moderating effects of fear across generationsElectronic Commerce Research10.1007/s10660-022-09662-524:4(2427-2467)Online publication date: 1-Dec-2024
https://dl.acm.org/doi/10.1007/s10660-022-09662-5
Ramtiyal BVerma DRathore A(2024)Role of risk perception and situational factors in mobile payment adoption among small vendors in unorganised retailElectronic Commerce Research10.1007/s10660-022-09657-224:4(2693-2731)Online publication date: 1-Dec-2024
https://dl.acm.org/doi/10.1007/s10660-022-09657-2
Show More Cited By

Recommendations

Virtual teamwork training: factors influencing the acceptance of collaboration technology

The purpose of this study was to identify the factors that influence the acceptance of electronic collaboration technology by higher education students and that influence their predicted usage of the technology for virtual team collaboration. The ...
Determinants of Repurchase Intention in C2C E-Commerce: Customers' Perspectives of Merchants and Platform Providers

In order to create a thriving c2c e-commerce environment, it is imperative for c2c e-commerce companies as well as merchants within to fully understand the factors that persuade existing customers to make repeat purchases. This article distinguishes ...
What people do with digital multimedia broadcasting? Path analysis of structural equation modelling

Drawing from the uses and gratifications theory, this study explores the influences of informativeness, entertainment and interactivity on the Digital Multimedia Broadcasting (DMB) user dimensions such as attitude, usage, and satisfaction. Particularly, ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Electronic Commerce Research and Applications

Electronic Commerce Research and Applications Volume 9, Issue 6

November, 2010

105 pages

ISSN:1567-4223

Issue’s Table of Contents

Copyright © Elsevier B.V. © 2010.

Publisher

Elsevier Science Publishers B. V.

Netherlands

Publication History

Published: 01 November 2010

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

46
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 08 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Jalo HPirkkalainen H(2024)Effect of user resistance on the organizational adoption of extended reality technologiesInternational Journal of Information Management: The Journal for Information Professionals10.1016/j.ijinfomgt.2023.10273175:COnline publication date: 1-Apr-2024
https://dl.acm.org/doi/10.1016/j.ijinfomgt.2023.102731
Dinh CPark S(2024)How to increase consumer intention to use Chatbots? An empirical analysis of hedonic and utilitarian motivations on social presence and the moderating effects of fear across generationsElectronic Commerce Research10.1007/s10660-022-09662-524:4(2427-2467)Online publication date: 1-Dec-2024
https://dl.acm.org/doi/10.1007/s10660-022-09662-5
Ramtiyal BVerma DRathore A(2024)Role of risk perception and situational factors in mobile payment adoption among small vendors in unorganised retailElectronic Commerce Research10.1007/s10660-022-09657-224:4(2693-2731)Online publication date: 1-Dec-2024
https://dl.acm.org/doi/10.1007/s10660-022-09657-2
Altan BYorulmaz AKaralar H(2024)Modelling primary school teachers’ acceptance of distance-based educational technologies: A post-pandemic perspectiveEducation and Information Technologies10.1007/s10639-024-12509-129:13(16499-16523)Online publication date: 12-Feb-2024
https://dl.acm.org/doi/10.1007/s10639-024-12509-1
El-Hamamsy LMonnier EAvry SChevalier MBruno BDehler Zufferey JMondada F(2024)Modelling the sustainability of a primary school digital education curricular reform and professional development programEducation and Information Technologies10.1007/s10639-023-11653-429:3(2857-2904)Online publication date: 1-Feb-2024
https://dl.acm.org/doi/10.1007/s10639-023-11653-4
Piriyakul IPiriyakul MPiriyakul RNambuddee N(2023)The Evidence of a Thai Restaurant's Mass Customization Implementation for Firm Survival During the Pandemic CrisisInternational Journal of Asian Business and Information Management10.4018/IJABIM.32379714:1(1-19)Online publication date: 5-Jun-2023
https://dl.acm.org/doi/10.4018/IJABIM.323797
Hernandez-Bocanegra DZiegler J(2023)Explaining Recommendations through Conversations: Dialog Model and the Effects of Interface Type and Degree of InteractivityACM Transactions on Interactive Intelligent Systems10.1145/357954113:2(1-47)Online publication date: 12-Apr-2023
https://dl.acm.org/doi/10.1145/3579541
Stevens AStetson P(2023)Theory of trust and acceptance of artificial intelligence technology (TrAAIT)Journal of Biomedical Informatics10.1016/j.jbi.2023.104550148:COnline publication date: 1-Dec-2023
https://dl.acm.org/doi/10.1016/j.jbi.2023.104550
Westland J(2023)PLS PapersElectronic Commerce Research10.1007/s10660-023-09749-723:3(1361-1366)Online publication date: 30-Aug-2023
https://dl.acm.org/doi/10.1007/s10660-023-09749-7
Wang M(2022)Encouraging solvers to sustain participation intention on crowdsourcing platforms: an investigation of social beliefsInformation Technology and Management10.1007/s10799-021-00340-w23:1(39-50)Online publication date: 1-Mar-2022
https://dl.acm.org/doi/10.1007/s10799-021-00340-w
Show More Cited By

View Options

View options

Figures

Tables

Media

View Issue’s Table of Contents