Internal Consistency of the Five Reduced Markers of Hauck and Collaborators: A Re-Analysis
DOI:
https://doi.org/10.1590/0102.3772e37522Keywords:
Reliability, Big Five, Measurement error, Alpha coefficientAbstract
The purpose of this letter is to present commentary on the internal consistency estimates (Alpha; Cronbach, 1951) obtained in the study by Hauck, de Lara, Pereira and Ruschel (2012) towards the validation of the five Big Five Personality factors in Brazil (Hutz et al., 1998). This new information may have a critical impact on the psychometric conclusions drawn by the authors, since measurement error should always be taken into account when evaluating the equivalence between test forms. The authors state that the levels of internal consistency obtained from the reliability coefficients varied from reasonable to satisfactory in magnitude; however, they did not put any emphasis on the fact that the variance in magnitude of these coefficients suggests that they cannot be considered homogeneous, nor that different amounts of measurement error are present in subscale scores. The present critique involves two types of measurement precision: of the scores of the five reduced scales examined, and the precision of the Alpha coefficient.
References
Cronbach, L. J. (1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16(3), 297–334. doi: 10.1007/bf02310555.
Dominguez-Lara, S., & Merino-Soto, C. (2015). ¿Por qué es importante reportar los intervalos de confianza del coeficiente alfa de Cronbach? Revista Latinoamericana de Ciencias Sociales, Niñez y Juventud, 13(2), 1326-1327.
Feldt, L. S. (1965). The approximate sampling distribution of Kuder-Richardson reliability coefficient twenty. Psychometrika, 30(3), 357–370. doi: 10.1007/bf02289499
Feldt, L. S., Woodruff, D. J., & Salih, F. A. (1987). Statistical Inference for Coefficient Alpha. Applied Psychological Measurement, 11(1), 93–103. doi:10.1177/014662168701100107
Foxcroft, C., & Roodt, G. (2013). Introduction to psychological assessment in the South African context (4th ed.). Cape Town: Oxford University Press.
Han, J., Bao, L., Chen, L., Cai, T., Pi, Y., Zhou, S., Tu, Y., & Koenig, K. (2015). Dividing the Force Concept Inventory into two equivalent half-length tests. Physical Review Special Topics - Physics Education Research, 11(1), 1-9. doi: 10.1103/PhysRevSTPER.11.010112.
Hauck, N., de Lara, W., Pereira, M., & Ruschel, D. (2012). Evidências de validade de marcadores reduzidos para a avaliação da personalidade no modelo dos cinco grandes fatores. Psicologia: Teoria e Pesquisa, 28(4), 417-423. doi:10.1590/S0102-37722012000400007
Holland, P. W., & Dorans, N. J. (2006). Linking and equating. In R. L. Brennan (Ed.), Educational measurement (4th ed.). Westport, CT: ACE/Praeger.
Holland, P. W., Dorans, N. J., & Petersen, N. S. (2007). Equating test scores. In C. R. Rao, & S. Sinharay (Eds.), Handbook of statistics (Vol. 26: Psychometrics; pp. 169-204). London: Elsevier. doi: 10.1016/S0169-7161(06)26006-1.
Hutz, C. S., Nunes, C. H. S. S., Silveira, A. D., Serra, J., Anton, M., & Wieczorek, L. S. (1998). The development of the big five markers for personality assessment in Brazil. Psicologia: Reflexão e Crítica, 11, 395-411. doi: 10.1590/S0102-79721998000200015
Kelley, K., & Lai, K. (2012). MBESS. (R package version 3.3.3). Retrieved from http://CRAN.R-project.org/package=MBESS.
Kolen, M. J. (2006). Scaling and norming. In R. L. Brennan (Ed.), Educational measurement (4th ed.). Westport, CT: ACE/Praeger.
Kolen, M. J., & Brennan, R. L. (2004). Test equating, linking and scaling: Methods and practices (2nd ed.). New York: Springer-Verlag. doi: 10.1007/978-1-4757-4310-4
Kristof, W. (1963). The statistical theory of stepped-up reliability coefficients when a test has been divided into several equivalent parts. Psychometrika, 28, 221–238. doi: 10.1007/BF02289571.
Lautenschlager, G. J., & Meade, A. W. (2008). AlphaTest: A Windows program for tests of hypotheses about coefficient alpha. Applied Psychological Measurement, 32, 502-503. doi: 10.1177/0146621607312307
Merino, C., & Lautenschlager, G. (2003). Comparación estadística de la confiabilidad alfa de Cronbach: aplicaciones en la medición educacional. Revista de Psicología de la Universidad de Chile, 12(2), 129-139.
Revelle, W. (2015). psych: Procedures for personality and psychological research. (R package versión 1.5.8). Retrieved from http://CRAN.R-project.org/package=psych
Revelle, W., & Zinbarg, R. E. (2008). Coefficients alpha, beta, omega and the glb: comments on Sijtsma. Psychometrica, 74(1), 145-154. doi: 10.1007/s11336-008-9102-z
Reynolds, C. R. (2000). Methods for detecting and evaluating cultural bias in neuropsychological tests. En S. Fletcher-Janzen, L. S. Strickland & C. R. Reynolds (Eds.), Handbook of Cross-Cultural Neuropsychology (pp. 249-285). New York: Kluwer Academiz / Plenum Publishers. doi: 10.1007/978-1-4615-4219-3_15.
Widaman, K. F., Little, T. D., Preacher, K. J., & Sawalani, G. M. (2011). On creating and using short forms of scales in secondary research. In K. H. Trzesniewski, M. B. Donnellan, & R. E. Lucas (Eds.), Secondary data analysis: An introduction for psychologists (pp. 39-61). Washington, DC: APA. doi: 10.1037/12350-003.
Zinbarg, R. E., Revelle, W., Yovel, I., & Li, W. (2005). Cronbach’s a, Revelle’s ß, and McDonald’s wH: Their relations with each other and two alternative conceptions of reliability. Psychometrica, 70(1), 123-133. doi: 10.1007/s11336-003-0974-7
Zinbarg, R. E., Yovel, I., Revelle, W., & McDonald, R. P. (2006). Estimating generalizability to a latent variable common to all of a scale’s indicators: A comparison of estimators for omega_h. Applied Psychological Measurement, 30(2), 121-144. doi: 10.1177/0146621605278814
Downloads
Published
Issue
Section
License
Copyright (c) 2021 César Merino Soto, Conrad Stanislaw Zygmont
This work is licensed under a Creative Commons Attribution 4.0 International License.
