Journal of the Korea Society of Computer and Information (한국컴퓨터정보학회논문지)

Korean Society of Computer Information (한국컴퓨터정보학회)
권호 표지
DOI QR코드

DOI QR Code

Permutation Analysis of Split-Half Reliability Coefficient

  • Um, Yonghwan (Division of Industrial and Management Engineering, Sungkyul University)
  • Received : 2017.05.28
  • Accepted : 2017.07.04
  • Published : 2017.07.31
Download PDF
⟨ Previous Next ⟩

Abstract

In this paper, we describe a permutation procedure in which we compute a resampling probability value and empirical quantile limits for Split-Half measure of internal reliability. We use the Split-Half reliability coefficient given by two simple methods, the Spearman-Brown formula and the two-part coefficient alpha. The use of a permutation test for Split-Half reliability coefficient is highlighted as a valuable tool when the sample sizes are small and necessary assumptions cannot be met. The permutation tests for Split-Half reliability coefficient are illustrated with an example analysis of two survey data with a sample size of 15 and 35, respectively, and a hypothetical data with a sample size of 5.

Keywords

References

  1. C. Spearman, Correlations calculated from faulty data, British Journal of Psychology, Vol. 3, pp. 271-295, 1910.
  2. R. A. Charter, Note on the underrepresentation of the split-half reliability formula for unequal standard deviations, Perceptual and Motor Skills, Vol. 82, pp401-402, 1996. https://doi.org/10.2466/pms.1996.82.2.401
  3. P. J. Rulon, A simplified procedure for determining the reliability of a test by split halves, Harvard Educational Review, Vol. 9, 99-103, 1939.
  4. R. A. Charter, Testing the difference between two or more independent alpha coefficients: an example, Perceptual and Motor Skills, Vol. 84, pp. 464-466, 1997. https://doi.org/10.2466/pms.1997.84.2.464
  5. R. A. Fisher, A design of experiment, Oliver & Boyd, Edinburgh, 1935.
  6. P. W. Mielke Jr. and K. J. Berry, Permutation methods: a distance function approach. (2nd ed.) New York: Springer-Verlag, 2007.
  7. J. E. Johnston, K. J. Berry, and P. W. Mielke, Permutation tests: precision in estimating probability values., Perceptual and Motor Skills, Vol. 105, pp. 915-920, 2007. https://doi.org/10.2466/pms.105.3.915-920
  8. R. A. Charter, Confidence Interval formulas for split-half reliability coefficients, Perceptual and Motor Skills, Vol. 86, pp. 1168-1170, 2000.
  9. J. H. Zar, Biostatistical Analysis. (2nd ed.), Englewood Cliffs, NJ: Prentice-Hall, 1984.
  10. W. Kristof, On the sampling theory of reliability estimation, Journal of Mathematical Psychology, Vol. 7, 371-377, 1970. https://doi.org/10.1016/0022-2496(70)90054-4
  11. A. J. Prelog, K. J. Berry and P. W. Mielke, Resampling permutation probability values forCronbach's alpha, Perceptual and Motor Skills, Vol. 108, pp. 431-438, 2009. https://doi.org/10.2466/pms.108.2.431-438
  12. H. Levenson, Differentiating among internality, powerful others, and chance. In H. M. Lefcourt (Ed.), Research with the locus of control construct, Vol. 1, New York: Academic Press, pp. 15-63, 1981.
  13. M. H. Huh, SPSS Questionnaire Survey Methods: from Basic to Practical Use. Hannnare Publishing Col, 2010.