| Peer-Reviewed

Classification of Some Test of Normality Techniques into UMP and LMP Using Monte Carlo Simulation Technique

Received: 29 September 2021    Accepted: 24 August 2022    Published: 29 May 2023
Views:       Downloads:
Abstract

In Statistics, test of normality is of great importance and cannot be neglected in statistical analysis. However, there exist many techniques for such analysis and researchers usually face with the choice of test. From the literature, it has been established that power of test of normality vary significantly based on sample sizes. In this study, seven normality tests were reviewed and the classification into LMP and UMP were based on Power-of-Test. The test of hypothesis was done at 5% level of significance. The tests considered as; Shapiro-Wilk, Anderson-Darling, Bonett-Serial, Robust Jarque-Bera, Skewness, Lilliefors and Kurtosis tests. The sample sizes considered are 10, 20, 50 and 100 with 1000 replicates. Simulation was done from 3 distributions namely, normal, gamma and beta distributions. It was found that all methods were stronger for the detection of normality when normal distribution was used but the variation in their power was obvious when non-normal distributions were used. Among the methods, only three can be referred to as UMP while the rest are LMP. The UMP methods are Shapiro-Wilk, Anderson-Darling and Lilliefors as their Power-of-Test was not affected by sample sizes.

Published in Mathematics Letters (Volume 9, Issue 1)
DOI 10.11648/j.ml.20230901.12
Page(s) 8-17
Creative Commons

This is an Open Access article, distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution and reproduction in any medium or format, provided the original work is properly cited.

Copyright

Copyright © The Author(s), 2024. Published by Science Publishing Group

Keywords

Distributions, Simulation, Monte Carlo Techniques, Power-of-Test, Type I Error

References
[1] Abbas M. (2013): Robust Goodness of Fit Test Based on the Forward Search. American Journal of App. Mathematics and Statistics, 2013, Vol. 1, No. 1, 6-10.
[2] Adefisoye J. O, Golam Kibria B. M, George F (2016) Performances of Several Univariate Tests of Normality: An Empirical Study. J Biom Biostat 7: 322. doi: 10.4172/2155-6180.1000322.
[3] Agnieszka W, Robert D. I, Krzysztof B. (2020); Omnibus test for normality based on the Edgeworth expansion. PLoS ONE, vol. 15, no. 6, p. e0233901. Gale OneFile: Health and Medicine.
[4] Anderson, T. W. (1962): On the Distribution of the Two-Sample Cramer–von Mises Criterion. The Annals of Mathematical Statistics (Institute of Mathematical Statistics) 33 (3): 1148–1159. doi: 10.1214/aoms/1177704477. ISSN 0003-4851.
[5] Baghban A. A., Younespour S., Jambarsang S., Yousefi M., Zayeri F., and Jalilian F. A. (2013): How to test normality distribution for a variable: a real example and a simulationstudy. Journal of Paramedical Sciences (JPS). Vol. 4, No. 1 ISSN 2008-4978.
[6] Bruno E. and Norbert H. (2020). Tests for multivariate normality -- a critical review with emphasis on weighted L2-Statistics. arXiv; 2004.07332 Math.ST.
[7] D’Agostino R. B. and Stephens M. A. (1986): Goodness-of-fit techniques. New York, Marcel Dekker.
[8] Derya O., Atilla H. E., and Ersoz T. (2006): Investigation of Four Different Normality Tests in Terms of Type I Error Rate and Power Under Different Distributions. Turk. J. Med. Sci. 2006; 36 (3): 171-176.
[9] Douglas G. B. and Edith S. (2002): A test of normality with high uniform power. Journal of Computational Statistics and Data Analysis 40 (2002) 435–445. www.elsevier.com/locate/csda.
[10] Everitt, B. S. (2006): The Cambridge Dictionary of Statistics. Third Edition. Cambridge University Press, Cambridge, New York, Melbourne, Madrid, Cape Town, Singapore, Sao Paulo. Pp. 240-241.
[11] Farrel P. J and Stewart K. R. (2006): Comprehensive Study of Tests for Normality and Symmetry; Extending the Spiegelhalter Test. Journal of Statistical Computation and Simulation. Vol. 76, No. 9, Pp 803-816.
[12] Felix B. O and Senyo Y. A. (2016); Assessing Univariate and Multivariate Normality, A Guide For Non-Statisticians. Mathematical Theory and Modeling www.iiste.org ISSN 2224-5804 (Paper) ISSN 2225-0522 (Online) Vol. 6, No. 2.
[13] Frain J. C. (2006): Small Sample Power of Tests of Normality when the Alternative is an α –stable distribution. http://www.tcd.ie/Economics/staff/frainj/Stable_D istribution/normal.pdf
[14] Guner B. and Johnson J. T. (2007): Comparison of the Shapiro-Wilk and Kurtosis Tests for the Detection of Pulsed Sinusoidal Radio Frequency Interference. The Ohio State University, Department of Electrical and Computer Engineering and Electro-Science Laboratory, 1320 Kinnear Road, Columbus, OH 43210, USA.
[15] Gupta S. C. (2011): Fundamentals of Statistics. Sixth Revised and Enlarged Edition. Himilaya Publishing House PVT Ltd. Mumbai-400 004. Pp 16. 28-16.31.
[16] Hadi Alizadeh Noughab (2018). A Comprehensive Study on Power of Tests for Normality. Journal of Statistical Theory and Applications, Vol. 17 (4), pp. 647–660. DOI: 10.2991/jsta.2018.17.4.7; ISSN 1538-7887. https://www.atlantis-press.com/journals/jsta
[17] Jarque, C. M. and Bera, A. K. (1980): Efficient tests for normality, homoscedasticity and serial independence of regression residuals. Economics Letters 6 (3): 255–259. doi: 10.1016/0165-1765(80)90024-5.
[18] Jarque, C. M. and Bera, A. K. (1981): Efficient tests for normality, homoscedasticity and serial independence of regression residuals: Monte Carlo evidence. Economics Letters 7 (4): 313–318. doi: 10.1016/0165-1765(81)900235-5.
[19] Jarque, C. M. and Bera, A. K. (1987): A test for normality of observations and regression residuals. International Statistical Review 55 (2): 163–172. JSTOR 1403192.
[20] Jason O. (2002): Notes on the use of data transformations. Practical Assessment, Research & Evaluation, 8 (6). http://PAREonline.net/getvn.asp?v=8&n=6.
[21] Jason O. (2010): Improving your data transformations: Applying the Box-Cox transformation. Practical Assessment, Research & Evaluation, 15 (12). Available online: http://pareonline.net/getvn.asp?v=15&n=12.
[22] Kuiper, N. H. (1960) Tests Concerning Random Points on a Circle. Proceedings of the Koninklijke Nederlandse Akademie van Wetenschappen, Series A, 63, 38-47. https://doi.org/10.1016/S1385-7258(60)50006-0
[23] Lilliefors HW (1967) On the Kolmogorov-Smirnov test for normality with mean and variance unknown. Journal of the American Statistical Association 62: 399-402.
[24] Lobato, Ignacio N. and Velasco, Carlos, (2004). "A Simple Test of Normality for Time Series". Econometric Theory, Cambridge University Press, vol. 20 (4), pages 671-689.
[25] Marmolejo-Ramos F. and Gonza´lez-Burgos J. (2012): A Power Comparison of Various Tests of Univariate Normality on Ex-Gaussian Distributions. European Journal of Research Methods for the Behavioural and Social Sciences. ISSN-Print 1614-1881 ISSN-Online 1614-2241. DOI: 10.1027/1614-2241/a000059. www.hogrefe.com/journals/methodology.
[26] Nasrin Khatun (2021). Applications of Normality Test in Statistical Analysis. Open Journal of Statistics 11 (01): 113-122. DOI: 10.4236/ojs.2021.111006.
[27] Nornadiah M. R. and Yap B. W (2011). Power comparisons of Shapiro-Wilk, Kolmogorov-Smirnov, Lilliefors and Anderson-Darling tests. Journal of Statistical Modeling and Analytics. Vol. 2 No. I, 21-33.
[28] Ralph Henderson (2006). Testing experimental data for univariate normality Clinica Chimica Acta; International Journal of Clinical Chemistry 366 (1-2): 112-29. DOI: 10.1016/j.cca.2005.11.007.
[29] Shapiro SS, Wilk MB (1965) An analysis of variance test for normality. Biometrika 52: 591-611.
[30] Shapiro Wilk and Shapiro Francia (1972). An approximate analysis of variance test for normality. Journal of the American Statistical Association 67: 215-216.
[31] Shengyi & Mokhtarian, Patricia L & Johnston, Robert A., 2007. "Exploring the connections among job accessibility, employment, income, and auto ownership using structural equation modeling," Institute of Transportation Studies, Working Paper Series qt30v177dx, Institute of Transportation Studies, UC Davis.
[32] Stephen W. Looney (1995). How to Use Tests for Univariate Normality to Assess Multivariate Normality. The American Statistician, Volume 49, Issue 1. Pp 64-70.
[33] Thorsten Thadewald, and Herbert Büning, 2004. "Jarque-Bera test and its competitors for testing normality: A power comparison," Discussion Papers 2004/9, Free University Berlin, School of Business & Economics.
[34] Tanweer U. I. (2019); Ranking of Normality tests, An Appraisal through Skewed Alternative Space. Symmetry Basel. Volume 11 issue 7.
[35] Ukponmwan H. Nosakhare, and Ajibade F. Bright (2017). Evaluation of Techniques for Univariate Normality Test Using Monte Carlo Simulation. American Journal of Theoretical and Applied Statistics; 6 (5-1): 51-61http://www.sciencepublishinggroup.com/j/ajtasdoi: 10.11648/j.ajtas.s.2017060501.18ISSN: 2326-8999 (Print); ISSN: 2326-9006 (Online).
[36] Yap, B. W and Sim, C. H (2011). Comparisons of various types of normality tests. Journal of Statistical Computation and Simulation, 81: 12, 2141-2155, DOI: 10.1080/00949655.2010.520163.
Cite This Article
  • APA Style

    Awopeju Kabiru Abidemi, Ajibade Fatai Bright, Abuh Musa. (2023). Classification of Some Test of Normality Techniques into UMP and LMP Using Monte Carlo Simulation Technique. Mathematics Letters, 9(1), 8-17. https://doi.org/10.11648/j.ml.20230901.12

    Copy | Download

    ACS Style

    Awopeju Kabiru Abidemi; Ajibade Fatai Bright; Abuh Musa. Classification of Some Test of Normality Techniques into UMP and LMP Using Monte Carlo Simulation Technique. Math. Lett. 2023, 9(1), 8-17. doi: 10.11648/j.ml.20230901.12

    Copy | Download

    AMA Style

    Awopeju Kabiru Abidemi, Ajibade Fatai Bright, Abuh Musa. Classification of Some Test of Normality Techniques into UMP and LMP Using Monte Carlo Simulation Technique. Math Lett. 2023;9(1):8-17. doi: 10.11648/j.ml.20230901.12

    Copy | Download

  • @article{10.11648/j.ml.20230901.12,
      author = {Awopeju Kabiru Abidemi and Ajibade Fatai Bright and Abuh Musa},
      title = {Classification of Some Test of Normality Techniques into UMP and LMP Using Monte Carlo Simulation Technique},
      journal = {Mathematics Letters},
      volume = {9},
      number = {1},
      pages = {8-17},
      doi = {10.11648/j.ml.20230901.12},
      url = {https://doi.org/10.11648/j.ml.20230901.12},
      eprint = {https://article.sciencepublishinggroup.com/pdf/10.11648.j.ml.20230901.12},
      abstract = {In Statistics, test of normality is of great importance and cannot be neglected in statistical analysis. However, there exist many techniques for such analysis and researchers usually face with the choice of test. From the literature, it has been established that power of test of normality vary significantly based on sample sizes. In this study, seven normality tests were reviewed and the classification into LMP and UMP were based on Power-of-Test. The test of hypothesis was done at 5% level of significance. The tests considered as; Shapiro-Wilk, Anderson-Darling, Bonett-Serial, Robust Jarque-Bera, Skewness, Lilliefors and Kurtosis tests. The sample sizes considered are 10, 20, 50 and 100 with 1000 replicates. Simulation was done from 3 distributions namely, normal, gamma and beta distributions. It was found that all methods were stronger for the detection of normality when normal distribution was used but the variation in their power was obvious when non-normal distributions were used. Among the methods, only three can be referred to as UMP while the rest are LMP. The UMP methods are Shapiro-Wilk, Anderson-Darling and Lilliefors as their Power-of-Test was not affected by sample sizes.},
     year = {2023}
    }
    

    Copy | Download

  • TY  - JOUR
    T1  - Classification of Some Test of Normality Techniques into UMP and LMP Using Monte Carlo Simulation Technique
    AU  - Awopeju Kabiru Abidemi
    AU  - Ajibade Fatai Bright
    AU  - Abuh Musa
    Y1  - 2023/05/29
    PY  - 2023
    N1  - https://doi.org/10.11648/j.ml.20230901.12
    DO  - 10.11648/j.ml.20230901.12
    T2  - Mathematics Letters
    JF  - Mathematics Letters
    JO  - Mathematics Letters
    SP  - 8
    EP  - 17
    PB  - Science Publishing Group
    SN  - 2575-5056
    UR  - https://doi.org/10.11648/j.ml.20230901.12
    AB  - In Statistics, test of normality is of great importance and cannot be neglected in statistical analysis. However, there exist many techniques for such analysis and researchers usually face with the choice of test. From the literature, it has been established that power of test of normality vary significantly based on sample sizes. In this study, seven normality tests were reviewed and the classification into LMP and UMP were based on Power-of-Test. The test of hypothesis was done at 5% level of significance. The tests considered as; Shapiro-Wilk, Anderson-Darling, Bonett-Serial, Robust Jarque-Bera, Skewness, Lilliefors and Kurtosis tests. The sample sizes considered are 10, 20, 50 and 100 with 1000 replicates. Simulation was done from 3 distributions namely, normal, gamma and beta distributions. It was found that all methods were stronger for the detection of normality when normal distribution was used but the variation in their power was obvious when non-normal distributions were used. Among the methods, only three can be referred to as UMP while the rest are LMP. The UMP methods are Shapiro-Wilk, Anderson-Darling and Lilliefors as their Power-of-Test was not affected by sample sizes.
    VL  - 9
    IS  - 1
    ER  - 

    Copy | Download

Author Information
  • Department of Statistics, Nnamdi Azikiwe University, Awka, Nigeria

  • Petroleum Training Institute, Effurun, Warri, Nigeria

  • Department of Statistics, Federal Polytechnic, Idah, Nigeria

  • Sections