Tests for one-way analysis of covariance with heteroscedasticity

Document Type : Original Scientific Paper

Authors

1 Department of Statistics, Yazd University, Yazd, Iran

2 Department of Statistics, Shiraz University, Shiraz, Iran

Abstract

The one-way analysis of covariance model is used to evaluate the equality between multiple treatments in the presence of a covariate‎. ‎Presenting a test that controls the size is a major consideration for this model especially when the variances are unequal‎, ‎since the actual size of the test depends on the values of the variances‎. ‎The traditional F test in the analysis of covariance problem can produce unreliable outcomes‎, ‎and there is no simple manipulation test that satisfactorily controls the size‎. ‎The calculations for the generalized F test and parametric bootstrap test are complicated and must be performed using Monte Carlo techniques‎. ‎In this study‎, ‎we first suggest a generalized test for the analysis of covariance problem and then construct three approximate tests that do not have the problems of earlier tests‎. ‎The performance of the generalized test and the three simple tests is shown using extensive simulations‎. ‎When the variances are very unequal‎, ‎the actual sizes of these tests can be close to the nominal size and rarely exceed the nominal level‎. ‎Three data sets illustrate the application of the methods.

Keywords

Main Subjects


Ananda, M.M. (1998). Bayesian and non-Bayesian solutions to analysis of covariance models under heteroscedasticity. Journal of Econometrics, 86(1):177–192.
Arnold, S.F. (1981). The Theory of Linear Models and Multivariate Analysis. New York: Wiley.
Barrett, T.J. (2011). Computations using analysis of covariance. Wiley Interdisciplinary Reviews: Computational Statistics, 3(3):260–268.
European Medicines Agency (2015). Guideline on adjustment for baseline covariates in clinical trials. Author London, England, EMA/CHMP/295050/2013.
Keselman, H.J., Huberty, C.J., Lix, L.M., Olejnik, S., Cribbie, R.A., Donahue, B., Kowalchuk, R.K., Lowman, L.L., Petoskey, M.D., Keselman, J.C. and Levin, J.R. (1998). Statistical practices of educational researchers: An analysis of their ANOVA, MANOVA, and ANCOVA analyses. Review of Educational Research, 68(3):350–386.
Khammar, A., Yarahmadi, M. and Madadizadeh, F. (2020). What is analysis of covariance (ANCOVA) and how to correctly report its results in medical research? Iranian Journal of Public Health, 49(5):1016–1017.
Milliken, G.A. and Johnson, D.E. (2001). Analysis of Messy Data, Volume III: Analysis of Covariance. Volume 3, CRC Press.
Morrison, D.F. (1983). Applied Linear Statistical Methods. Prentice-Hall Englewood Cliffs, NJ.
R Core Team (2025). R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing, Vienna, Austria.
Rencher, A.C. and Schaalje, G.B. (2008). Linear Models in Statistics. New York: John Wiley & Sons.
Rutherford, A. (2011). ANOVA and ANCOVA: A GLM Approach. John Wiley & Sons.
Sadooghi-Alvandi, S.M. and Jafari, A.A. (2013). A parametric bootstrap approach for one-way ANCOVA with unequal variances. Communications in Statistics - Theory and Methods, 42(14):2473–2498.
Sadooghi-Alvandi, S.M., Jafari, A.A. and Mardani-Fard, H.A. (2012). One-way ANOVA with unequal variances. Communications in Statistics-Theory and Methods, 41(22):4200–4221.
Tsui, K.W. and Weerahandi, S. (1989). Generalized p-values in significance testing of hypotheses in the presence of nuisance parameters. Journal of the American Statistical Association, 84(406):602–607.
Welch, B.L. (1951). On the comparison of several mean values: An alternative approach. Biometrika, 38(3-4):330–336.