Detection of outliers and influential observations in linear mixed measurement error models with Liu estimation

Document Type : Original Scientific Paper

Authors

1 Department of Statistics‎, ‎Ahvaz Branch‎, ‎Islamic Azad University‎, ‎Ahvaz‎, ‎Iran

2 Department of Mathematics and Statistics‎, ‎Shoushtar Branch‎, ‎Islamic Azad University‎, ‎Shoushtar‎, ‎Iran

Abstract

In this paper, the case deletion approach and mean shift outlier model are developed to identify influential and outlier observations using the Liu corrected likelihood estimator in linear mixed measurement error models when multicollinearity is present. We derive a corrected score test statistic for outlier detection based on mean shift outlier models. Furthermore, according to the Liu corrected likelihood estimator, several Cook’s distance is constructed for influence diagnostics. A parametric bootstrap procedure is used to obtain empirical distribution of the test statistic and a simulation study is conducted to demonstrate the performance of the diagnostic criteria. Finally, a real example is provided to illustrate the performance of the test statistics.

Keywords

Main Subjects


Banerjee, M. and Frees, E.W. (1997). Influence diagnostics for linear longitudinal models. Journal of the American Statistical Association, 92(439):999–1005.
Belsley, D.A., Kuh, E. and Welsch, R.E. (1980). Regression Diagnostics: Identifying Influential Data and Sources of Collinearity. New York: John Wiley & Sons.
Christensen, R., Pearson, L.M. and Johnson, W. (1992). Case-deletion diagnostics for mixed-models. Technometrics, 34:38–45.
Cook, R.D. (2000). Detection of influential observation in linear regression. Technometrics, 42(1):65–68.
Demidenko, E. and Stukel, T.A. (2005). Influence analysis for linear mixed-effects models. Statistics in Medicine, 24(6):893–909.
Fung, W.K., Zhong, X.P. and Wei, B.C. (2003). On estimation and influence diagnostics in linear mixed measurement error models. American Journal of Mathematical and Management Sciences, 23(1-2):37–59.
Ghapani, F. (2022). Stochastic restricted Liu estimator in linear mixed measurement error models. Communications in Statistics - Simulation and Computation, 51(3):1220–1233.
Harrison, D. and Rubinfeld, D.L. (1978). Hedonic housing prices and the demand for clean air. Journal of Environmental Economics and Management, 5(1):81–102.
Harville, D.A. (1977). Maximum likelihood approaches to variance component estimation and to related problems (with discussion). Journal of the American Statistical Association, 72(358):320–340.
Haslett, J. and Dillane, D. (2004). Application of 'delete= replace' to deletion diagnostics for variance component estimation in the linear mixed model. Journal of the Royal Statistical Society, Series B, 66(1):131–143.
Hoerl, A.E. and Kennard, R.W. (1970). Ridge regression: biased estimation for non-orthogonal problems. Technometrics, 12(1):55–67.
Jennrich, R.I. and Sampson, P.F. (1976). Newton-Raphson and related algorithms for maximum likelihood estimation of variance components. Technometrics, 18(1):11–18.
Li, Z., Xu, W. and Zhu, L. (2009). Influence diagnostics and outlier tests for varying coefficient mixed models. Journal of Multivariate Analysis, 100(9):2002–2017.
Liang, H., Härdle, W. and Carroll, R.J. (1999). Estimation in a semiparametric partially linear errors-in variables model. The Annals of Statistics, 27(5):1519–1535.
Lin, D.Y., Wei, L.J. and Ying, Z. (1993). Checking the Cox model using cumulative sums of martingale-based residuals. Biometrika, 80(3):557–572.
Liu, K. (1993). A new class of biased estimate in linear regression. Communications in Statistics-Theory and Methods, 22(2):393–402.
Maksaei, N., Rasekh, A. and Babadi, B. (2023). Influence measures and outliers detection in linear mixed measurement error models with Ridge estimation. Communications in Statistics-Simulation and Computation, 52(7):3062–3078.
McCulloch, C.E. and Searle, S.R. (2001). Generalized, Linear and Mixed Models. New York: John Wiley & Sons.
McDonald, G.C. and Galarneau, D.I. (1975). A Monte Carlo evaluation of some ridge-type estimators. Journal of the American Statistical Association, 70(350):407–416.
Nagelkerke, N.J. (1992). Maximum Likelihood Estimation of Functional Relationships. New York: Springer.
Nakamura, T. (1990). Corrected score function for errors-in-variables models: Methodology and application to generalized linear models. Biometrika, 77(1):127–137.
Rao, C.R., Toutenburg, H., Shalabh and Heumann, C. (2008). Linear Models and Generalizations. Berlin: Springer.
Rebai, A., Goffinet, B. and Mangin, B. (1994). Approximate thresholds of interval mapping tests for QTL detection. Genetics, 138(1):235–240.
Riquelme, M., Bolfarine, H. and Galea, M. (2015). Robust linear functional mixed models. Journal of Multivariate Analysis, 134:82–98.
SAS Institute Inc. (1992). SAS Technical Report P-229 SAS/STAT Software: Changes and Enhancement. Release 6.07. Cary, NC: SAS Institute.
Searle, S.R., Casella, G. and McCulloch, C.E. (1992). Variance Components. New York: John Wiley.
Stein, C. (1956). Inadmissibility of the usual estimator for mean of multivariate normal distribution. In Proceedings of the Third Berkeley Symposium on Mathematical Statistics and Probability, Volume 1: Contributions to the Theory of Statistics (Vol. 3, pp. 197–207), University of California Press.
Tan, F.E., Ouwens, M.J. and Berger, M.P. (2001). Detection of influential observations in longitudinal mixed effects regression models. Journal of the Royal Statistical Society, Series D, 50(3):271–284.
Zare, K. and Rasekh, A. (2011). Diagnostic measures for linear mixed measurement error models. SORT-Statistics and Operations Research Transactions, 35(2):125–144.
Zare, K. and Rasekh, A. (2014). Residuals and leverages in the linear mixed measurement error models. Journal of Statistical Computation and Simulation, 84(7):1427–1443.
Zare, K., Rasekh, A. and Rasekhi, A.A. (2012). Estimation of variance components in linear mixed measurement error models. Statistical Papers, 53(4):849–863.
Zewotir, T. and Galpin, J.S. (2005). Influence diagnostics for linear mixed models. Journal of Data Science, 3(2):153–177.
Zewotir, T. and Galpin, J.S. (2007). A unified approach on residuals, leverages and outliers in the linear mixed model. Test, 16:58–75.
Xuping, Z. and Bocheng, W. (1999). Influence analysis on linear models with random effects. Applied Mathematics-A Journal of Chinese Universities, 14:169–176.
Zhong, X.P., Fung, W.K. and Wei, B.C. (2002). Estimation in linear models with random effects and errors-in-variables. Annals of Applied Statistics, 54(3):595–606.