Leverage and influential observations on the restricted Liu estimator in the linear mixed measurement error models

Document Type : Original Scientific Paper

Author

Department of Mathematics and Statistics‎, ‎Sho.C.‎, ‎Islamic Azad University‎, ‎Shoushtar‎, ‎Iran

Abstract

A fundamental step in constructing linear regression models is the identification of atypical observations, specifically high-leverage and influential points. The coexistence of atypical observations and severe multicollinearity complicates statistical analysis and reduces the effectiveness of conventional diagnostic methods. To address these challenges, this paper proposes diagnostic methods based on the restricted Liu estimator for identifying atypical observations in linear mixed measurement error models. Specifically, generalized leverage matrices are derived using the restricted Liu estimator to identify high-leverage points. Furthermore, several case-deletion measures are developed based on the restricted Liu estimator to serve as robust tools for diagnosing influential points. The performance of the proposed methods is evaluated through two simulation studies and an application to a real-life example.

Keywords

Main Subjects


Borhani, Sh., Ghapani, F. and Jafaraghaie, R. (2023). Detection of outliers and influential observations in linear mixed measurement error models with Liu estimation. Journal of Statistical Modelling: Theory and Applications, 4(2):1–16.
Borhani, Sh., Ghapani, F. and Jafaraghaie, R. (2024). Detecting Influential Observations Using Liu Estimator in Linear Mixed Measurement Error Models. Journal of Statistical Theory and Practice, 18(2):18.
Cook, R.D. (1977). Detection of influential observations in linear regression. Technometrics, 19(1):15–18.
Demidenko, E. and Stukel, T.A. (2005). Influence analysis for linear mixed-effects models. Statistics in Medicine, 24(6):893–909.
Fuller, W.A. (1987). Measurement Error Models. New York: Wiley.
Fung, W.K., Zhong, X.P. and Wei, B.C. (2003). On estimation and influence diagnostics in linear mixed measurement error models. American Journal of Mathematical and Management Sciences, 23(1-2):37–59.
Fung, W.K., Zhu, Z.Y., Wei, B.C. and He, X. (2002). Influence diagnostics and outliers tests for semiparametric mixed models. Journal of the Royal Statistical Society. Series B, 64(3):565–579.
Ganjealivand, N. and Ghapani, F. (2024). The weighted two-parameter estimation for linear mixed models with measurement error under stochastic linear mixed restrictions. Journal of Statistical Modelling: Theory and Applications, 5(2):137–152.
Ghapani, F. (2024). Diagnostic measures based on restricted ridge estimator in linear mixed measurement error models. Journal of Data Science and Modeling, 3(1):95–122.
Ghapani, F. and Babadi, B. (2022a). Diagnostic measures for the restricted Liu estimator in linear measurement error models. Journal of Statistical Computation and Simulation, 92(11):2257–2272.
Ghapani, F. and Babadi, B. (2022b). Two parameter weighted mixed estimator in linear measurement error models. Communications in Statistics-Simulation and Computation, 51(12):6936–6946.
Hoaglin, D.C. and Welsch, R.E. (1978). The hat matrix in regression and ANOVA. The American Statistician, 32(1):17–22.
Liu, K. (1993). A new class of biased estimate in linear regression. Communications in Statistics-Theory and Methods, 22(2):393–402.
McDonald, G.C. and Galarneau, D.I. (1975). A Monte Carlo evaluation of some ridge-type estimators. Journal of the American Statistical Association, 70(350):407–416.
Nakamura, T. (1990). Corrected score function for errors-in-variables models: Methodology and application to generalized linear models. Biometrika, 77(1):127–137.
Rao, C.R., Shalabh, Toutenburg, H. and Heumann, C. (2008). Linear Models and Generalizations. Berlin, Heidelberg: Springer Berlin Heidelberg.
Tan, F.E.S., Ouwens, M.J.N. and Berger, M.P.F. (2001). Detection of influential observations in longitudinal mixed effects regression models. Journal of the Royal Statistical Society Series D, 50(3):271–284.
Wei, B.C., Hu, Y.Q. and Fung, W.K. (1998). Generalized leverage and its applications. Scandinavian Journal of Statistics, 25(1):25–37.
Welsch, R.E. (1982). Influence functions and regression diagnostics. In: Launer, R.L. and Siegel, A.F. (eds.), Modern Data Analysis. pp. 149–169, New York: Academic Press.
Zare, K. and Rasekh, A. (2011). Diagnostic measures for linear mixed measurement error models. Sort, 35(2):125–144.
Zare, K. and Rasekh, A. (2014). Residuals and leverages in the linear mixed measurement error models. Journal of Statistical Computation and Simulation, 84(7):1427–1443.
Zare, K., Rasekh, A. and Rasekhi, A.A. (2012). Estimation of variance components in linear mixed measurement error models. Statistical Papers, 53(4):849–863.
Zhong, X.P., Fung, W.K. and Wei, B.C. (2002). Estimation in linear models with random effects and errors-in-variables. Annals of the Institute of Statistical Mathematics, 54(3):595–606.