Introduction to non-parametric generalized additive models

Document Type : Original Scientific Paper

Authors

Department of Computer Science and Statistics, K.N. Toosi University of Technology, Tehran, Iran

Abstract

In order to investigate a series of data scenarios and determine the model governing the changes of a random variable over time‎, ‎according to the variables affecting it‎, ‎efficient methods have been developed in recent decades‎. ‎One of these methods is the generalized additive model‎. ‎By this modeling for data‎, ‎it is possible to check the behavior of the non-linear data and even predict the future‎. ‎In this article‎, ‎we intend to express this method non-parametrically‎, ‎in cases such as when the variable is independent‎, ‎time series‎, ‎or has a lag and implement the estimation of model parameters‎. ‎Moreover‎, ‎we will demonstrate the power and effectiveness of this method by presenting some examples.

Keywords

Main Subjects


Allmon, S. (1965). The distributed lag between capital appropriations and expenditures. Econometrica, 33:178–196.
Birks, H.J.B. (1998). Numerical tools in palaeolimnology-progress, potentialities, and problems. Journal of Paleolimnology, 20:307–332.
Breiman, L. and Fried, J. (1985). Estimating optimal transformations for multiple regression and correlation. Journal of the American Statistical Association, 80(391):580–598.
Bremner, S.A., Anderson, H.R., Atkinson, R.W., McMichael, A.S., Strachan, D.P., Bland, J.M. and Bower, J.S. (1999). Short term association between outdoor air pollution and mortality in London 1992-4. Occupational and Environmental Medicine, 56(4):237–244.
Buja, A., Hastie, T. and Tibshirani, R. (1989). Linear smoothers and additive models. The Annals of Statistics, 17(2):453–510.
Chang, C-H., Caruana, R. and Goldenberg, A. (2022). NODE-GAM: Neural generalized additive model for interpretable deep learning. arXiv preprint arXiv:2106.01613.
Cleveland, W.S. (1979). Robust locally weighted regression and smoothing scatterplots. Journal of the American Statistical Association, 74(368):829–836.
Corradi, C. (1977). Smooth distributed lag estimators and smoothing spline functions in Hilbert spaces. Journal of Econometrics, 5(2):211–220.
Dehghan, A., Khanjani, N., Bahrampour, A., Goudarzi, G. and Yunesian, M. (2018). The relation between air pollution and respiratory deaths in Tehran, Iran-using generalized additive models. BMC Pulmonary Medicine, 18(1):1–9.
Dominici, F., Samet, J. and Zeger, S.L. (2000). Combining evidence on air pollution and daily mortality from the largest 20 US cities: a hierarchical modeling strategy. Journal of the Royal Statistical Society, 163(3):263–284.
Eilers, P.H.C. and Marx, B.D. (1996). Flexible smoothing with B-splines and penalties. Statistical Science, 11(2):89–121.
Friedman, J.H. and Stuetzle, W. (1981). Projection pursuit regression. Journal of the American Statistical Association, 76(376):817–823.
Hastie, T.J. and Tibshirani, R.J. (1986). Generalized additive models. Statistical Science, 3(1):297–318.
Hastie, T.J. and Tibshirani, R.J. (1990). Generalized Additive Models. London: Chapman and Hall.
Hoek, G., Schwartz, J., Groot, B. and Eilers, P. (1997). Effects of ambient particulate matter and ozone on daily mortality in Rotterdam, The Netherlands. Archives of Environmental Health: An International Journal, 52(6):455–463.
Gu, Ch. and Wahba, G. (1991). Minimizing GCV/GML scores with multiple smoothing parameters via the Newton method. SIAM Journal on Scientific and Statistical Computing, 12(2):383–398.
James, G., Witten, D., Hastie, T. and Tibshirani, R. (2013). An Introduction to Statistical Learning. Vol. 112, New York: Springer.
Kelsall, J.E., Samet, J.M., Zeger, S.L. and Xu, J. (1997). Air pollution and mortality in Philadelphia: 1974-1988. American Journal of Epidemiology, 146(9):750–762.
Nelder, J. and Wedderburn, R. (1972). Generalized linear models. Journal of the Royal Statistical Society. Series A (General), 135(3):370–384.
Pinilla, J. and Negrín, M. (2021). Non-Parametric generalized additive models as a tool for evaluating policy interventions. Mathematics, 9(4):299.
Ravindra, K., Rattan, P., Mor, S. and Aggarwal, A.N. (2019). Generalized additive models: Building evidence of air pollution, climate change and human health. Environment International, 132:104987.
Schwartz, J. (1993). Air pollution and mortality in Birmingham, AL. American Journal of Epidemiology, 137(10):1136–1147.
Schwartz, J. (1994). Nonparametric smoothing in the analysis of air pollution and respiratory illness. The Canadian Journal of Statistics, 22(4):471–487.
Wood, S.N. (2003). Thin plate regression splines. Journal of the Royal Statistical Society. Series B (Statistical Methodology), 65(1):95–114.
Wood, S.N. (2004). Generalized Additive Models: an introduction with R. First ed., New York: Chapman and Hall/CRC.
Wood, S.N. (2017). Generalized Additive Models: an Introduction with R. 2nd ed., CRC Press.
Yang, K. and Maiti, T. (2020). Ultra high dimensional generalised additive model: Unified Theory and Methods. Scandinavian Journal of Statistics, 49(3):917–942.
Yee, T.W. (2015). Vector Generalized Linear and Additive Models with an Implementation in R. New York: Springer.
Zanobetti, A., Wand, M.P., Schwartz, J. and Ryan, L.M. (2000). Generalized additive distributed lag models: Quantifying mortality displacement. Biostatistics, 1(3):279–292.
Zhao, J., Cao, J., Tian, S., Chen, S., Zhang, S., Wang, Z. and Zhou, X. (2014). A comparison between two GAM models in quantifying relationships of environmental variables with fish richness and diversity indices. Aquatic Ecology, 48:297–312.