Conditions for interior based constrained prior distributions to ensure probability density

Document Type : Original Scientific Paper

Authors

1 Department of Statistics‎, ‎Amirkabir University of Technology‎, ‎Tehran‎, ‎Iran

2 Department of Mathematics‎, ‎Kharazmi University‎, ‎Tehran‎, ‎Iran

Abstract

In Bayesian inference‎, ‎the acquisition of prior distributions plays a fundamental role‎. ‎While authorized priors need not conform to traditional probability densities and may be improper priors‎, ‎obtaining proper prior densities remains a challenge in the Bayesian literature‎. ‎This article explores a set of conditions that enable the establishment of specific assumptions‎, ‎ensuring that maximum entropy priors and restricted reference priors become proper and transform into probability density priors‎. ‎By examining these conditions‎, ‎this study contributes to the advancement of proper prior acquisition in Bayesian analysis.

Keywords

Main Subjects


Banner, K.M., Irvine, K.M. and Rodhouse, T.J. (2020). The use of Bayesian priors in ecology: The good, the bad and the not great. Methods in Ecology and Evolution, 11(8):882–889.
Berger, J.O. (1985). Statistical Decision Theory and Bayesian Analysis. New York: Springer.
Bernardo, J.M. (2005). Reference analysis. Handbook of Statistics, 25:17–90.
Bernardo, J.M. and Smith, A.F. (2009). Bayesian Theory. Vol. 405, John Wiley & Sons.
Case, K.E. and Keats, J.B. (1982). On the selection of a prior distribution in Bayesian acceptance sampling. Journal of Quality Technology, 14(1):10–18.
Chen, M.-H., Ibrahim, J.G. and Kim, S. (2008). Properties and implementation of Jeffreys's prior in binomial regression models. Journal of the American Statistical Association, 103(484):1659–1664.
Cover, T.M. (1999). Elements of Information Theory. New Jersey: John Wiley & Sons.
Gelman, A. (2006). Prior distribution. In Encyclopedia of Environmetrics, Vol. 3, 1634–1637.
Gelman, A., Simpson, D. and Betancourt, M. (2017). The prior can often only be understood in the context of the likelihood. Entropy, 19(10):555.
Jeffreys, H. (1946). An invariant form for the prior probability in estimation problems. Proceedings of the Royal Society of London. Series A. Mathematical and Physical Sciences, 186(1007):453–461.
Jensen, J.L.W.V. (1906). Sur les fonctions convexes et les inégalités entre les valeurs moyennes. Acta Mathematica, 30(1):175–193.
Kass, R. (2005). Prior distribution. Encyclopedia of Biostatistics, 6.
Kosmidis, I. and Firth, D. (2021). Jeffreys-prior penalty, finiteness and shrinkage in binomial-response generalized linear models. Biometrika, 108(1):71–82.
Perlman, M.D. (1974). Jensen's inequality for a convex vector-valued function on an infinite-dimensional space. Journal of Multivariate Analysis, 4(1):52–65.
Rojas, R., Feyen, L. and Dassargues, A. (2009). Sensitivity analysis of prior model probabilities and the value of prior knowledge in the assessment of conceptual model uncertainty in groundwater modelling. Hydrological Processes: An International Journal, 23(8):1131–1146.
Rudin, W. (1987). Real and Complex Analysis. McGraw-Hill Book Company.
Tang, Y., Marshall, L., Sharma, A. and Smith, T. (2016). Tools for investigating the prior distribution in Bayesian hydrology. Journal of Hydrology, 538:551–562.