On a measure of dependence and its application to independent component analysis

Document Type : Original Scientific Paper

Authors

1 Management and Planning Organization, Yazd, Iran

2 Department of Statistics, Yazd University, 89175-741, Yazd, Iran

Abstract

In this article we study a copula-based measure of‎ ‎dependence constructed based on the concept of average quadrant‎ ‎dependence‎. ‎The rank-based estimator of this index and its ‎asymptotic normality is investigated‎. ‎An algorithm for independent ‎component analysis is developed whose contrast function is the‎ ‎proposed dependence coefficient.

Keywords

Main Subjects


Alsina, C., Schweizer, B. and Frank, M.J. (2006). Associative Functions: Triangular Norms and Copulas. Singapore: World Scientific.
Amari, S., Cichocki, A. and Yang, H.H. (1996). A new learning algorithm for blind signal separation. Advances in Neural Information Processing Systems, 8, 757–763. MIT Press.
Bach, F.R. and Jordan, M.I. (2002). Kernel independent component analysis. The Journal of Machine Learning Research, 3, 1–48.
Behboodian, J., Dolati, A. and Úbeda-Flores, M. (2005). Measures of association based on average quadrant dependence. Journal of Probability and Statistical Science, 3, 161–173.
Blum, J.R., Kiefer, J. and Rosenblatt, M. (1961). Distribution free tests of independence based on the sample distribution function. The Annals of Mathematical Statistics, 32, 485–498.
Cardoso, J.F. and Souloumiac, A. (1993). Blind beam forming for non-Gaussian signals. In IEE Proceedings F - Radar and Signal Processing, Vol. 140, No. 6, pp. 362–370.
Cardoso, J.F. (1999). High-order contrasts for independent component analysis. Neural Computation, 11(1), 157–192.
Comon, P. (1994). Independent component analysis, a new concept? Signal Processing, 36(3), 287–314.
Fermanian, J.D., Radulovic, D. and Wegkamp, M. (2004). Weak convergence of empirical copula processes. Bernoulli, 10(5), 847–860.
Feuerverger, A. and Mureika, R.A. (1977). The empirical characteristic function and its applications. The Annals of Statistics, 5, 88–97.
Gaißer, S., Ruppert, M. and Schmid, F. (2010). A multivariate version of Hoeffding's phi-square. Journal of Multivariate Analysis, 101(10), 2571–2586.
Gretton, A., Bousquet, O., Smola, A. and Schölkopf, B. (2005). Measuring statistical dependence with Hilbert-Schmidt norms. In Algorithmic Learning Theory (pp. 63–77). Springer Berlin Heidelberg.
Hoeffding, W. (1941). Scale-invariant correlation theory. In The Collected Works of Wassily Hoeffding (pp. 57–107). Springer New York.
Hyvärinen, A. (1999). Fast and robust fixed-point algorithms for independent component analysis. IEEE Transactions on Neural Networks, 10, 626–634.
Hyvärinen, A. and Koster, U. (2006). FastISA: A fast fixed-point algorithm for independent subspace analysis. In Proceedings of ESANN, Evere, Belgium.
Learned-Miller, E.G. (2003). ICA using spacings estimates of entropy. The Journal of Machine Learning Research, 4, 1271–1295.
Lehmann, E.L. (1966). Some concepts of dependence. The Annals of Mathematical Statistics, 35, 1137–1153.
Nelsen, R.B. (2006). An Introduction to Copulas. Springer Science & Business Media.
Rényi, A. (1959). On measures of dependence. Acta Mathematica Hungarica, 10, 441–451.
Rosenblatt, M. (1975). A quadratic measure of deviation of two-dimensional density estimates and a test of independence. The Annals of Statistics, 3, 1–14.
Segers, J. (2012). Asymptotics of empirical copula processes under non-restrictive smoothness assumptions. Bernoulli, 18, 764–782.
Shannon, C.E. and Weaver, W. (1949). The Mathematical Theory of Communication. Champaign, IL: University of Illinois Press.
Shen, H., Jegelka, S. and Gretton, A. (2009). Fast kernel-based independent component analysis. IEEE Transactions on Signal Processing, 57(9), 3498–3511.
Schweizer, B. and Wolff, E.F. (1981). On nonparametric measures of dependence for random variables. The Annals of Statistics, 9, 879–885.
Sklar, A. (1959). Fonctions de répartition à n dimensions et leurs marges. Institut de Statistique de l'Université de Paris, 8, 229–231.
Van der Vaart, A.W. and Wellner, J.A. (1996). Weak Convergence and Empirical Processes. Springer Verlag.