© The Institution of Engineering and Technology
The dependence between random variables may be measured by mutual information. However, the estimation of mutual information is difficult since the estimation of the joint probability density function (PDF) of non-Gaussian distributed data is a hard problem. Copulas offer a natural approach for estimating mutual information, since the joint probability density function of random variables can be expressed as the product of the associated copula density function and marginal PDFs. The experiment demonstrates that the proposed copulas-based mutual information is much more accurate than conventional methods such as the joint histogram and Parzen window based mutual information that are widely used in image processing.
References
-
-
1)
-
T.M. Cover ,
J.A. Thomas
.
(2006)
Elements of information theory.
-
2)
-
F. Maes ,
A. Collignona ,
A. Vandermenlen ,
G. Marchal
.
Multimodality image registration by maximization of mutual information.
IEEE Trans. Med. Imaging
,
2 ,
187 -
198
-
3)
-
U. Cherubini ,
E. Luciano ,
W. Vecchiato
.
(2004)
Copula methods in finance.
-
4)
-
N. Kwak ,
C. Choi
.
Input feature selection by mutual information based on Parzen window.
IEEE Trans. Pattern Anal. Mach. Intell.
,
12 ,
1667 -
1671
-
5)
-
R.B. Nelsen
.
(2006)
An introduction to copulas.
http://iet.metastore.ingenta.com/content/journals/10.1049/el.2011.0778
Related content
content/journals/10.1049/el.2011.0778
pub_keyword,iet_inspecKeyword,pub_concept
6
6