Estimation of mutual information using copula density function

Access Full Text

Estimation of mutual information using copula density function

For access to this article, please select a purchase option:

Buy article PDF
£12.50
(plus tax if applicable)
Buy Knowledge Pack
10 articles for £75.00
(plus taxes if applicable)

IET members benefit from discounts to all IET publications and free access to E&T Magazine. If you are an IET member, log in to your account and the discounts will automatically be applied.

Learn more about IET membership 

Recommend Title Publication to library

You must fill out fields marked with: *

Librarian details
Name:*
Email:*
Your details
Name:*
Email:*
Department:*
Why are you recommending this title?
Select reason:
 
 
 
 
 
Electronics Letters — Recommend this title to your library

Thank you

Your recommendation has been sent to your librarian.

The dependence between random variables may be measured by mutual information. However, the estimation of mutual information is difficult since the estimation of the joint probability density function (PDF) of non-Gaussian distributed data is a hard problem. Copulas offer a natural approach for estimating mutual information, since the joint probability density function of random variables can be expressed as the product of the associated copula density function and marginal PDFs. The experiment demonstrates that the proposed copulas-based mutual information is much more accurate than conventional methods such as the joint histogram and Parzen window based mutual information that are widely used in image processing.

Inspec keywords: information theory; Gaussian processes; signal processing

Other keywords: joint probability density function; nonGaussian distributed data; copula density function; mutual information

Subjects: Signal processing and detection; Information theory; Other topics in statistics

References

    1. 1)
      • T.M. Cover , J.A. Thomas . (2006) Elements of information theory.
    2. 2)
    3. 3)
      • U. Cherubini , E. Luciano , W. Vecchiato . (2004) Copula methods in finance.
    4. 4)
    5. 5)
      • R.B. Nelsen . (2006) An introduction to copulas.
http://iet.metastore.ingenta.com/content/journals/10.1049/el.2011.0778
Loading

Related content

content/journals/10.1049/el.2011.0778
pub_keyword,iet_inspecKeyword,pub_concept
6
6
Loading