Your browser does not support JavaScript!
http://iet.metastore.ingenta.com
1887

Information theory and inverse probability in telecommunication

Information theory and inverse probability in telecommunication

For access to this article, please select a purchase option:

Buy article PDF
£12.50
(plus tax if applicable)
Buy Knowledge Pack
10 articles for £75.00
(plus taxes if applicable)

IET members benefit from discounts to all IET publications and free access to E&T Magazine. If you are an IET member, log in to your account and the discounts will automatically be applied.

Learn more about IET membership 

Recommend Title Publication to library

You must fill out fields marked with: *

Librarian details
Name:*
Email:*
Your details
Name:*
Email:*
Department:*
Why are you recommending this title?
Select reason:
 
 
 
 
 
Proceedings of the IEE - Part III: Radio and Communication Engineering — Recommend this title to your library

Thank you

Your recommendation has been sent to your librarian.

The foundations of information theory are presented as an extension of the theory of inverse probability. By postulating that information is additive and taking suitable averages, all the essential definitions of Shannon's theory for discrete and continuous communication channels, with and without noise, are obtained. The theory is based on the idea that receiving a communication, or making an observation, merely changes the relative probabilities of the various possible messages. The whole process of reception can therefore be regarded as a means of evaluating a posteriori probabilities, and this leads to the idea that the optimum receiver in any telecommunication problem can always be specified, in principle, by inverse probability. The simplest instance is the correlation receiver for detecting very weak signals in the presence of noise, and its theory is briefly discussed The paper concludes with an answer to possible criticisms of the use of inverse probability.

References

    1. 1)
      • C.E. Shannon . Communication in the Presence of Noise. Proceedings of the Institute of Radio Engineers
    2. 2)
      • L. Brillouin . Physical Entropy and Information. II. Journal of Applied Physics
    3. 3)
      • P.M. Woodward . Information Theory and the Design of Radar Receivers. Proceedings of the Institute of Radio Engineers
    4. 4)
      • E.C. Cherry . A History of the Theory of Information. Proceedings I.E.E.
    5. 5)
      • M.S. Bartlett . Probability and Chance in the Theory of Statistics. Proceedings of the Royal Society
    6. 6)
      • L. Brillouin . Maxwell's Demon Cannot Operate: Information and Entropy. I. Journal of Applied Physics
    7. 7)
      • C.E. Shannon . A Mathematical Theory of Communication. Bell System Technical Journal
    8. 8)
      • H. Jeffreys . (1939) , Theory of Probability.
    9. 9)
      • P.M. Woodward , I.L. Davies . A Theory of Radar Information. Philosophical Magazine
http://iet.metastore.ingenta.com/content/journals/10.1049/pi-3.1952.0011
Loading

Related content

content/journals/10.1049/pi-3.1952.0011
pub_keyword,iet_inspecKeyword,pub_concept
6
6
Loading
Correspondence
This article has following corresponding article(s):
Information theory and inverse probability in telecommunication
This is a required field
Please enter a valid email address