source coding theorem
source coding theorem In communication theory, the statement that the output of any information source having entropy H units per symbol can be encoded into an alphabet having N symbols in such a way that the source symbols are represented by codewords having a weighted average length not less than H/logN
(where the base of the logarithm is consistent with the entropy units). Also, that this limit can be approached arbitrarily closely, for any source, by suitable choice of a variable-length code and the use of a sufficiently long extension of the source (see source coding).
The theorem was first expounded and proved by Claude Elwood Shannon in 1948.
(where the base of the logarithm is consistent with the entropy units). Also, that this limit can be approached arbitrarily closely, for any source, by suitable choice of a variable-length code and the use of a sufficiently long extension of the source (see source coding).
The theorem was first expounded and proved by Claude Elwood Shannon in 1948.
More From encyclopedia.com
Coding And Decoding , Coding and Decoding
Representation of information is a fundamental aspect of all communication from bird songs to human language to modern telecommun… Native American Code Talkers , █ ADRIENNE WILMOTH LERNER
Windtalkers was the code name given to the Navajo Indian code talkers employed by United States military intelligence durin… Binary notation , Gray code A binary (n, n) block code having the following properties:
(a) there are 2n codewords, each of length n bits;
(b) successive codewords dif… Ascii , ASCII
ASCII [Pronounced ‘Askee’; The abbreviation of, and the common term for, the American Standard Code for Information Interchange]. Also ASCII co… Binary coded decimal system , BCD (USA) bad conduct discharge
• Chem. betacyclodextrin
• Computing binary-coded decimal
• Astronomy blue compact dwarf (type of star)
BCD Abbrev. f… Degenerate Code , degenerate code A genetic code in which the number of sense codons exceeds the number of amino acids, with the consequence that some amino acids are…
You Might Also Like
NEARBY TERMS
source coding theorem