Survey Basic Terms
Alphabet []
An ordered set of symbols that can be sorted.
Code []
Specification that describes the relation between different set of symbols.
Coding []
Procedures applying a code.
Entropy []
Quantitative measure for information of an information source and required average code length.
Entropy Coding []
Procedure for coding of symbols with variable code length antiproportionally to the probability of their occurrence.
Information []
Mathematical or technical measure for information.
Information Theory []
Theory to describe information as a mathematical or technical measure, founded by Claude Shannon.
Irrelevance Reduction []
Reduction of data volume by eliminating irrelevant parts of the contents.
Message []
The term message in information theory.
Probability []
Probabilities for messages or symbols provided by an information source.
Redundancy []
Part of data that does not contribute to information.
Redundancy Reduction []
Reduction of data volume by eliminating redundant parts of the contents.
Set of Symbols []
Total amount of symbols potentially used to create data.
Symbol []
Basic unit structuring data.
< ^ >
