Information-Theoretic Methods for Estimating of Complicated Probability Distributions

Mixing up various disciplines frequently produces something that are profound and far-reaching. Cybernetics is such an often-quoted example. Mix of information theory, statistics and computing technology proves to be very useful, which leads to the recent development of information-theory based methods for estimating complicated probability distributions.Estimating probability distribution of a random variable is the fundamental task for quite some fields besides statistics, such as reliability,