Principle of maximum entropy
Principle in Bayesian statistics / From Wikipedia, the free encyclopedia
Dear Wikiwand AI, let's keep it short by simply answering these key questions:
Can you list the top facts and stats about Maximum entropy method?
Summarize this article for a 10 year old
SHOW ALL QUESTIONS
For other uses of "Maximum entropy", see Maximum entropy (disambiguation).
The principle of maximum entropy states that the probability distribution which best represents the current state of knowledge about a system is the one with largest entropy, in the context of precisely stated prior data (such as a proposition that expresses testable information).
This article includes a list of general references, but it lacks sufficient corresponding inline citations. (September 2008) |
Another way of stating this: Take precisely stated prior data or testable information about a probability distribution function. Consider the set of all trial probability distributions that would encode the prior data. According to this principle, the distribution with maximal information entropy is the best choice.