Difference between revisions of "Belief Propagation"
From Cohen Courses
Jump to navigationJump to search| Line 1: | Line 1: | ||
This is a [[category::Method]] proposed by [[RelatedPaper::Judea Pearl, 1982: Reverend Bayes on inference engines: A distributed hierarchical approach, AAAI 1982]]. | This is a [[category::Method]] proposed by [[RelatedPaper::Judea Pearl, 1982: Reverend Bayes on inference engines: A distributed hierarchical approach, AAAI 1982]]. | ||
| − | Belief Propagation is a message passing inference method for statistical graphical models (e.g. Markov random fields). The basic idea is to compute the marginal distribution of unobserved nodes, based on the conditional distribution of observed nodes. When the graphical model is both a factor graph and a tree, the exact marginals can be obtained. | + | Belief Propagation is a message passing inference method for statistical graphical models (e.g. Bayesian networks and Markov random fields). The basic idea is to compute the marginal distribution of unobserved nodes, based on the conditional distribution of observed nodes. There are two major cases: |
| + | * When the graphical model is both a factor graph and a tree (no loops), the exact marginals can be obtained. This is also equivalent to dynamic programming and Viterbi. | ||
| + | * Otherwise, loopy Belief Propagation will become an approximation inference algorithm. | ||
== Definition == | == Definition == | ||
== Inference == | == Inference == | ||
Revision as of 23:35, 26 September 2011
This is a Method proposed by Judea Pearl, 1982: Reverend Bayes on inference engines: A distributed hierarchical approach, AAAI 1982.
Belief Propagation is a message passing inference method for statistical graphical models (e.g. Bayesian networks and Markov random fields). The basic idea is to compute the marginal distribution of unobserved nodes, based on the conditional distribution of observed nodes. There are two major cases:
- When the graphical model is both a factor graph and a tree (no loops), the exact marginals can be obtained. This is also equivalent to dynamic programming and Viterbi.
- Otherwise, loopy Belief Propagation will become an approximation inference algorithm.
