Difference between revisions of "KL Divergence"
From Cohen Courses
Jump to navigationJump to search| Line 1: | Line 1: | ||
| − | Its a metric which is used to measure the similarity between two probability distribution P and Q. | + | Its a metric which is used to measure the similarity between two probability distribution "P" and "Q". |
For probability distributions ''P'' and ''Q'' of a discrete random variable | For probability distributions ''P'' and ''Q'' of a discrete random variable | ||
Revision as of 23:53, 31 March 2011
Its a metric which is used to measure the similarity between two probability distribution "P" and "Q".
For probability distributions P and Q of a discrete random variable their K–L divergence is defined to be
