Public marks with tag "information theory" Public marks with tag "information theory" http://blogmarks.net/marks/tag/information theory An Intuitive Explanation of the Information Entropy of a Random Variable http://danielwilkerson.com/entropy.html There is a popular game called twenty questions that works like this. One person is the "Knower" and picks a point out of the probability space of all objects (thinks of an object). The other is the "Guesser" and asks the Knower to evaluate various random variables (questions) at that point (answer the questions of the object). The Guesser wins if he can guess the object the Knower is thinking about by asking at most twenty questions. 2007-09-22T17:29:16Z ogrisel information theory, entropy, game

An Intuitive Explanation of the Information Entropy of a Random Variable

by ogrisel

There is a popular game called twenty questions that works like this. One person is the "Knower" and picks a point out of the probability space of all objects (thinks of an object). The other is the "Guesser" and asks the Knower to evaluate various random variables (questions) at that point (answer the questions of the object). The Guesser wins if he can guess the object the Knower is thinking about by asking at most twenty questions.

Copy | React (0)
]]>