413 views

Entropy of a discrete random variable with possible values $\{x_1, x_2, \dots , x_n\}$ and probability density function $P(X)$ is

$H(X) = \: – \sum\limits_{i=1}^{n}P(x_i) \log _bP(x_i)$

The value of $b$ gives the units of entropy. The unit for $b=10$ is

1. bits
2. bann
3. nats
4. deca

1 vote