edited by
538 views
1 votes
1 votes

Entropy of a discrete random variable with possible values $\{x_1, x_2, \dots , x_n\}$ and probability density function $P(X)$ is

$H(X) = \: –  \sum\limits_{i=1}^{n}P(x_i) \log _bP(x_i)$

The value of $b$ gives the units of entropy. The unit for $b=10$ is

  1. bits
  2. bann
  3. nats
  4. deca
edited by

Please log in or register to answer this question.

Answer:

Related questions

1 votes
1 votes
3 answers
1
Arjun asked Nov 5, 2017
870 views
Which of the following routing technique / techniques is/are used in distributed systems?Fixed RoutingVirtual RoutingDynamic Routing(a) only(a) and (b) only(c) onlyAll (a...
1 votes
1 votes
2 answers
3
Arjun asked Nov 5, 2017
954 views
The Sigmoid activation function $f(t)$ is defined as$\dfrac{1}{\text{exp} (t) + \text{exp} (-t)}$$t \text{ exp}(-t)$$\dfrac{1}{1+ \text{exp} (t)}$$\dfrac{1}{1+ \text{exp...