gained

Using q instead of p requires H(p, q)-H(x) extra bits. We call this value the relative entropy or Kullback-Leibler (KL)…

gained, information, mutual