KL divergence over-estimate/under-estimate

reference: Very intuitive example shown in this blog https://wiseodd.github.io/techblog/2016/12/21/forward-reverse-kl/ Let our true distribution defined as P ( X ) P(X) P(X), and the approximate distr

>>阅读原文<<