正向KL散度與反向KL散度

KL散度的公式是 K L [ p ( x ) ∣ ∣ q ( x ) ] = ∫ x p ( x ) l o g p ( x ) q ( x ) d x KL[p(x)||q(x)] = \int_{x}p(x)log{p(x) \over q(x)}dx KL[p(x)∣∣q(x)]=∫x​p(x)logq(x)p(x)​dx 假設真實分佈爲 p ( x ) p(x) p(x)，我們想用分佈 q

>>阅读原文<<