Adversarial Auto-Encoders

目錄

• Another Approach: q(z)->p(z)
  • Intuitively comprehend KL(p|q)
• Minimize KL Divergence
  • How to compute KL between q(z) and p(z)

• Distribution of hidden code

• Give more details after GAN

Another Approach: q(z)->p(z)

• Explicitly enforce

Intuitively comprehend KL(p|q)

\(KL \in{[0,+\infty]}\)

• KL = 0 --> \(p\approx{q}\)

Minimize KL Divergence

• Evidence Lower BOund

\[ KL(q_\theta(z|x_i)||p(z)) \]

How to compute KL between q(z) and p(z)

咱們所但願的兩點：

• 重建變量
• 隱藏變量逼近p的分佈