Background knowledge for Generative Adversarial Nets

Contents

1. Model related to Boltzmann machine

1. Boltzmann machine
2. Restricted Boltzmann machine
3. Deep belief network

2. Information Theory

1. What is Information theory?
2. Self-information
3. Shannon entropy
4. Kullback -Leibler divergence (KLD)
5. Cross entropy
6. Jensen–Shannon Shannon divergence

File link

link