Methodology skeletons

AI skeletons

• Supervised model
• Self-supervised model
• Unsupervised model
  • Generative models
    • Autoregressive models
      • RNN & Transformer language models, NADE, PixelCNN, WaveNet
    • Latent variable models
      
      • Tractable: e.g. invertible / flow-based models (RealNVP, Glow, etc.)
      • Intractable: e.g. Markov Chain Monte Carlo, Variational Autoencoders series
    • Implicit models
      • Generative Adversarial Networks (GANs) and variants

Methodology concepts

• Variational Inference