Neural Networks

Biological neural networks. Artificial neural networks. Basic neuron. Modeling the single neuron. Feed-forward architectures. Recurrent neural networks. Restricted boltzmann machines. Learning algorithms. Back propagation. Contrastive divergence. Optimization and generalization for neural networks. Autoencoders. Deep belief networks. Convolutional neural networks. Long short-term memory networks. Self-attention and transformers. Adversarial networks.