The Perceptron & Neural Network Basics
Weights, biases, activation functions, and the universal approximation theorem.
Training Neural Networks
Loss functions, gradient descent, backpropagation, and modern optimizers.
Convolutional Neural Networks
Convolution, pooling, LeNet to ResNet — the computer vision revolution.
Recurrent Neural Networks & Sequences
RNNs, LSTMs, GRUs, vanishing gradients, and gating mechanisms.