Neural Gym Initial Draft

Neural networks

• Loading, Encoding and Standardizing data →
• Linearity and Non-Linearity (Activation Functions) →
• Weights, Loss, Gradient and Backpropagation →
• Optimization Algorithms →
  • Gradient Descent
  • Momentum
  • Other types of optims (Adam, SGD, RMS prop)
• Training and Inferencing →
• Generalization and Regularization ( Prevent Overfitting) →
  • Dropout
  • Weight Decay
  • Other Regularization algorithms …

Convolutions (Still in drafting progress …)