Math — Neural Networks

\mathbf{a} = \sigma(W\mathbf{x} + \mathbf{b})

\sigma(z) = \frac{1}{1 + e^{-z}}

\frac{\partial L}{\partial W}\ \text{via backpropagation}

W \leftarrow W - \eta\frac{\partial L}{\partial W}