September 18, 2015

Deep learning (LeCun, Bengio, & Hinton (2015))

Deep Learning in neural networks: an overview (Schmidhuber 2015)

Michael A. Neilsen's Neural Networks & Deep Learning

Take input \(x_{p\times 1}\) and calculate the weighed input \(w\cdot x + b\), where

- \(w_{p\times 1}\) is a vector of weights applied to the input, and
- \(b\) is a scalar bias term that offsets the weighted sum

Now, classify x according to

\[output = \begin{cases} 0 & \text{if } w\cdot x + b \leq 0 \\ 1 & \text{if } w\cdot x + b > 0 \end{cases}\]