Neural Networks
From Ufldl
Line 52: | Line 52: | ||
A neural network is put together by hooking together many of our simple | A neural network is put together by hooking together many of our simple | ||
- | + | "neurons," so that the output of a neuron can be the input of another. For | |
example, here is a small neural network: | example, here is a small neural network: | ||
Line 58: | Line 58: | ||
In this figure, we have used circles to also denote the inputs to the network. The circles | In this figure, we have used circles to also denote the inputs to the network. The circles | ||
- | labeled | + | labeled "+1" are called '''bias units''', and correspond to the intercept term. |
The leftmost layer of the network is called the '''input layer''', and the | The leftmost layer of the network is called the '''input layer''', and the | ||
rightmost layer the '''output layer''' (which, in this example, has only one | rightmost layer the '''output layer''' (which, in this example, has only one |