Linear Decoders
From Ufldl
Line 1: | Line 1: | ||
Sparse Autoencoder Recap | Sparse Autoencoder Recap | ||
+ | |||
+ | |||
In the sparse autoencoder, we had 3 layers of neurons: an input layer, a hidden layer and an output layer. In our previous description | In the sparse autoencoder, we had 3 layers of neurons: an input layer, a hidden layer and an output layer. In our previous description | ||
of autoencoders (and of neural networks), every neuron in the neural network used the same activation function. | of autoencoders (and of neural networks), every neuron in the neural network used the same activation function. |