# Fine-tuning Stacked AEs

 Revision as of 18:46, 11 May 2011 (view source)Jngiam (Talk | contribs)← Older edit Revision as of 18:46, 11 May 2011 (view source)Jngiam (Talk | contribs) (→Recap of the Backpropagation Algorithm)Newer edit → Line 36: Line 36: {{Quote| {{Quote| - Note: While one could consider the softmax classifier as an additional layer, the derivation above does not. Specifically, we consider the "last layer" of the network to be the features that goes into the softmax classifier. Therefore, the derivatives are computed using $\delta^{(n_l)} = - (\nabla_{a^{n_l}}J) \bullet f'(z^{(n_l)})$. + Note: While one could consider the softmax classifier as an additional layer, the derivation above does not. Specifically, we consider the "last layer" of the network to be the features that goes into the softmax classifier. Therefore, the derivatives (in Step 2) are computed using $\delta^{(n_l)} = - (\nabla_{a^{n_l}}J) \bullet f'(z^{(n_l)})$. }} }}