Linear Decoders

From Ufldl

Jump to: navigation, search
Line 47: Line 47:
\begin{align}
\begin{align}
\delta_i^{(3)} = - (y_i - \hat{x}_i)
\delta_i^{(3)} = - (y_i - \hat{x}_i)
-
\end{align}
 
-
</math>
 
-
:<math>
 
-
\begin{align}
 
-
\delta_i^{(3)}
 
-
= \frac{\partial}{\partial z_i} \;\;
 
-
        \frac{1}{2} \left\|y - \hat{x}\right\|^2 = - (y_i - \hat{x}_i) \cdot f'(z_i^{(3)})
 
\end{align}
\end{align}
</math>
</math>
-
 
Of course, when using backpropagation to compute the error terms for the ''hidden'' layer:
Of course, when using backpropagation to compute the error terms for the ''hidden'' layer:

Revision as of 05:36, 8 March 2013

Personal tools