Exercise:Learning color features with Sparse Autoencoders
From Ufldl
(→Dependencies) |
(→Step 1: Modify sparseAutoencoderCost.m to use a linear decoder) |
||
| Line 27: | Line 27: | ||
In this step, we initialize some parameters used in the exercise. | In this step, we initialize some parameters used in the exercise. | ||
| - | === Step 1: Modify | + | === Step 1: Modify your sparse autoencoder to use a linear decoder === |
Copy <tt>sparseAutoencoder.m</tt> to the directory for this exercise and rename it to <tt>sparseAutoencoderLinear.m</tt>. Rename the function <tt>sparseAutoencoderCost</tt> in the file to <tt>sparseAutoencoderLinearCost</tt>, and modify it to use a [[Linear Decoders | linear decoder]]. In particular, you should change the cost and gradients returned to reflect the change from a sigmoid to a linear decoder. After making this change, check your gradient to ensure that they are correct. | Copy <tt>sparseAutoencoder.m</tt> to the directory for this exercise and rename it to <tt>sparseAutoencoderLinear.m</tt>. Rename the function <tt>sparseAutoencoderCost</tt> in the file to <tt>sparseAutoencoderLinearCost</tt>, and modify it to use a [[Linear Decoders | linear decoder]]. In particular, you should change the cost and gradients returned to reflect the change from a sigmoid to a linear decoder. After making this change, check your gradient to ensure that they are correct. | ||
