Exercise:Sparse Autoencoder
From Ufldl
(Initial import from LaTeX file) |
(Added images and fixed line spacing) |
||
Line 109: | Line 109: | ||
rather than the "<math>(W^{(1)}, W^{(2)}, b^{(1)}, b^{(2)})</math>" parameterization when passing our parameters | rather than the "<math>(W^{(1)}, W^{(2)}, b^{(1)}, b^{(2)})</math>" parameterization when passing our parameters | ||
to it. | to it. | ||
- | |||
Train a sparse autoencoder with 64 input units, 25 hidden units, and 64 output units. | Train a sparse autoencoder with 64 input units, 25 hidden units, and 64 output units. | ||
Line 122: | Line 121: | ||
should work, but feel free to play with different settings of the parameters as | should work, but feel free to play with different settings of the parameters as | ||
well. | well. | ||
- | |||
===Step 5: Visualization=== | ===Step 5: Visualization=== | ||
Line 130: | Line 128: | ||
the visualization to a file "<tt>weights.jpg</tt>" (which you will submit together with | the visualization to a file "<tt>weights.jpg</tt>" (which you will submit together with | ||
your code). | your code). | ||
- | |||
==Results== | ==Results== | ||
Line 138: | Line 135: | ||
was the visualization we obtained: | was the visualization we obtained: | ||
+ | |||
+ | [[File:Gabor.jpg]] | ||
Line 144: | Line 143: | ||
different parameter values, be sure to budget enough time for debugging | different parameter values, be sure to budget enough time for debugging | ||
and to run the experiments you'll need. | and to run the experiments you'll need. | ||
- | |||
- | |||
Also, by way of comparison, here are some visualizations from implementations | Also, by way of comparison, here are some visualizations from implementations | ||
that we do not consider successful (either a buggy implementation, or where | that we do not consider successful (either a buggy implementation, or where | ||
the parameters were poorly tuned): | the parameters were poorly tuned): | ||
+ | |||
+ | |||
+ | [[File:badfilter1.jpg|240 px]] [[File:badfilter2.jpg|240 px]] [[File:badfilter3.jpg|240 px]] | ||
+ | |||
+ | [[File:badfilter4.jpg|240 px]] [[File:badfilter5.jpg|240 px]] [[File:badfilter6.jpg|240 px]] |