Exercise:Sparse Autoencoder

From Ufldl

Jump to: navigation, search
(Initial import from LaTeX file)
(Added images and fixed line spacing)
Line 109: Line 109:
rather than the "<math>(W^{(1)}, W^{(2)}, b^{(1)}, b^{(2)})</math>" parameterization when passing our parameters
rather than the "<math>(W^{(1)}, W^{(2)}, b^{(1)}, b^{(2)})</math>" parameterization when passing our parameters
to it.
to it.
-
 
Train a sparse autoencoder with 64 input units, 25 hidden units, and 64 output units.
Train a sparse autoencoder with 64 input units, 25 hidden units, and 64 output units.
Line 122: Line 121:
should work, but feel free to play with different settings of the parameters as
should work, but feel free to play with different settings of the parameters as
well.
well.
-
 
===Step 5: Visualization===
===Step 5: Visualization===
Line 130: Line 128:
the visualization to a file "<tt>weights.jpg</tt>" (which you will submit together with
the visualization to a file "<tt>weights.jpg</tt>" (which you will submit together with
your code).  
your code).  
-
 
==Results==
==Results==
Line 138: Line 135:
was the visualization we obtained:  
was the visualization we obtained:  
 +
 +
[[File:Gabor.jpg]]
Line 144: Line 143:
different parameter values, be sure to budget enough time for debugging  
different parameter values, be sure to budget enough time for debugging  
and to run the experiments you'll need.  
and to run the experiments you'll need.  
-
 
-
 
Also, by way of comparison, here are some visualizations from implementations
Also, by way of comparison, here are some visualizations from implementations
that we do not consider successful (either a buggy implementation, or where
that we do not consider successful (either a buggy implementation, or where
the parameters were poorly tuned):
the parameters were poorly tuned):
 +
 +
 +
[[File:badfilter1.jpg|240 px]] [[File:badfilter2.jpg|240 px]] [[File:badfilter3.jpg|240 px]]
 +
 +
[[File:badfilter4.jpg|240 px]] [[File:badfilter5.jpg|240 px]] [[File:badfilter6.jpg|240 px]]

Revision as of 06:32, 30 March 2011

Personal tools