Exercise: Implement deep networks for digit classification

From Ufldl

Jump to: navigation, search
(Step 5: Test the model)
(Step 4: Implement fine-tuning)
Line 46: Line 46:
To help you check that your implementation is correct, you should also check your gradients on a synthetic small dataset. We have implemented <tt>checkStackedAECost.m</tt> to help you check your gradients. If this checks passes, you will have implemented fine-tuning correctly.
To help you check that your implementation is correct, you should also check your gradients on a synthetic small dataset. We have implemented <tt>checkStackedAECost.m</tt> to help you check your gradients. If this checks passes, you will have implemented fine-tuning correctly.
-
{{Quote|
+
'''Note:''' When adding the weight decay term to the cost, you should regularize '''all''' the weights in the network.
-
Note: When adding the weight decay term to the cost, you should regularize '''all''' the weights in the network.
+
-
}}
+
-
 
+
'''Implementation Tip:''' It is always a good idea to implement the code modularly and check (the gradient) of each part of the code before writing the more complicated parts.
-
{{Quote|
+
-
Implementation Tip: It is always a good idea to implement the code modularly and check (the gradient) of each part of the code before writing the more complicated parts.  
+
-
}}
+
=== Step 5: Test the model ===
=== Step 5: Test the model ===

Revision as of 17:47, 13 May 2011

Personal tools