Whitening
From Ufldl
(→Regularizaton) |
|||
Line 100: | Line 100: | ||
\end{align}</math> | \end{align}</math> | ||
When <math>\textstyle x</math> takes values around <math>\textstyle [-1,1]</math>, a value of <math>\textstyle \epsilon \approx 10^{-5}</math> | When <math>\textstyle x</math> takes values around <math>\textstyle [-1,1]</math>, a value of <math>\textstyle \epsilon \approx 10^{-5}</math> | ||
- | might be typical. With this form of regularization, the features won't all | + | might be typical. <!-- With this form of regularization, the features won't all --> |
For the case of images, adding <math>\textstyle \epsilon</math> here also has the effect of slightly smoothing (or low-pass | For the case of images, adding <math>\textstyle \epsilon</math> here also has the effect of slightly smoothing (or low-pass |