l What′s invariance?
l How to learn invariance?
n Traditional methods
u Tangent propagation
u Invariant kernels
n Extracting invariant features.
u Hand-crafted features
u Learned features
u Combine hand-crafted and learned features
l How to measure invariance?
n Grating test
n Natural video test
l Invariances in face recognition
Aapo Hyvarinen, Yan Karklin
【CM】Hyvarinen, A. and Hoyer, P. (2001). A two-layer sparse coding model learns simple and complex cell receptive fields and topography from natural images. Vision Research, 41(18):2413–2423.
【CM】Karklin, Y., & Lewicki, M. S. (2009). Emergence of complex cell properties by learning to generalize in natural scenes. Nature, 457(7225), 83-85.
【CM】Adelson E.H. and Bergen J.R. (1985) Spatiotemporal energy models for the perception of motion. Journal Opt. Soc. Am.
【ML】Ian J. Goodfellow, Quoc V. Le, Andrew M. Saxe, Honglak Lee, and Andrew Y. Ng. (2009) Measuring invariances in deep networks. Advances in Neural Information Processing Systems (NIPS).
补充
【ML】Q.V. Le, et, al. Building high-level features using large scale unsupervised learning. ICML, 2012.