This paper proposes a novel texture representation suitable for recognizing images of textured surfaces under a wide range of transformations, including viewpoint changes and non-rigid deformations. Unlike many existing feature extraction methods, which treat the neighborhood of every pixel as a candidate texture element, the proposed algorithm works by selecting a sparse set of affine-invariant local patches. This spatial selection process, besides providing greater computational efficiency...