Texture Segmentation Based on Voting of Blocks, Bayesian Flooding and Region Merging

Introduction

We propose an unsupervised texture image segmentation framework with unknown number of regions, which involves feature extraction and classification in feature space, followed by flooding and merging in spatial domain. The distribution of the features for the different classes are obtained by a block-wise unsupervised voting framework using the blocks grid graph or its minimum spanning tree and the Mallows distance. Experimental results  are presented on on the Prague benchmark data set demonstrating the high-performance of the proposed scheme [1].

 

                                                  


Methodology

Figure 2: The main steps of the proposed method.

The block size as well as the minimum (MINR) and the maximum (MAXR) number of possible regions are
the three parameters of the proposed method method. The proposed scheme [1] consists of several steps.

  • The image is divided into overlapping blocks, whose content is described by the distribution of three color Lab components and two components from wavelet transform to represent the texture [8].

  • The Voting framework [4-5] selects the MAXR representative blocks using as input the blocks grid graph or its minimum spanning tree and the Mallows distance (see Fig. 1).

  • Then, for each possible number of regions K ∈ {MINR, ...,MAXR}, we have performed the following steps (see lines 4-9 of Fig. 2).  Based on the Mallows distance and the K first representative blocks as extracted by a Voting Framework, the rest blocks are grouped in clusters with homogeneous content. Then a k-centroids clustering procedure is applied using the Bhattacharyya distance between the distributions of features extracted from each block cluster. Based on the resulting clustering, the feature classes are extracted and described, one per cluster, and then, probabilistic distances are used to select and label a set of pixels that belong to each class with high confidence, thus providing an initial map of almost correctly labelled pixels. Different existing components of the same class are captured by the initial seed-regions. Having the data modelling available and the initial map of almost correctly labelled pixels, we have used an algorithm in order to fill the initial map of decisions, using statistical dissimilarity criteria. The new algorithm, Priority Multi-Class Flooding Algorithm (PMCFA)  [2,3] imposes strong topology constraints in such a way that also allows topological flexibility. The segmentation map is constructed respecting the proximity principle. The final step of our framework is a statistical region merging algorithm [2].

  • Finally, we select the segmentation that minimizes a  criterion  taking into account the average likelihood per pixel  of the classification map and penalizes the complexity of the regions boundaries.

 

                                                


Downloads

  • You can download the full experimental results of the proposed method [1] on the Prague benchmark data set. See the corresponding readme.txt files for instructions. You can use them only for non-commercial purposes. If you use them, please cite the articles [1-2].

 


Related Publications

[1] C. Panagiotakis, I. Grinias, and G. Tziritas, Texture Segmentation Based on Voting of Blocks, Bayesian Flooding and Region Merging,  ICPR, 2014 (under review).

[2]  C. Panagiotakis, I. Grinias and G. Tziritas, Natural Image Segmentation based  on Tree Equipartition, Bayesian Flooding and Region Merging,   IEEE Trans. on Image Processing, IEEE Transactions on Image Processing, Vol. 20, No. 8, pp. 2276 - 2287, Aug. 2011.

[3]. I. Grinias, Bayesian Flooding for Image and Video Segmentation, University of Crete, PhD Thesis, 2009.

[4] C. Panagiotakis and P. Fragopoulou, Voting Clustering and Key Points Selection, International Conference on Computer Analysis of Images and Patterns, 2013. 

[5] C. Panagiotakis, Clustering via Voting Maximization, submitted to Journal of Classification, 2013.

[6]. C. Panagiotakis, H. Papadakis, E. Grinias, N. Komodakis, P. Fragopoulou and G. Tziritas, Interactive Image Segmentation Based on Synthetic Graph Coordinates, Pattern Recognition, vol. 46, no. 11, pp. 2940-2952, Nov. 2013.

[7]. C. Panagiotakis, H. Papadakis, E. Grinias, N. Komodakis, P. Fragopoulou and G. Tziritas, Interactive Image Segmentation via Graph Clustering and Synthetic Coordinates Modeling, International Conference on Computer Analysis of Images and Patterns, 2013.

[8] S. Liapis, E. Sifakis, and G. Tziritas, Colour and texture segmentation using wavelet frame analysis, deterministic relaxation and fast marching algorithms, Journal of Visual Communication and Image Representation, vol. 15, no. 1, pp. 1–26, Mar. 2004.