7. Self-Organizing Maps : Introduction The neurons in the output layer are arranged on a map 2d array of neurons Set of input signals (connected to all neurons in lattice) Weighted synapses x 1 x 2 x 3 x n ... w j1 w j2 w j3 w jn j
8. Self-Organizing Maps : Introduction The figure shows a very small Kohonen network of 4 x 4 nodes connected to the input layer (shown in green) representing a two dimensional vector. Each node has a specific topological position (an x, y coordinate in the lattice) and contains a vector of weights of the same dimension as the input vectors. If the training data consists of vectors, V , of n dimensions: V1, V2, V3...Vn Then each node will contain a corresponding weight vector W, of n dimensions: W1, W2, W3...Wn Kohonen Network Architecture
9. Example Self-Organizing Maps ‘ Poverty map’ based on 39 indicators from World Bank statistics (1992) World Poverty Map A SOM has been used to classify statistical data describing various quality-of-life factors such as state of health, nutrition, educational services etc. . Countries with similar quality-of-life factors end up clustered together . The countries with better quality-of-life are situated toward the upper left and the most poverty stricken countries are toward the lower right. SOM – Result Example
16. Example TEST NETWORK Suppose the input pattern is 1100. Then Thus neuron 2 is the " winner ", and is the localized active region of the SOM. Notice that we may label this input pattern to belong to cluster 2. For all the other patterns, we find the clusters are as listed below. This matrix seems to converge to
17. Application Using SOM to cluster Data The IRIS dataset IRIS is a classical data set used by statisticians to check classification methods. It is composed by 150 samples of flowers divided into 3 classes (50 setosa, 50 versicolor, 50 virginica) and described by 4 variables (petal length, petal width, sepal length, sepal width
18. Application Using SOM to cluster Data Graphical Results we can look at the assignment of each neuron (i.e. each neuron will be coloured on the basis of the assigned class).
19. Application Using SOM to cluster Data Graphical Results we can look at the weights of a specific neuron and at the labels of the samples placed in that neuron