How to get flat clustering corresponding to color clusters in the dendrogram created by scipy

by

I think you’re on the right track. Let’s try this:

import scipy
import scipy.cluster.hierarchy as sch
X = scipy.randn(100, 2)     # 100 2-dimensional observations
d = sch.distance.pdist(X)   # vector of (100 choose 2) pairwise distances
L = sch.linkage(d, method='complete')
ind = sch.fcluster(L, 0.5*d.max(), 'distance')

ind will give you cluster indices for each of the 100 input observations. ind depends on what method you used in linkage. Try method=single, complete, and average. Then note how ind differs.

Example:

In [59]: L = sch.linkage(d, method='complete')

In [60]: sch.fcluster(L, 0.5*d.max(), 'distance')
Out[60]: 
array([5, 4, 2, 2, 5, 5, 1, 5, 5, 2, 5, 2, 5, 5, 1, 1, 5, 5, 4, 2, 5, 2, 5,
       2, 5, 3, 5, 3, 5, 5, 5, 5, 5, 5, 5, 2, 2, 5, 5, 4, 1, 4, 5, 2, 1, 4,
       2, 4, 2, 2, 5, 5, 5, 2, 5, 5, 3, 5, 5, 4, 5, 4, 5, 3, 5, 3, 5, 5, 5,
       2, 3, 5, 5, 4, 5, 5, 2, 2, 5, 2, 2, 4, 1, 2, 1, 5, 2, 5, 5, 5, 1, 5,
       4, 2, 4, 5, 2, 4, 4, 2])

In [61]: L = sch.linkage(d, method='single')

In [62]: sch.fcluster(L, 0.5*d.max(), 'distance')
Out[62]: 
array([1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,
       1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,
       1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,
       1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,
       1, 1, 1, 1, 1, 1, 1, 1])

scipy.cluster.hierarchy sure is confusing. In your link, I don’t even recognize my own code!

More Related Contents:

  1. plotting results of hierarchical clustering ontop of a matrix of data in python
  2. Use Distance Matrix in scipy.cluster.hierarchy.linkage()?
  3. plotting results of hierarchical clustering on top of a matrix of data
  4. Computing the correlation coefficient between two multi-dimensional arrays
  5. How does condensed distance matrix work? (pdist)
  6. ImportError in importing from sklearn: cannot import name check_build
  7. binning data in python with scipy/numpy
  8. Calculating Pearson correlation and significance in Python
  9. Calculating the area under a curve given a set of coordinates, without knowing the function
  10. How to implement band-pass Butterworth filter with Scipy.signal.butter
  11. Sparse matrix slicing using list of int
  12. What do all the distributions available in scipy.stats look like?
  13. Python Scipy FFT wav files
  14. Python 3D polynomial surface fit, order dependent
  15. Efficiently create sparse pivot tables in pandas?
  16. Map each list value to its corresponding percentile
  17. Improving FFT performance in Python
  18. Creating a Confidence Ellipses in a sccatterplot using matplotlib
  19. scipy, lognormal distribution – parameters
  20. Most efficient way to calculate radial profile
  21. Efficient distance calculation between N points and a reference in numpy/scipy
  22. Distance between point and a line (from two points)
  23. Python/Scipy 2D Interpolation (Non-uniform Data)
  24. scipy signal find_peaks_cwt not finding the peaks accurately?
  25. scipy with py2exe
  26. How to transform numpy.matrix or array to scipy sparse matrix
  27. Matplotlib – Finance volume overlay
  28. Convert Pandas dataframe to Sparse Numpy Matrix directly
  29. Structure of inputs to scipy minimize function
  30. ValueError: Dimension mismatch

Leave a Comment