Text clustering with Levenshtein distances

by

This may be a bit simplistic, but here’s a code example that uses hierarchical clustering based on Levenshtein distance in R.

set.seed(1)
rstr <- function(n,k){   # vector of n random char(k) strings
  sapply(1:n,function(i){do.call(paste0,as.list(sample(letters,k,replace=T)))})
}

str<- c(paste0("aa",rstr(10,3)),paste0("bb",rstr(10,3)),paste0("cc",rstr(10,3)))
# Levenshtein Distance
d  <- adist(str)
rownames(d) <- str
hc <- hclust(as.dist(d))
plot(hc)
rect.hclust(hc,k=3)
df <- data.frame(str,cutree(hc,k=3))

In this example, we create a set of 30 random char(5) strings artificially in 3 groups (starting with “aa”, “bb”, and “cc”). We calculate the Levenshtein distance matrix using adist(...), and we run heirarchal clustering using hclust(...). Then we cut the dendrogram into three clusters with cutree(...) and append the cluster id’s to the original strings.

More Related Contents:

  1. How to plot intersecting ranges in Excel/R/Matlab [closed]
  2. How do I know which observations belong to which cluster? [closed]
  3. Cluster analysis in R: determine the optimal number of clusters
  4. A similar function to R’s rep in Matlab [duplicate]
  5. Cluster one-dimensional data optimally? [closed]
  6. Fast Levenshtein distance in R?
  7. R Scatter Plot: symbol color represents number of overlapping points
  8. Identifying points by color
  9. 3d plot in R – Patch
  10. Efficient string similarity grouping
  11. Filter data.frame rows by a logical condition
  12. Pass a data.frame column name to a function
  13. Plot two graphs in same plot in R
  14. How can I plot data with confidence intervals?
  15. ggplot2: change order of display of a factor variable on an axis
  16. How to increase the space between the bars in a bar plot in ggplot2?
  17. Finding out which functions are called within a given function [duplicate]
  18. Rscript does not load methods package, R does — why, and what are the consequences?
  19. Accept HTTP Request in R shiny application
  20. How to extract the fill colours from a ggplot object?
  21. How to merge and sum two data frames
  22. Create categorical variable in R based on range
  23. dplyr mutate rowwise max of range of columns
  24. Using dynamic column names in `data.table`
  25. Spreading a two column data frame with tidyr
  26. Getting a function name as a string
  27. How to calculate number of days between two dates in R
  28. Match legend text color in geom_text to symbol [duplicate]
  29. Multiply columns in a data frame by a vector
  30. R – What algorithm does geom_density() use and how to extract points/equation of curves?

Leave a Comment