Fuzzy String Comparison

by

There is a package called fuzzywuzzy. Install via pip:

pip install fuzzywuzzy

Simple usage:

>>> from fuzzywuzzy import fuzz
>>> fuzz.ratio("this is a test", "this is a test!")
    96

The package is built on top of difflib. Why not just use that, you ask? Apart from being a bit simpler, it has a number of different matching methods (like token order insensitivity, partial string matching) which make it more powerful in practice. The process.extract functions are especially useful: find the best matching strings and ratios from a set. From their readme:

Partial Ratio

>>> fuzz.partial_ratio("this is a test", "this is a test!")
    100

Token Sort Ratio

>>> fuzz.ratio("fuzzy wuzzy was a bear", "wuzzy fuzzy was a bear")
    90
>>> fuzz.token_sort_ratio("fuzzy wuzzy was a bear", "wuzzy fuzzy was a bear")
    100

Token Set Ratio

>>> fuzz.token_sort_ratio("fuzzy was a bear", "fuzzy fuzzy was a bear")
    84
>>> fuzz.token_set_ratio("fuzzy was a bear", "fuzzy fuzzy was a bear")
    100

Process

>>> choices = ["Atlanta Falcons", "New York Jets", "New York Giants", "Dallas Cowboys"]
>>> process.extract("new york jets", choices, limit=2)
    [('New York Jets', 100), ('New York Giants', 78)]
>>> process.extractOne("cowboys", choices)
    ("Dallas Cowboys", 90)

More Related Contents:

  1. How to use Stanford Parser in NLTK using Python
  2. Calculate cosine similarity given 2 sentence strings
  3. Good Python modules for fuzzy string comparison? [closed]
  4. How to compute the similarity between two text documents?
  5. Creating a new corpus with NLTK
  6. Python NLTK pos_tag not returning the correct part-of-speech tag
  7. Stopword removal with NLTK
  8. Ordinal numbers replacement
  9. How to determine the language of a piece of text?
  10. NLTK Named Entity recognition to a Python list
  11. Computing N Grams using Python
  12. Python – RegEx for splitting text into sentences (sentence-tokenizing) [duplicate]
  13. Using NLTK and WordNet; how do I convert simple tense verb into its present, past or past participle form?
  14. How do I tokenize a string sentence in NLTK?
  15. How to get rid of punctuation using NLTK tokenizer?
  16. English grammar for parsing in NLTK
  17. NLTK and language detection
  18. Extract Word from Synset using Wordnet in NLTK 3.0
  19. How do I do dependency parsing in NLTK?
  20. training data format for NLTK punkt
  21. Efficiently count word frequencies in python
  22. Difference between Python’s collections.Counter and nltk.probability.FreqDist
  23. Saving nltk drawn parse tree to image file
  24. Creating a custom categorized corpus in NLTK and Python
  25. Pandas dataframe groupby text value that occurs in two columns
  26. Expanding English language contractions in Python
  27. NLTK WordNet Lemmatizer: Shouldn’t it lemmatize all inflections of a word?
  28. What is NLTK POS tagger asking me to download?
  29. How to use malt parser in python nltk
  30. How to tweak the NLTK sentence tokenizer

Leave a Comment