Apply fuzzy matching across a dataframe column and save results in a new column

by

I couldn’t tell what you were doing. This is how I would do it.

from fuzzywuzzy import fuzz
from fuzzywuzzy import process

Create a series of tuples to compare:

compare = pd.MultiIndex.from_product([df1['Company'],
                                      df2['FDA Company']]).to_series()

Create a special function to calculate fuzzy metrics and return a series.

def metrics(tup):
    return pd.Series([fuzz.ratio(*tup),
                      fuzz.token_sort_ratio(*tup)],
                     ['ratio', 'token'])

Apply metrics to the compare series

compare.apply(metrics)

enter image description here

There are bunch of ways to do this next part:

Get closest matches to each row of df1

compare.apply(metrics).unstack().idxmax().unstack(0)

enter image description here

Get closest matches to each row of df2

compare.apply(metrics).unstack(0).idxmax().unstack(0)

enter image description here

More Related Contents:

  1. Vectorizing or Speeding up Fuzzywuzzy String Matching on PANDAS Column
  2. how to parallelize many (fuzzy) string comparisons using apply in Pandas?
  3. Select nan column in pandas
  4. How to identify and label similar rows in a pandas data frame
  5. How do I read a large csv file with pandas?
  6. How can I use the apply() function for a single column?
  7. Pandas filtering for multiple substrings in series
  8. Filtering Pandas DataFrames on dates
  9. Remove duplicates by columns A, keeping the row with the highest value in column B
  10. How can I display full (non-truncated) dataframe information in HTML when converting from Pandas dataframe to HTML?
  11. pandas: to_numeric for multiple columns
  12. Access to table objects on Webpage Using Python Selenium
  13. How to flatten a hierarchical index in columns
  14. Most efficient way to sort an array into bins specified by an index array?
  15. Python Pandas Conditional Sum with Groupby
  16. Pandas DataFrames with NaNs equality comparison
  17. Impute categorical missing values in scikit-learn
  18. How to save a Seaborn plot into a file
  19. Using conditional to generate new column in pandas dataframe
  20. round a single column in pandas
  21. Identifying statistical outliers with pandas: groupby and reduce rows into different dataframe
  22. Writing large Pandas Dataframes to CSV file in chunks
  23. NumPy version of “Exponential weighted moving average”, equivalent to pandas.ewm().mean()
  24. Split pandas dataframe based on values in a column using groupby
  25. FutureWarning: The default value of regex will change from True to False in a future version
  26. Pretty print a pandas dataframe in VS Code
  27. Transpose the data in a column every nth rows in PANDAS
  28. Python making combined bar and line plot with secondary y-axis
  29. How to efficiently assign unique ID to individuals with multiple entries based on name in very large df
  30. Add image annotations to bar plots

Leave a Comment