Counting the Frequency of words in a pandas data frame

by

IIUIC, use value_counts()

In [3361]: df.Firm_Name.str.split(expand=True).stack().value_counts()
Out[3361]:
Society       3
Ltd           2
James's       1
R.X.          1
Yah           1
Associates    1
St            1
Kensington    1
MMV           1
Big           1
&             1
The           1
Co            1
Oil           1
Building      1
dtype: int64

Or,

pd.Series(np.concatenate([x.split() for x in df.Firm_Name])).value_counts()

Or,

pd.Series(' '.join(df.Firm_Name).split()).value_counts()

For top N, for example 3

In [3379]: pd.Series(' '.join(df.Firm_Name).split()).value_counts()[:3]
Out[3379]:
Society    3
Ltd        2
James's    1
dtype: int64

Details

In [3380]: df
Out[3380]:
      URN                   Firm_Name
0  104472               R.X. Yah & Co
1  104873        Big Building Society
2  109986          St James's Society
3  114058  The Kensington Society Ltd
4  113438      MMV Oil Associates Ltd

More Related Contents:

  1. re.sub erroring with “Expected string or bytes-like object”
  2. NLTK-based text processing with pandas
  3. How to apply NLTK word_tokenize library on a Pandas dataframe for Twitter data?
  4. Selecting a row of pandas series/dataframe by integer index
  5. pandas: merge (join) two data frames on multiple columns
  6. How do I find the closest values in a Pandas series to an input number?
  7. How to display custom values on a bar plot
  8. How do I count the NaN values in a column in pandas DataFrame?
  9. Dummy variables when not all categories are present
  10. getting the index of a row in a pandas apply function
  11. Recursive definitions in Pandas
  12. Tilde sign in pandas DataFrame
  13. Drop columns whose name contains a specific string from pandas DataFrame
  14. Python Pandas How to assign groupby operation results back to columns in parent dataframe?
  15. Panda’s Write CSV – Append vs. Write
  16. Pandas Merge on Name and Closest Date
  17. Convert Pandas Series to DateTime in a DataFrame
  18. Expanding pandas data frame with date range in columns
  19. How to use a conditional statement based on DataFrame boolean value in pandas
  20. Stacked bar chart in Seaborn
  21. Why is np.where faster than pd.apply
  22. Improve subplot size/spacing with many subplots
  23. Extract column value based on another column in Pandas
  24. Change the color of text within a pandas dataframe html table python using styles and css
  25. pandas – scatter plot with different color legend for each point
  26. Pandas: parse merged header columns from Excel
  27. Remove substring from column based on another column
  28. Split Python sequence (time series/array) into subsequences with overlap
  29. start index at 1 for Pandas DataFrame
  30. Multi Index Sorting in Pandas

Leave a Comment