Drop all duplicate rows across multiple columns in Python Pandas

by

This is much easier in pandas now with drop_duplicates and the keep parameter.

import pandas as pd
df = pd.DataFrame({"A":["foo", "foo", "foo", "bar"], "B":[0,1,1,1], "C":["A","A","B","A"]})
df.drop_duplicates(subset=['A', 'C'], keep=False)

More Related Contents:

  1. Remove pandas rows with duplicate indices
  2. Remove duplicates by columns A, keeping the row with the highest value in column B
  3. How do I get a list of all the duplicate items using pandas in python?
  4. Remove duplicates from dataframe, based on two columns A,B, keeping row with max value in another column C
  5. Group duplicate column IDs in pandas dataframe
  6. How to concatenate two dataframes without duplicates?
  7. Remove duplicate rows from Pandas dataframe where only some columns have the same value
  8. drop_duplicates not working in pandas?
  9. How to repeat a Pandas DataFrame?
  10. How to “select distinct” across multiple data frame columns in pandas?
  11. pandas get column average/mean
  12. python pandas extract year from datetime: df[‘year’] = df[‘date’].year is not working
  13. How can I strip the whitespace from Pandas DataFrame headers?
  14. Select Pandas rows based on list index
  15. selecting across multiple columns with python pandas?
  16. Problem in combining bar plot and line plot (python)
  17. Bar Chart: How to choose color if value is positive vs value is negative
  18. import pandas_datareader gives ImportError: cannot import name ‘is_list_like’
  19. vectorize conditional assignment in pandas dataframe
  20. Read csv from Google Cloud storage to pandas dataframe
  21. How to set the pandas dataframe data left/right alignment?
  22. Convert numpy type to python
  23. How to get/set a pandas index column title or name?
  24. Pandas: drop columns with all NaN’s
  25. How can I create the minimum size executable with pyinstaller?
  26. Normalize DataFrame by group
  27. Color a scatter plot by Column Values
  28. pandas extract year from datetime: df[‘year’] = df[‘date’].year is not working
  29. pandas.read_csv FileNotFoundError: File b’\xe2\x80\xaa’ despite correct path
  30. Pandas: Selecting rows based on value counts of a particular column

Leave a Comment