Pandas: remove duplicates that exist in any order

by

I think that you can do this with stack, drop_duplicates and unstack:

data.set_index(['A','B']).stack().drop_duplicates().unstack().reset_index()

    A   B  C  D
0   0  50  a  y
1  10  22  b  c
2  11  35  r  w
3  21   5  x  z

More Related Contents:

  1. How to write this code without using pandas?
  2. How to plot in multiple subplots
  3. Faster way to read Excel files to pandas dataframe
  4. Format y axis as percent
  5. float64 with pandas to_csv
  6. How do I transpose dataframe in pandas without index?
  7. How to select all columns whose names start with X in a pandas DataFrame
  8. Append column to pandas dataframe
  9. How do I round datetime column to nearest quarter hour
  10. How to plot and annotate grouped bars in seaborn / matplotlib
  11. Print the raw value of a column alone, in pandas?
  12. Pandas merge two dataframes with different columns
  13. Pandas filter dataframe rows with a specific year
  14. Divide multiple columns by another column in pandas
  15. Access index in pandas.Series.apply
  16. Python Pandas to_sql, how to create a table with a primary key?
  17. Pandas “Group By” Query on Large Data in HDFStore?
  18. Apply function to each cell in DataFrame
  19. Export Pandas DataFrame into a PDF file using Python
  20. Concat DataFrame Reindexing only valid with uniquely valued Index objects
  21. pandas – Merge nearly duplicate rows based on column value
  22. Pivot Tables or Group By for Pandas?
  23. Giving a column multiple indexes/headers
  24. Create a pandas DataFrame from generator?
  25. Pandas DataFrame search is linear time or constant time?
  26. case_when function from R to Python
  27. Pandas Dataframe Comparison and Floating Point Precision
  28. numerical sort a column containing numbers and strings (pandas/python)
  29. Faster way to transform group with mean value in Pandas
  30. DataFrame object has no attribute append

Leave a Comment