Comparing two dataframes and getting the differences [duplicate]

by

This approach, df1 != df2, works only for dataframes with identical rows and columns. In fact, all dataframes axes are compared with _indexed_same method, and exception is raised if differences found, even in columns/indices order.

If I got you right, you want not to find changes, but symmetric difference. For that, one approach might be concatenate dataframes:

>>> df = pd.concat([df1, df2])
>>> df = df.reset_index(drop=True)

group by 

>>> df_gpby = df.groupby(list(df.columns))

get index of unique records

>>> idx = [x[0] for x in df_gpby.groups.values() if len(x) == 1]

filter

>>> df.reindex(idx)
         Date   Fruit   Num   Color
9  2013-11-25  Orange   8.6  Orange
8  2013-11-25   Apple  22.1     Red

More Related Contents:

  1. how to calculation cost time [closed]
  2. How to add a new column to an existing DataFrame?
  3. String concatenation of two pandas columns
  4. pandas: filter rows of DataFrame with operator chaining
  5. What rules does Pandas use to generate a view vs a copy?
  6. How to get a value from a cell of a dataframe?
  7. Multiple aggregations of the same column using pandas GroupBy.agg()
  8. How can I split a column of tuples in a Pandas dataframe?
  9. Sorting columns in pandas dataframe based on column name [duplicate]
  10. What is the difference between using loc and using just square brackets to filter for columns in Pandas/Python?
  11. Find maximum value of a column and return the corresponding row values using Pandas
  12. python – Using pandas structures with large csv(iterate and chunksize)
  13. Group duplicate column IDs in pandas dataframe
  14. How to convert column with list of values into rows in Pandas DataFrame
  15. Remove or replace spaces in column names
  16. Python – splitting dataframe into multiple dataframes based on column values and naming them with those values [duplicate]
  17. Shift NaNs to the end of their respective rows
  18. how to read certain columns from Excel using Pandas – Python
  19. OSError: Initializing from file failed on csv in Pandas
  20. Convert column to row in Python Pandas
  21. Putting many python pandas dataframes to one excel worksheet
  22. Remove Unnamed columns in pandas dataframe [duplicate]
  23. How to slice a pandas DataFrame by position?
  24. Filling in date gaps in MultiIndex Pandas Dataframe
  25. Writing a Python Pandas DataFrame to Word document
  26. Find unique values in a Pandas dataframe, irrespective of row or column location
  27. Efficient way to add rows to dataframe
  28. Find names of top-n highest-value columns in each pandas dataframe row
  29. How to upload a CSV file in FastAPI and convert it into a Pandas Dataframe?
  30. DataFrame object has no attribute append

Leave a Comment