Find symmetric pairs quickly in numpy

by

You can sort the values, then groupby:

a= np.sort(df.to_numpy(), axis=1)
df.groupby([a[:,0], a[:,1]], as_index=False, sort=False).first()

Option 2: If you have a lot of pairs c1, c2, groupby can be slow. In that case, we can assign new values and filter by drop_duplicates:

a= np.sort(df.to_numpy(), axis=1) 

(df.assign(one=a[:,0], two=a[:,1])   # one and two can be changed
   .drop_duplicates(['one','two'])   # taken from above
   .reindex(df.columns, axis=1)
)

More Related Contents:

  1. Fast punctuation removal with pandas
  2. String concatenation of two pandas columns
  3. How to one-hot-encode from a pandas column containing a list?
  4. Calculate average of every x rows in a table and create new table
  5. Find column name in pandas that matches an array
  6. Most efficient way to forward-fill NaN values in numpy array
  7. Select multiple ranges of columns in Pandas DataFrame
  8. How to one hot encode variant length features?
  9. Improve Row Append Performance On Pandas DataFrames
  10. Missing data, insert rows in Pandas and fill with NAN
  11. Precision lost while using read_csv in pandas
  12. pandas equivalent of np.where
  13. which is faster for load: pickle or hdf5 in python
  14. Saving Matplotlib graphs to image as full screen
  15. Create new dataframe in pandas with dynamic names also add new column
  16. Pandas Latitude-Longitude to distance between successive rows [duplicate]
  17. pd.Timestamp versus np.datetime64: are they interchangeable for selected uses?
  18. Create new column based on values from other columns / apply a function of multiple columns, row-wise in Pandas
  19. Pandas in AWS lambda gives numpy error
  20. Pandas groupby with categories with redundant nan
  21. Filling in date gaps in MultiIndex Pandas Dataframe
  22. Different std in pandas vs numpy
  23. Python numpy: cannot convert datetime64[ns] to datetime64[D] (to use with Numba)
  24. Getting days since last occurence in Pandas DataFrame?
  25. Add numpy array as column to Pandas data frame
  26. Stratified Sampling in Pandas
  27. Load CSV to Pandas MultiIndex DataFrame
  28. AttributeError: module ‘numpy’ has no attribute ‘__version__’
  29. Python pandas – new column’s value if the item is in the list
  30. Why is NaN considered as a float?

Leave a Comment