cartesian product in pandas

by

In recent versions of Pandas (>= 1.2) this is built into merge so you can do:

from pandas import DataFrame
df1 = DataFrame({'col1':[1,2],'col2':[3,4]})
df2 = DataFrame({'col3':[5,6]})    

df1.merge(df2, how='cross')

This is equivalent to the previous pandas < 1.2 answer but is easier to read.

For pandas < 1.2:

If you have a key that is repeated for each row, then you can produce a cartesian product using merge (like you would in SQL).

from pandas import DataFrame, merge
df1 = DataFrame({'key':[1,1], 'col1':[1,2],'col2':[3,4]})
df2 = DataFrame({'key':[1,1], 'col3':[5,6]})

merge(df1, df2,on='key')[['col1', 'col2', 'col3']]

Output:

   col1  col2  col3
0     1     3     5
1     1     3     6
2     2     4     5
3     2     4     6

See here for the documentation: http://pandas.pydata.org/pandas-docs/stable/merging.html

More Related Contents:

  1. Pandas Merging 101
  2. Performant cartesian product (CROSS JOIN) with pandas
  3. pandas three-way joining multiple dataframes on columns
  4. Python: pandas merge multiple dataframes
  5. Apply pandas function to column to create multiple new columns?
  6. Merge two dataframes by index
  7. Combine two pandas Data Frames (join on a common column)
  8. Difference(s) between merge() and concat() in pandas
  9. Pandas left outer join multiple dataframes on multiple columns
  10. Pandas Merge on Name and Closest Date
  11. merging 2 dataframes vertically [duplicate]
  12. How to do “(df1 & not df2)” dataframe merge in pandas?
  13. How to merge pandas on string contains?
  14. How to merge multiple dataframes
  15. “Anti-merge” in pandas (Python)
  16. how to merge two data frames based on particular column in pandas python?
  17. Improve Pandas Merge performance
  18. Python Pandas merge only certain columns
  19. In Pandas, how to delete rows from a Data Frame based on another Data Frame?
  20. MemoryError when I merge two Pandas data frames
  21. how to concat two data frames with different column names in pandas? – python
  22. Anti-Join Pandas
  23. Check if rows in one dataframe exist in another dataframe
  24. Merging two tables with millions of rows in Python
  25. Group duplicate column IDs in pandas dataframe
  26. Panda’s DataFrame – renaming multiple identically named columns
  27. Create Empty Dataframe in Pandas specifying column types
  28. Find unique values in a Pandas dataframe, irrespective of row or column location
  29. Add numpy array as column to Pandas data frame
  30. How to use ast.literal_eval in a pandas dataframe and handle exceptions

Leave a Comment