SQL join or R’s merge() function in NumPy?

by

If you want to use only numpy, you can use structured arrays and the lib.recfunctions.join_by function (see http://pyopengl.sourceforge.net/pydoc/numpy.lib.recfunctions.html). A little example:

In [1]: import numpy as np
   ...: import numpy.lib.recfunctions as rfn
   ...: a = np.array([(1, 10.), (2, 20.), (3, 30.)], dtype=[('id', int), ('A', float)])
   ...: b = np.array([(2, 200.), (3, 300.), (4, 400.)], dtype=[('id', int), ('B', float)])

In [2]: rfn.join_by('id', a, b, jointype="inner", usemask=False)
Out[2]: 
array([(2, 20.0, 200.0), (3, 30.0, 300.0)], 
      dtype=[('id', '<i4'), ('A', '<f8'), ('B', '<f8')])

Another option is to use pandas (documentation). I have no experience with it, but it provides more powerful data structures and functionality than standard numpy, “to make working with “relational” or “labeled” data both easy and intuitive”. And it certainly has joining and merging functions (for example see http://pandas.sourceforge.net/merging.html#joining-on-a-key).

More Related Contents:

  1. Change sign of elements with an odd sum of indices
  2. Find unique rows in numpy.array
  3. Find nearest value in numpy array
  4. Convert a tensor to numpy array in Tensorflow?
  5. Convert array of indices to 1-hot encoded numpy array
  6. How to execute raw SQL in Flask-SQLAlchemy app
  7. Replace all elements of Python NumPy Array that are greater than some value
  8. Why are NumPy arrays so fast?
  9. What does numpy.random.seed(0) do?
  10. Calculate mean across dimension in a 2D array
  11. ValueError: numpy.ndarray size changed, may indicate binary incompatibility. Expected 88 from C header, got 80 from PyObject
  12. Numpy random choice to produce a 2D-array with all unique values
  13. pip install mysqlclient returns “fatal error C1083: Cannot open file: ‘mysql.h’: No such file or directory
  14. Most efficient property to hash for numpy array
  15. Why are 0d arrays in Numpy not considered scalar?
  16. How do you stop numpy from multithreading? [duplicate]
  17. Counting Cars OpenCV + Python Issue
  18. Vectorizing Haversine distance calculation in Python
  19. Parallelizing a Numpy vector operation
  20. numpy: efficiently summing with index arrays
  21. Preserve custom attributes when pickling subclass of numpy array
  22. What is the inverse of the numpy cumsum function?
  23. TensorFlow ValueError: Cannot feed value of shape (64, 64, 3) for Tensor u’Placeholder:0′, which has shape ‘(?, 64, 64, 3)’
  24. Subtracting numpy arrays of different shape efficiently
  25. How can I take the square root of -1 using python?
  26. Better way to shuffle two numpy arrays in unison
  27. Input and output numpy arrays to h5py
  28. Numpy sub-array assignment with advanced, mixed indexing
  29. Complex matlab-like data structure in python (numpy/scipy)
  30. Compute divergence of vector field using python

Leave a Comment