How do I stack vectors of different lengths in NumPy?

by

Short answer: you can’t. NumPy does not support jagged arrays natively.

Long answer:

>>> a = ones((3,))
>>> b = ones((2,))
>>> c = array([a, b])
>>> c
array([[ 1.  1.  1.], [ 1.  1.]], dtype=object)

gives an array that may or may not behave as you expect. E.g. it doesn’t support basic methods like sum or reshape, and you should treat this much as you’d treat the ordinary Python list [a, b] (iterate over it to perform operations instead of using vectorized idioms).

Several possible workarounds exist; the easiest is to coerce a and b to a common length, perhaps using masked arrays or NaN to signal that some indices are invalid in some rows. E.g. here’s b as a masked array:

>>> ma.array(np.resize(b, a.shape[0]), mask=[False, False, True])
masked_array(data = [1.0 1.0 --],
             mask = [False False  True],
       fill_value = 1e+20)

This can be stacked with a as follows:

>>> ma.vstack([a, ma.array(np.resize(b, a.shape[0]), mask=[False, False, True])])
masked_array(data =
 [[1.0 1.0 1.0]
 [1.0 1.0 --]],
             mask =
 [[False False False]
 [False False  True]],
       fill_value = 1e+20)

(For some purposes, scipy.sparse may also be interesting.)

More Related Contents:

  1. How to calculate rolling / moving average using python + NumPy / SciPy?
  2. Saving a Numpy array as an image
  3. Intuition and idea behind reshaping 4D array to 2D array in NumPy
  4. Removing nan values from an array
  5. How to count the occurrence of certain item in an ndarray?
  6. How do I compute derivative using Numpy?
  7. binning data in python with scipy/numpy
  8. How do I count the occurrence of a certain item in an ndarray?
  9. Calculating Pearson correlation and significance in Python
  10. numpy max vs amax vs maximum
  11. Replace negative values in an numpy array
  12. Python RuntimeWarning: overflow encountered in long scalars
  13. How to copy data from a numpy array to another
  14. Read a base 64 encoded image from memory using OpenCv python library
  15. Pandas in AWS lambda gives numpy error
  16. Pandas groupby with categories with redundant nan
  17. Shuffling NumPy array along a given axis
  18. How to display progress of scipy.optimize function?
  19. Easy way to test if each element in an numpy array lies between two values?
  20. Python numpy: cannot convert datetime64[ns] to datetime64[D] (to use with Numba)
  21. ImportError: No module named numpy on spark workers
  22. Weird behaviour initializing a numpy array of string data
  23. Extract csv file specific columns to list in Python
  24. How to “scale” a numpy array?
  25. Resample time series in pandas to a weekly interval
  26. How to convert an image from np.uint16 to np.uint8?
  27. Python import error: cannot import name ‘six’ from ‘sklearn.externals’
  28. Passing C++ vector to Numpy through Cython without copying and taking care of memory management automatically
  29. Numpy Broadcast to perform euclidean distance vectorized
  30. ValueError: x and y must be the same size

Leave a Comment