Numpy: Fix array with rows of different lengths by filling the empty elements with zeros

by

This could be one approach –

def numpy_fillna(data):
    # Get lengths of each row of data
    lens = np.array([len(i) for i in data])

    # Mask of valid places in each row
    mask = np.arange(lens.max()) < lens[:,None]

    # Setup output array and put elements from data into masked positions
    out = np.zeros(mask.shape, dtype=data.dtype)
    out[mask] = np.concatenate(data)
    return out

Sample input, output –

In [222]: # Input object dtype array
     ...: data = np.array([[1, 2, 3, 4],
     ...:                  [2, 3, 1],
     ...:                  [5, 5, 5, 5, 8 ,9 ,5],
     ...:                  [1, 1]])

In [223]: numpy_fillna(data)
Out[223]: 
array([[1, 2, 3, 4, 0, 0, 0],
       [2, 3, 1, 0, 0, 0, 0],
       [5, 5, 5, 5, 8, 9, 5],
       [1, 1, 0, 0, 0, 0, 0]], dtype=object)

More Related Contents:

  1. Performance of Pandas apply vs np.vectorize to create new column from existing columns
  2. numpy: most efficient frequency counts for unique values in an array
  3. Why is numpy’s einsum faster than numpy’s built in functions?
  4. Numpy sum elements in array based on its value
  5. Efficiently return the index of the first value satisfying condition in array
  6. Implement MATLAB’s im2col ‘sliding’ in Python
  7. Frequency counts for unique values in a NumPy array
  8. Most efficient way to forward-fill NaN values in numpy array
  9. Why is a `for` over a Python list faster than over a Numpy array?
  10. Fastest save and load options for a numpy array
  11. Why is Numpy much faster at creating a Zero array compared to replacing the values of an existing array with zeros?
  12. Efficient dot products of large memory-mapped arrays
  13. Creating a numpy array of 3D coordinates from three 1D arrays
  14. Store different datatypes in one NumPy array?
  15. Comparing two NumPy arrays for equality, element-wise
  16. Finding indices of matches of one array in another array
  17. How to copy a 2D array into a 3rd dimension, N times?
  18. How do I convert a numpy array to (and display) an image?
  19. How does NumPy’s transpose() method permute the axes of an array?
  20. Installing Numpy on 64bit Windows 7 with Python 2.7.3 [closed]
  21. How do I print the full NumPy array, without truncation?
  22. RuntimeError: module compiled against API version a but this version of numpy is 9
  23. Repeat each values of an array different times
  24. How to create 2d array with numpy random.choice for every rows?
  25. Append 2D array to 3D array, extending third dimension
  26. What is the best approach in python: multiple OR or IN in if statement?
  27. Working with floating point NumPy arrays for comparison and related operations
  28. Mapping a NumPy array in place
  29. How to implement Garbage Collection in Numpy
  30. numpy array row major and column major

Leave a Comment