Numpy isnan() fails on an array of floats (from pandas dataframe apply)

by

np.isnan can be applied to NumPy arrays of native dtype (such as np.float64):

In [99]: np.isnan(np.array([np.nan, 0], dtype=np.float64))
Out[99]: array([ True, False], dtype=bool)

but raises TypeError when applied to object arrays:

In [96]: np.isnan(np.array([np.nan, 0], dtype=object))
TypeError: ufunc 'isnan' not supported for the input types, and the inputs could not be safely coerced to any supported types according to the casting rule ''safe''

Since you have Pandas, you could use pd.isnull instead — it can accept NumPy arrays of object or native dtypes:

In [97]: pd.isnull(np.array([np.nan, 0], dtype=float))
Out[97]: array([ True, False], dtype=bool)

In [98]: pd.isnull(np.array([np.nan, 0], dtype=object))
Out[98]: array([ True, False], dtype=bool)

Note that None is also considered a null value in object arrays.

More Related Contents:

  1. Convert pandas dataframe to NumPy array
  2. Performance of Pandas apply vs np.vectorize to create new column from existing columns
  3. Efficiently return the index of the first value satisfying condition in array
  4. Most efficient way to forward-fill NaN values in numpy array
  5. Ambiguity in Pandas Dataframe / Numpy Array “axis” definition
  6. Python Numpy TypeError: ufunc ‘isfinite’ not supported for the input types
  7. pd.Timestamp versus np.datetime64: are they interchangeable for selected uses?
  8. Replacing values represented by 'UN' with NaN
  9. How to access the ith column of a NumPy multidimensional array?
  10. pandas select from Dataframe using startswith
  11. Concatenating two one-dimensional NumPy arrays
  12. What’s the fastest way in Python to calculate cosine similarity given sparse matrix data?
  13. Dropping infinite values from dataframes in pandas?
  14. How can I add new dimensions to a Numpy array?
  15. Force NumPy ndarray to take ownership of its memory in Cython
  16. How to normalize a NumPy array to within a certain range?
  17. Pandas lookup from one of multiple columns, based on value
  18. Check if two 3D numpy arrays contain overlapping 2D arrays
  19. Find symmetric pairs quickly in numpy
  20. Repeat each values of an array different times
  21. How to create 2d array with numpy random.choice for every rows?
  22. Unpivot Pandas Data
  23. Numpy Vector (N,1) dimension -> (N,) dimension conversion
  24. How does the axis parameter from NumPy work?
  25. numpy – evaluate function on a grid of points
  26. Interweaving two NumPy arrays efficiently
  27. Formatting floats in a numpy array [duplicate]
  28. How to convert a 3d numpy array to 2d
  29. Add density curve on the histogram
  30. Numpy.dtype has the wrong size, try recompiling

Leave a Comment