how to test if a variable is pd.NaT?

by

Pandas NaT behaves like a floating-point NaN, in that it’s not equal to itself. Instead, you can use pandas.isnull:

In [21]: pandas.isnull(pandas.NaT)
Out[21]: True

This also returns True for None and NaN.

Technically, you could also check for Pandas NaT with x != x, following a common pattern used for floating-point NaN. However, this is likely to cause issues with NumPy NaTs, which look very similar and represent the same concept, but are actually a different type with different behavior:

In [29]: x = pandas.NaT

In [30]: y = numpy.datetime64('NaT')

In [31]: x != x
Out[31]: True

In [32]: y != y
/home/i850228/.local/lib/python3.6/site-packages/IPython/__main__.py:1: FutureWarning: In the future, NAT != NAT will be True rather than False.
  # encoding: utf-8
Out[32]: False

numpy.isnat, the function to check for NumPy NaT, also fails with a Pandas NaT:

In [33]: numpy.isnat(pandas.NaT)
---------------------------------------------------------------------------
TypeError                                 Traceback (most recent call last)
<ipython-input-33-39a66bbf6513> in <module>()
----> 1 numpy.isnat(pandas.NaT)

TypeError: ufunc 'isnat' is only defined for datetime and timedelta.

pandas.isnull works for both Pandas and NumPy NaTs, so it’s probably the way to go:

In [34]: pandas.isnull(pandas.NaT)
Out[34]: True

In [35]: pandas.isnull(numpy.datetime64('NaT'))
Out[35]: True

More Related Contents:

  1. Convert Pandas Column to DateTime
  2. Set value for particular cell in pandas DataFrame using index
  3. What is the difference between size and count in pandas?
  4. How to join two dataframes for which column values are within a certain range?
  5. Calculate Time Difference Between Two Pandas Columns in Hours and Minutes
  6. Extracting just Month and Year separately from Pandas Datetime column
  7. datetime to string with series in pandas
  8. pandas datetime to unix timestamp seconds
  9. python pandas extract year from datetime: df[‘year’] = df[‘date’].year is not working
  10. How to filter in NaN (pandas)?
  11. How to group a pandas dataframe by a defined time interval?
  12. How to find which columns contain any NaN value in Pandas dataframe
  13. Python Pandas Group by date using datetime data
  14. How do I round datetime column to nearest quarter hour
  15. Removing the timestamp from a datetime in pandas dataframe
  16. Subtract a year from a datetime column in pandas
  17. Pandas: Return Hour from Datetime Column Directly
  18. pandas .plot() x-axis tick frequency — how can I show more ticks?
  19. Pandas: How to create a datetime object from Week and Year?
  20. Leave dates as strings using read_excel function from pandas in python
  21. Combine Date and Time columns using pandas
  22. Converting time zone pandas dataframe
  23. Pandas parse non-english string dates
  24. Remove NaN/NULL columns in a Pandas dataframe?
  25. Group DataFrame in 5-minute intervals
  26. What values are valid in Pandas ‘Freq’ tags?
  27. How do I convert timestamp to datetime.date in pandas dataframe?
  28. Convert dates to pd.to_datetime where month could be either a number or month name
  29. Plot pandas dates in matplotlib
  30. Pandas: select all dates with specific month and day

Leave a Comment