Convert timedelta64[ns] column to seconds in Python Pandas DataFrame

by

This works properly in the current version of Pandas (version 0.14):

In [132]: df[:5]['duration'] / np.timedelta64(1, 's')
Out[132]: 
0    1232
1    1390
2    1495
3     797
4    1132
Name: duration, dtype: float64

Here is a workaround for older versions of Pandas/NumPy:

In [131]: df[:5]['duration'].values.view('<i8')/10**9
Out[131]: array([1232, 1390, 1495,  797, 1132], dtype=int64)

timedelta64 and datetime64 data are stored internally as 8-byte ints (dtype
'<i8'). So the above views the timedelta64s as 8-byte ints and then does integer
division to convert nanoseconds to seconds.

Note that you need NumPy version 1.7 or newer to work with datetime64/timedelta64s.

More Related Contents:

  1. How to map numeric data into categories / bins in Pandas dataframe
  2. Improve Row Append Performance On Pandas DataFrames
  3. Parse a Pandas column to Datetime when importing table from SQL database and filtering rows by date
  4. Python Pandas: remove entries based on the number of occurrences
  5. Pandas conditional creation of a series/dataframe column
  6. How to sort a dataFrame in python pandas by two or more columns?
  7. Converting between datetime, Timestamp and datetime64
  8. Fast Haversine Approximation (Python/Pandas)
  9. Why isn’t my Pandas ‘apply’ function referencing multiple columns working? [closed]
  10. Pandas Timedelta in Days
  11. Conditionally fill column values based on another columns value in pandas
  12. How to remove blanks/NA’s from dataframe and shift the values up
  13. Comparing previous row values in Pandas DataFrame
  14. Take multiple lists into dataframe
  15. selecting across multiple columns with python pandas?
  16. Populate a Pandas SparseDataFrame from a SciPy Sparse Matrix
  17. Vectorized look-up of values in Pandas dataframe
  18. Problem in combining bar plot and line plot (python)
  19. PIP Install Numpy throws an error “ascii codec can’t decode byte 0xe2”
  20. vectorize conditional assignment in pandas dataframe
  21. Pandas: How to create a datetime object from Week and Year?
  22. Binning a column with pandas
  23. Convert numpy type to python
  24. Screen Capture with OpenCV and Python-2.7
  25. Numpy isnan() fails on an array of floats (from pandas dataframe apply)
  26. pandas, melt, unmelt preserve index
  27. plotting a histogram on a Log scale with Matplotlib
  28. How to use sklearn fit_transform with pandas and return dataframe instead of numpy array?
  29. ImportError: DLL load failed when importing Numpy installed in conda virtual environment
  30. mean from pandas and numpy differ

Leave a Comment