Convert Pandas Series to DateTime in a DataFrame

by

You can’t: DataFrame columns are Series, by definition. That said, if you make the dtype (the type of all the elements) datetime-like, then you can access the quantities you want via the .dt accessor (docs):

>>> df["TimeReviewed"] = pd.to_datetime(df["TimeReviewed"])
>>> df["TimeReviewed"]
205  76032930   2015-01-24 00:05:27.513000
232  76032930   2015-01-24 00:06:46.703000
233  76032930   2015-01-24 00:06:56.707000
413  76032930   2015-01-24 00:14:24.957000
565  76032930   2015-01-24 00:23:07.220000
Name: TimeReviewed, dtype: datetime64[ns]
>>> df["TimeReviewed"].dt
<pandas.tseries.common.DatetimeProperties object at 0xb10da60c>
>>> df["TimeReviewed"].dt.year
205  76032930    2015
232  76032930    2015
233  76032930    2015
413  76032930    2015
565  76032930    2015
dtype: int64
>>> df["TimeReviewed"].dt.month
205  76032930    1
232  76032930    1
233  76032930    1
413  76032930    1
565  76032930    1
dtype: int64
>>> df["TimeReviewed"].dt.minute
205  76032930     5
232  76032930     6
233  76032930     6
413  76032930    14
565  76032930    23
dtype: int64

If you’re stuck using an older version of pandas, you can always access the various elements manually (again, after converting it to a datetime-dtyped Series). It’ll be slower, but sometimes that isn’t an issue:

>>> df["TimeReviewed"].apply(lambda x: x.year)
205  76032930    2015
232  76032930    2015
233  76032930    2015
413  76032930    2015
565  76032930    2015
Name: TimeReviewed, dtype: int64

More Related Contents:

  1. How to join two dataframes for which column values are within a certain range?
  2. Filtering Pandas DataFrames on dates
  3. How to print pandas DataFrame without index
  4. datetime dtypes in pandas read_csv
  5. python pandas extract year from datetime: df[‘year’] = df[‘date’].year is not working
  6. Python Pandas Group by date using datetime data
  7. Removing the timestamp from a datetime in pandas dataframe
  8. Pandas filter dataframe rows with a specific year
  9. Python/Pandas convert string to time only
  10. Truncate `TimeStamp` column to hour precision in pandas `DataFrame`
  11. Python pandas integer YYYYMMDD to datetime
  12. Group DataFrame in 5-minute intervals
  13. Pandas custom function to find whether it is the 1st, 2nd etc Monday, Tuesday, etc – all suggestions welcome
  14. What values are valid in Pandas ‘Freq’ tags?
  15. Python: Adding hours to pandas timestamp
  16. pandas extract year from datetime: df[‘year’] = df[‘date’].year is not working
  17. Python Pandas : pandas.to_datetime() is switching day & month when day is less than 13
  18. Get weekday/day-of-week for Datetime column of DataFrame
  19. Plot pandas dates in matplotlib
  20. Convert DataFrame column type from string to datetime
  21. How to convert an XML file to nice pandas dataframe?
  22. df.append() is not appending to the DataFrame
  23. pandas dataframe str.contains() AND operation
  24. Pandas groupby mean – into a dataframe?
  25. pandas groupby without turning grouped by column into index
  26. Find the unique values in a column and then sort them
  27. Anti-Join Pandas
  28. Calculate summary statistics of columns in dataframe
  29. Pandas: Join dataframe with condition
  30. UnicodeDecodeError when reading CSV file in Pandas

Leave a Comment