How to calculate time difference by group using pandas?

by

You can use sort_values with groupby and aggregating diff:

df['diff'] = df.sort_values(['id','time']).groupby('id')['time'].diff()
print (df)
  id                time     diff
0  A 2016-11-25 16:32:17      NaT
1  A 2016-11-25 16:36:04 00:00:35
2  A 2016-11-25 16:35:29 00:03:12
3  B 2016-11-25 16:35:24      NaT
4  B 2016-11-25 16:35:46 00:00:22

If need remove rows with NaT in column diff use dropna:

df = df.dropna(subset=['diff'])
print (df)
  id                time     diff
2  A 2016-11-25 16:35:29 00:03:12
1  A 2016-11-25 16:36:04 00:00:35
4  B 2016-11-25 16:35:46 00:00:22

You can also overwrite column:

df.time = df.sort_values(['id','time']).groupby('id')['time'].diff()
print (df)
  id     time
0  A      NaT
1  A 00:00:35
2  A 00:03:12
3  B      NaT
4  B 00:00:22

df.time = df.sort_values(['id','time']).groupby('id')['time'].diff()
df = df.dropna(subset=['time'])
print (df)
  id     time
1  A 00:00:35
2  A 00:03:12
4  B 00:00:22

More Related Contents:

  1. How to sort a dataFrame in python pandas by two or more columns?
  2. how to sort pandas dataframe from one column
  3. What is the difference between size and count in pandas?
  4. pandas groupby sort within groups
  5. Naturally sorting Pandas DataFrame
  6. Python: Convert timedelta to int in a dataframe
  7. pandas groupby, then sort within groups
  8. sorting by a custom list in pandas
  9. Why does my Pandas DataFrame not display new order using `sort_values`?
  10. Sort a pandas dataframe series by month name
  11. timedelta to string type in pandas dataframe
  12. Find the unique values in a column and then sort them
  13. python, sort descending dataframe with pandas
  14. Python – Delete duplicates in a dataframe based on two columns combinations?
  15. Pandas DataFrame sort by categorical column but by specific class ordering
  16. Sorting by absolute value without changing the data
  17. Custom sorting with Pandas
  18. Python pandas cumsum() reset after hitting max
  19. How to sort pandas data frame using values from several columns?
  20. Python: Adding hours to pandas timestamp
  21. numerical sort a column containing numbers and strings (pandas/python)
  22. Multi Index Sorting in Pandas
  23. Sorting a pandas series
  24. Get the row(s) which have the max value in groups using groupby
  25. python/pandas: convert month int to month name
  26. Seaborn showing scientific notation in heatmap for 3-digit numbers
  27. Format certain floating dataframe columns into percentage in pandas
  28. pandas comparison raises TypeError: cannot compare a dtyped [float64] array with a scalar of type [bool]
  29. Remove NaN values from pandas dataframe and reshape table [duplicate]
  30. How to compute jaccard similarity from a pandas dataframe

Leave a Comment