Pandas compare next row

by

Looks like you want to use the Series.shift method.

Using this method, you can generate new columns which are offset to the original columns. Like this:

df['qty_s'] = df['qty'].shift(-1)
df['t_s'] = df['t'].shift(-1)
df['z_s'] = df['z'].shift(-1)

Now you can compare these:

df['is_something'] = (df['qty'] == df['qty_s']) & (df['t'] < df['t_s']) & (df['z'] == df['z_s'])

Here is a simplified example of how Series.shift works to compare next row to the current:

df = pd.DataFrame({"temp_celcius":pd.np.random.choice(10, 10) + 20}, index=pd.date_range("2015-05-15", "2015-05-24")) 
df
            temp_celcius

2015-05-15            21
2015-05-16            28
2015-05-17            27
2015-05-18            21
2015-05-19            25
2015-05-20            28
2015-05-21            25
2015-05-22            22
2015-05-23            29
2015-05-24            25

df["temp_c_yesterday"] = df["temp_celcius"].shift(1)
df
            temp_celcius  temp_c_yesterday
2015-05-15            21               NaN
2015-05-16            28                21
2015-05-17            27                28
2015-05-18            21                27
2015-05-19            25                21
2015-05-20            28                25
2015-05-21            25                28
2015-05-22            22                25
2015-05-23            29                22
2015-05-24            25                29

df["warmer_than_yesterday"] = df["temp_celcius"] > df["temp_c_yesterday"]
            temp_celcius  temp_c_yesterday warmer_than_yesterday
2015-05-15            21               NaN                 False
2015-05-16            28                21                  True
2015-05-17            27                28                 False
2015-05-18            21                27                 False
2015-05-19            25                21                  True
2015-05-20            28                25                  True
2015-05-21            25                28                 False
2015-05-22            22                25                 False
2015-05-23            29                22                  True
2015-05-24            25                29                 False

If I misunderstood your query, please post a comment and I’ll update my answer.

More Related Contents:

  1. Pandas finding local max and min
  2. how to understand closed and label arguments in pandas resample method?
  3. Pandas conditional creation of a series/dataframe column
  4. Truth value of a Series is ambiguous. Use a.empty, a.bool(), a.item(), a.any() or a.all()
  5. How to unnest (explode) a column in a pandas DataFrame, into multiple rows
  6. How to split a dataframe string column into two columns?
  7. Annotate bars with values on Pandas bar plots
  8. Remove unwanted parts from strings in a column
  9. Comparing two dataframes and getting the differences [duplicate]
  10. Combine Date and Time columns using python pandas
  11. Accessing Pandas column using squared brackets vs using a dot (like an attribute)
  12. Get the name of a pandas DataFrame
  13. Why does my Pandas DataFrame not display new order using `sort_values`?
  14. How to check if a column exists in Pandas
  15. What is the difference between join and merge in Pandas?
  16. Ambiguity in Pandas Dataframe / Numpy Array “axis” definition
  17. Pandas Dataframe: Replacing NaN with row average
  18. How to read a .xlsx file using the pandas Library in iPython?
  19. Convert pandas data frame to series
  20. Pandas – dataframe groupby – how to get sum of multiple columns
  21. Pandas DataFrame merge summing column
  22. Mapping ranges of values in pandas dataframe [duplicate]
  23. pandas: combine two columns in a DataFrame
  24. Convert month int to month name in Pandas
  25. Pandas query function not working with spaces in column names
  26. Pandas groupby and aggregation output should include all the original columns (including the ones not aggregated on)
  27. Selecting a range of columns in a dataframe
  28. Replace NaN with empty list in a pandas dataframe
  29. Get weekday/day-of-week for Datetime column of DataFrame
  30. When is it appropriate to use df.value_counts() vs df.groupby(‘…’).count()?

Leave a Comment