Split pandas dataframe in two if it has more than 10 rows

by

I used a List Comprehension to cut a huge DataFrame into blocks of 100’000:

size = 100000
list_of_dfs = [df.loc[i:i+size-1,:] for i in range(0, len(df),size)]

or as generator:

list_of_dfs = (df.loc[i:i+size-1,:] for i in range(0, len(df),size))

More Related Contents:

  1. Splitting dataframe into multiple dataframes
  2. Pandas split DataFrame by column value
  3. Pandas split column into multiple columns by comma
  4. Quickest way to make a get_dummies type dataframe from a column with a multiple of strings
  5. How to deal with SettingWithCopyWarning in Pandas
  6. Using Pandas to pd.read_excel() for multiple worksheets of the same workbook
  7. How to add pandas data to an existing csv file?
  8. How to explode a list inside a Dataframe cell into separate rows
  9. Combine two pandas Data Frames (join on a common column)
  10. Repeat rows in a pandas DataFrame based on column value
  11. Accessing every 1st element of Pandas DataFrame column containing lists
  12. How to deal with multi-level column names downloaded with yfinance
  13. Replace all occurrences of a string in a pandas dataframe (Python)
  14. Running get_dummies on several DataFrame columns?
  15. Python – How to convert JSON File to Dataframe
  16. How to remove timezone from a Timestamp column in a pandas dataframe
  17. Pandas lookup from one of multiple columns, based on value
  18. How to add a suffix (or prefix) to each column name?
  19. How to delete multiple pandas (python) dataframes from memory to save RAM?
  20. Subtract two columns in dataframe
  21. Capitalize first letter of each word in a dataframe column
  22. Compute the running (cumulative) maximum for a series in pandas
  23. Get total of Pandas column
  24. How to read a Parquet file into Pandas DataFrame?
  25. Get first and second highest values in pandas columns
  26. Enumerate each row for each group in a DataFrame
  27. What’s the best way to sum all values in a Pandas dataframe? [duplicate]
  28. MonthEnd object result in instead of number
  29. Python Pandas – Combining Multiple Columns into one Staggered Column
  30. pandas.read_csv FileNotFoundError: File b’\xe2\x80\xaa’ despite correct path

Leave a Comment