Python Pandas – Read csv file containing multiple tables

by

If you know the table names beforehand, then something like this:

df = pd.read_csv("jahmyst2.csv", header=None, names=range(3))
table_names = ["Inventory", "HP BladeSystem Rack", "Network Interface"]
groups = df[0].isin(table_names).cumsum()
tables = {g.iloc[0,0]: g.iloc[1:] for k,g in df.groupby(groups)}

should work to produce a dictionary with keys as the table names and values as the subtables.

>>> list(tables)
['HP BladeSystem Rack', 'Inventory']
>>> for k,v in tables.items():
...     print("table:", k)
...     print(v)
...     print()
...     
table: HP BladeSystem Rack
              0          1               2
6   System Name  Rack Name  Enclosure Name
7      dg-enc05       BU40             NaN
8  dg-enc05-oa1       BU40        dg-enc05
9  dg-enc05-oa2       BU40        dg-enc05

table: Inventory
                    0             1              2
1         System Name    IP Address  System Status
2            dg-enc05           NaN         Normal
3  dg-enc05_vc_domain           NaN        Unknown
4        dg-enc05-oa1  172.20.0.213         Normal

Once you’ve got that, you can set the column names to the first rows, etc.

More Related Contents:

  1. How to write to an existing excel file without overwriting data (using pandas)?
  2. Use Multiple Character Delimiter in Python Pandas read_csv
  3. Export a list of stock prices to excel
  4. Skip the headers when editing a csv file using Python
  5. Skip rows during csv import pandas
  6. How to avoid Python/Pandas creating an index in a saved csv?
  7. datetime dtypes in pandas read_csv
  8. How do I create test and train samples from one dataframe with pandas?
  9. What is the fastest way to upload a big csv file in notebook to work with python pandas?
  10. append dataframe to excel with pandas
  11. Pandas read csv file with float values results in weird rounding and decimal digits
  12. Improve Row Append Performance On Pandas DataFrames
  13. Key error when selecting columns in pandas dataframe after read_csv
  14. Precision lost while using read_csv in pandas
  15. Python Pandas: How to read only first n rows of CSV files in?
  16. Prevent pandas read_csv treating first row as header of column names
  17. Merging dataframes based on date range
  18. Merge rows based on value (pandas to excel – xlsxwriter)
  19. Write to StringIO object using Pandas Excelwriter?
  20. How to avoid pandas creating an index in a saved csv
  21. Pandas – write Multiindex rows with to_csv
  22. How to add header row to a pandas DataFrame
  23. Pandas: Reading Excel with merged cells
  24. UnicodeDecodeError: ‘utf-8’ codec can’t decode byte 0x8b in position 1: invalid start byte, while reading csv file in pandas
  25. How can I use io.StringIO() with the csv module?
  26. Calculate summary statistics of columns in dataframe
  27. double quoted elements in csv cant read with pandas
  28. how to specify the datetime format in read_csv
  29. UnicodeDecodeError when reading CSV file in Pandas
  30. How to return a csv file/Pandas DataFrame in JSON format using FastAPI?

Leave a Comment