Import multiple csv files into pandas and concatenate into one DataFrame

by

If you have same columns in all your csv files then you can try the code below.
I have added header=0 so that after reading csv first row can be assigned as the column names.

import pandas as pd
import glob

path = r'C:\DRO\DCL_rawdata_files' # use your path
all_files = glob.glob(os.path.join(path , "/*.csv"))

li = []

for filename in all_files:
    df = pd.read_csv(filename, index_col=None, header=0)
    li.append(df)

frame = pd.concat(li, axis=0, ignore_index=True)

More Related Contents:

  1. UnicodeDecodeError when reading CSV file in Pandas with Python
  2. How to add pandas data to an existing csv file?
  3. Writing a pandas DataFrame to CSV file
  4. Import CSV file as a pandas DataFrame
  5. How to make separator in pandas read_csv more flexible wrt whitespace, for irregular separators?
  6. datetime dtypes in pandas read_csv
  7. How to get rid of “Unnamed: 0” column in a pandas DataFrame read in from CSV file?
  8. What is the fastest way to upload a big csv file in notebook to work with python pandas?
  9. Pandas split column into multiple columns by comma
  10. python – Using pandas structures with large csv(iterate and chunksize)
  11. pandas concat generates nan values
  12. pandas DataFrame output end of csv
  13. OSError: Initializing from file failed on csv in Pandas
  14. Loading multiple csv files of a folder into one dataframe
  15. Read CSV into a dataFrame with varying row lengths using Pandas
  16. How to add header row to a pandas DataFrame
  17. Is there a way to speed up handling large CSVs and dataframes in python?
  18. How do you remove the column name row when exporting a pandas DataFrame?
  19. Calculate summary statistics of columns in dataframe
  20. How to convert DataFrame.append() to pandas.concat()?
  21. pandas dataframe with 2-rows header and export to csv
  22. UnicodeDecodeError when reading CSV file in Pandas
  23. How to upload a CSV file in FastAPI and convert it into a Pandas Dataframe?
  24. How to return a csv file/Pandas DataFrame in JSON format using FastAPI?
  25. pandas.read_csv FileNotFoundError: File b’\xe2\x80\xaa’ despite correct path
  26. start index at 1 for Pandas DataFrame
  27. Python – splitting dataframe into multiple dataframes based on column values and naming them with those values [duplicate]
  28. Convert column to row in Python Pandas
  29. Efficient way to add rows to dataframe
  30. Find names of top-n highest-value columns in each pandas dataframe row

Leave a Comment