How to read a Parquet file into Pandas DataFrame?

by

pandas 0.21 introduces new functions for Parquet:

import pandas as pd
pd.read_parquet('example_pa.parquet', engine="pyarrow")

or

import pandas as pd
pd.read_parquet('example_fp.parquet', engine="fastparquet")

The above link explains:

These engines are very similar and should read/write nearly identical parquet format files. These libraries differ by having different underlying dependencies (fastparquet by using numba, while pyarrow uses a c-library).

More Related Contents:

  1. error when applying function to a series object
  2. How to identify and label similar rows in a pandas data frame
  3. Renaming column names in Pandas
  4. Groupby value counts on the dataframe pandas
  5. How can I use the apply() function for a single column?
  6. Pandas filtering for multiple substrings in series
  7. Filtering Pandas DataFrames on dates
  8. Pandas DataFrame Groupby two columns and get counts
  9. How can I map True/False to 1/0 in a Pandas DataFrame?
  10. Selection with .loc in python
  11. Pandas deleting row with df.drop doesn’t work
  12. Pandas select rows and columns based on boolean condition
  13. How to flatten a hierarchical index in columns
  14. How can I subclass a Pandas DataFrame?
  15. Vectorized lookup on a pandas dataframe
  16. Add a sequential counter column on groups to a pandas dataframe
  17. Pandas: Shift down values by one row within a group
  18. Python: Pandas dataframe from Series of dict
  19. Move column by name to front of table in pandas
  20. Convert List to Pandas Dataframe Column
  21. How to merge a Series and DataFrame
  22. Pretty print a pandas dataframe in VS Code
  23. dataframe to dict such that one column is the key and the other is the value [duplicate]
  24. Transpose the data in a column every nth rows in PANDAS
  25. Is there a way to speed up handling large CSVs and dataframes in python?
  26. Convert pandas DataFrame into list of lists [duplicate]
  27. Got continuous is not supported error in RandomForestRegressor
  28. Copy text between parentheses in pandas DataFrame column into another column
  29. Get frequency of item occurrences in a column as percentage [duplicate]
  30. Get max value from row of a dataframe in python [duplicate]

Leave a Comment