How to ignore the first line of data when processing CSV data?

by

You could use an instance of the csv module’s Sniffer class to deduce the format of a CSV file and detect whether a header row is present along with the built-in next() function to skip over the first row only when necessary:

import csv

with open('all16.csv', 'r', newline="") as file:
    has_header = csv.Sniffer().has_header(file.read(1024))
    file.seek(0)  # Rewind.
    reader = csv.reader(file)
    if has_header:
        next(reader)  # Skip header row.
    column = 1
    datatype = float
    data = (datatype(row[column]) for row in reader)
    least_value = min(data)

print(least_value)

Since datatype and column are hardcoded in your example, it would be slightly faster to process the row like this:

    data = (float(row[1]) for row in reader)

Note: the code above is for Python 3.x. For Python 2.x use the following line to open the file instead of what is shown:

with open('all16.csv', 'rb') as file:

More Related Contents:

  1. How do I create a python code that distinguishes between the capital of a state and the state that the capital has?
  2. How do I read a large csv file with pandas?
  3. How to add pandas data to an existing csv file?
  4. Import CSV file as a pandas DataFrame
  5. Reading a huge .csv file
  6. Reading a UTF8 CSV file with Python
  7. Keep only date part when using pandas.to_datetime
  8. Python csv string to array
  9. Python parse CSV ignoring comma with double-quotes
  10. “Line contains NULL byte” in CSV reader (Python)
  11. Compare two CSV files and search for similar items
  12. Reading data from a CSV file in Python
  13. How to efficiently handle European decimal separators using the pandas read_csv function?
  14. Python Pandas read_csv skip rows but keep header
  15. Python : Compare two csv files and print out differences
  16. Pandas – Strip white space
  17. Loading UTF-8 file in Python 3 using numpy.genfromtxt
  18. Filter string data based on its string length
  19. Why is pandas.to_datetime slow for non standard time format such as ‘2014/12/31’
  20. UnicodeDecodeError: ‘utf-8’ codec can’t decode byte 0x96 in position 35: invalid start byte
  21. Simple CSV to XML Conversion – Python
  22. csv.writer writing each character of word in separate column/cell
  23. Pandas ParserError EOF character when reading multiple csv files to HDF5
  24. Python Pandas – Read csv file containing multiple tables
  25. Is there a way to speed up handling large CSVs and dataframes in python?
  26. Strip white spaces from CSV file
  27. Get data from Twitter using Tweepy and store in csv file
  28. How to add a new column to the beginning of the rows of a CSV file?
  29. Python Parse CSV Correctly
  30. start index at 1 for Pandas DataFrame

Leave a Comment