Use python requests to download CSV

by

This should help:

import csv
import requests

CSV_URL = 'http://samplecsvs.s3.amazonaws.com/Sacramentorealestatetransactions.csv'


with requests.Session() as s:
    download = s.get(CSV_URL)

    decoded_content = download.content.decode('utf-8')

    cr = csv.reader(decoded_content.splitlines(), delimiter=",")
    my_list = list(cr)
    for row in my_list:
        print(row)

Ouput sample:

['street', 'city', 'zip', 'state', 'beds', 'baths', 'sq__ft', 'type', 'sale_date', 'price', 'latitude', 'longitude']
['3526 HIGH ST', 'SACRAMENTO', '95838', 'CA', '2', '1', '836', 'Residential', 'Wed May 21 00:00:00 EDT 2008', '59222', '38.631913', '-121.434879']
['51 OMAHA CT', 'SACRAMENTO', '95823', 'CA', '3', '1', '1167', 'Residential', 'Wed May 21 00:00:00 EDT 2008', '68212', '38.478902', '-121.431028']
['2796 BRANCH ST', 'SACRAMENTO', '95815', 'CA', '2', '1', '796', 'Residential', 'Wed May 21 00:00:00 EDT 2008', '68880', '38.618305', '-121.443839']
['2805 JANETTE WAY', 'SACRAMENTO', '95815', 'CA', '2', '1', '852', 'Residential', 'Wed May 21 00:00:00 EDT 2008', '69307', '38.616835', '-121.439146']
[...]

Related question with answer: https://stackoverflow.com/a/33079644/295246

Edit: Other answers are useful if you need to download large files (i.e. stream=True).

More Related Contents:

  1. A simple maths operation on a CSV column using python [closed]
  2. How to write a python code which copies a unique column from an output file to a .csv file
  3. How to install packages offline?
  4. How can I convert JSON to CSV?
  5. How to send a “multipart/form-data” with requests in python?
  6. Sending “User-agent” using Requests library in Python
  7. Skip the headers when editing a csv file using Python
  8. Using python Requests with javascript pages
  9. Python CSV error: line contains NULL byte
  10. How do I disable log messages from the Requests library?
  11. What is the fastest way to upload a big csv file in notebook to work with python pandas?
  12. Compare two CSV files and search for similar items
  13. Download and save PDF file with Python requests module
  14. Pandas read csv file with float values results in weird rounding and decimal digits
  15. requests: how to disable / bypass proxy
  16. How can I send an xml body using requests library?
  17. Putting a `Cookie` in a `CookieJar`
  18. Requests library: missing SSL handshake certificates file after cx_Freeze
  19. How to delete columns in a CSV file?
  20. Precision lost while using read_csv in pandas
  21. Python Pandas: How to read only first n rows of CSV files in?
  22. Modify an existing Excel file using Openpyxl in Python
  23. SSL error with Python requests despite up-to-date dependencies
  24. python requests.get always get 404
  25. Python UTF-16 CSV reader
  26. load csv into 2D matrix with numpy for plotting
  27. Python requests, how to limit received size, transfer rate, and/or total time?
  28. Read .csv file from URL into Python 3.x – _csv.Error: iterator should return strings, not bytes (did you open the file in text mode?)
  29. csv: writer.writerows() splitting my string inputs
  30. How to convert csv to json in python?

Leave a Comment