Downloading and unzipping a .zip file without writing to disk

by

Below is a code snippet I used to fetch zipped csv file, please have a look:

Python 2:

from StringIO import StringIO
from zipfile import ZipFile
from urllib import urlopen

resp = urlopen("http://www.test.com/file.zip")
zipfile = ZipFile(StringIO(resp.read()))
for line in zipfile.open(file).readlines():
    print line

Python 3:

from io import BytesIO
from zipfile import ZipFile
from urllib.request import urlopen
# or: requests.get(url).content

resp = urlopen("http://www.test.com/file.zip")
zipfile = ZipFile(BytesIO(resp.read()))
for line in zipfile.open(file).readlines():
    print(line.decode('utf-8'))

Here file is a string. To get the actual string that you want to pass, you can use zipfile.namelist(). For instance,

resp = urlopen('http://mlg.ucd.ie/files/datasets/bbc.zip')
zipfile = ZipFile(BytesIO(resp.read()))
zipfile.namelist()
# ['bbc.classes', 'bbc.docs', 'bbc.mtx', 'bbc.terms']

More Related Contents:

  1. Unzipping files in Python
  2. Extract files from zip without keeping the structure using python ZipFile?
  3. How can unrar a file with python
  4. How do you unzip very large files in python?
  5. Python if statements [closed]
  6. How do i implement these algorithms below
  7. Constantly print Subprocess output while process is running
  8. In Django, how does one filter a QuerySet with dynamic field lookups?
  9. How does Python manage int and long?
  10. How to avoid explicit ‘self’ in Python?
  11. Convert a timedelta to days, hours and minutes
  12. Remove duplicate rows from Pandas dataframe where only some columns have the same value
  13. How do I check for an EXACT word in a string in python
  14. Why is matrix multiplication faster with numpy than with ctypes in Python?
  15. Unable to install Python libraries
  16. How does the logical `and` operator work with integers? [duplicate]
  17. ImportError: Failed to import the Cloud Firestore library for Python
  18. How to strip all whitespace from string
  19. How can I replicate rows of a Pandas DataFrame?
  20. How to get the updated list of items in Jinja2 template using FastAPI?
  21. In Python pandas, start row index from 1 instead of zero without creating additional column
  22. plotting a histogram on a Log scale with Matplotlib
  23. python subclass access to class variable of parent
  24. Python: how to store a numpy multidimensional array in PyTables?
  25. Changing width of bars in bar chart created using seaborn.factorplot
  26. Is the right-hand side of an assignment always evaluated before the assignment?
  27. How to compute precision, recall, accuracy and f1-score for the multiclass case with scikit learn?
  28. Expand pandas DataFrame column into multiple rows
  29. How to remove all integer values from a list in python
  30. Requests with multiple connections

Leave a Comment