Download and decompress gzipped file in memory?

by

You need to seek to the beginning of compressedFile after writing to it but before passing it to gzip.GzipFile(). Otherwise it will be read from the end by gzip module and will appear as an empty file to it. See below:

#! /usr/bin/env python
import urllib2
import StringIO
import gzip

baseURL = "https://www.kernel.org/pub/linux/docs/man-pages/"
filename = "man-pages-3.34.tar.gz"
outFilePath = "man-pages-3.34.tar"

response = urllib2.urlopen(baseURL + filename)
compressedFile = StringIO.StringIO()
compressedFile.write(response.read())
#
# Set the file's current position to the beginning
# of the file so that gzip.GzipFile can read
# its contents from the top.
#
compressedFile.seek(0)

decompressedFile = gzip.GzipFile(fileobj=compressedFile, mode="rb")

with open(outFilePath, 'w') as outfile:
    outfile.write(decompressedFile.read())

More Related Contents:

  1. Does python urllib2 automatically uncompress gzip data fetched from webpage?
  2. Stream large binary files with urllib2 to file
  3. Using MultipartPostHandler to POST form-data with Python
  4. How do I wrap a string in a file in Python?
  5. Python3 error: initial_value must be str or None, with StringIO
  6. how to can i go over a file twice?
  7. How do I get the path and name of the file that is currently executing?
  8. Python: URLError:
  9. Monitoring contents of files/directories? [duplicate]
  10. What is the most efficient way to get first and last line of a text file?
  11. How do I prevent Python’s urllib(2) from following a redirect
  12. Python URLLib / URLLib2 POST
  13. Writing a list to a file with Python, with newlines
  14. How to do virtual file processing?
  15. Getting file size in Python? [duplicate]
  16. How do I concatenate files in Python?
  17. whitespaces in the path of windows filepath
  18. How to get all of the immediate subdirectories in Python
  19. Python – IOError: [Errno 13] Permission denied:
  20. Multiple (asynchronous) connections with urllib2 or other http library?
  21. Write to StringIO object using Pandas Excelwriter?
  22. opening websites using urllib2 from behind corporate firewall – 11004 getaddrinfo failed
  23. Python – When to use file vs open
  24. How to get the URL of a redirect with Python
  25. For loop not working twice on the same file descriptor [duplicate]
  26. f.read coming up empty
  27. Parsing compressed xml feed into ElementTree
  28. Read random lines from huge CSV file
  29. What is the difference between .py and .pyc files? [duplicate]
  30. urllib2 and json

Leave a Comment