Download and save PDF file with Python requests module

by

You should use response.content in this case:

with open('/tmp/metadata.pdf', 'wb') as f:
    f.write(response.content)

From the document:

You can also access the response body as bytes, for non-text requests:

>>> r.content
b'[{"repository":{"open_issues":0,"url":"https://github.com/...

So that means: response.text return the output as a string object, use it when you’re downloading a text file. Such as HTML file, etc.

And response.content return the output as bytes object, use it when you’re downloading a binary file. Such as PDF file, audio file, image, etc.

You can also use response.raw instead. However, use it when the file which you’re about to download is large. Below is a basic example which you can also find in the document:

import requests

url="http://www.hrecos.org//images/Data/forweb/HRTVBSH.Metadata.pdf"
r = requests.get(url, stream=True)

with open('/tmp/metadata.pdf', 'wb') as fd:
    for chunk in r.iter_content(chunk_size):
        fd.write(chunk)

chunk_size is the chunk size which you want to use. If you set it as 2000, then requests will download that file the first 2000 bytes, write them into the file, and do this again, again and again, unless it finished.

So this can save your RAM. But I’d prefer use response.content instead in this case since your file is small. As you can see use response.raw is complex.

Relates:

More Related Contents:

  1. Python Requests – No connection adapters
  2. python ignore certificate validation urllib2
  3. python how to decode http response
  4. How to resume file download in Python?
  5. How to measure download speed and progress using requests?
  6. Division in Python 2.7. and 3.3 [duplicate]
  7. Integer division in Python 2 and Python 3
  8. Can I set max_retries for requests.request?
  9. How to check the version of Python modules
  10. Python Request Post with param data
  11. Cleanest way to get last item from Python iterator
  12. How to use append with pickle in python?
  13. Argparse with required subparser
  14. too many values to unpack calling cv2.findContours
  15. portable way to write csv file in python 2 or python 3
  16. Run a foreign exe inside a Python GUI (PyQt)
  17. Decompile Python 2.7 .pyc [closed]
  18. How to call Base Class’s __init__ method from the child class? [duplicate]
  19. How should I understand the output of dis.dis?
  20. Using PIL to turn a RGB image into a pure black and white image
  21. Can json.loads ignore trailing commas?
  22. parse multipart/form-data, received from requests post
  23. Opencv – Grayscale mode Vs gray color conversion
  24. Sending a file over TCP sockets in Python
  25. How to make a simple multithreaded socket server in Python that remembers clients
  26. Python 2: SMTPServerDisconnected: Connection unexpectedly closed
  27. Understanding Pickling in Python
  28. How can I read pdf in python? [duplicate]
  29. Requests with multiple connections
  30. Searching in Google with Python

Leave a Comment