Download file using partial download (HTTP)

by

It is possible to do partial download using the range header, the following will request a selected range of bytes:

req = urllib2.Request('http://www.python.org/')
req.headers['Range'] = 'bytes=%s-%s' % (start, end)
f = urllib2.urlopen(req)

For example:

>>> req = urllib2.Request('http://www.python.org/')
>>> req.headers['Range'] = 'bytes=%s-%s' % (100, 150)
>>> f = urllib2.urlopen(req)
>>> f.read()
'l1-transitional.dtd">\n\n\n<html xmlns="http://www.w3.'

Using this header you can resume partial downloads. In your case all you have to do is to keep track of already downloaded size and request a new range.

Keep in mind that the server need to accept this header for this to work.

More Related Contents:

  1. How to download a file over HTTP?
  2. What is the fastest way to send 100,000 HTTP requests in Python?
  3. urllib2.HTTPError: HTTP Error 403: Forbidden
  4. How do you send a HEAD HTTP request in Python 2?
  5. Python requests – print entire http request (raw)?
  6. Problem HTTP error 403 in Python 3 Web Scraping
  7. How to add both file and JSON body in a FastAPI POST request?
  8. Python urllib2, basic HTTP authentication, and tr.im
  9. How to avoid HTTP error 429 (Too Many Requests) python
  10. Is there an easy way to request a URL in python and NOT follow redirects?
  11. Python: HTTP Post a large file with streaming
  12. Python ‘requests’ library – define specific DNS?
  13. Why am I getting this error in python ? (httplib)
  14. Python urllib2.urlopen() is slow, need a better way to read several urls
  15. How to get http headers in flask?
  16. How to stop BaseHTTPServer.serve_forever() in a BaseHTTPRequestHandler subclass?
  17. What should I do if socket.setdefaulttimeout() is not working?
  18. Read timeout using either urllib2 or any other http library
  19. How to scrape a website that requires login first with Python
  20. Save a large file using the Python requests library [duplicate]
  21. Python requests speed up using keep-alive
  22. Flask – POST Error 405 Method Not Allowed
  23. How do I catch a specific HTTP error in Python?
  24. How to send zip files in the python Flask framework?
  25. Checking if a website is up via Python
  26. How to get the raw content of a response in requests with Python?
  27. Ideal method for sending multiple HTTP requests over Python? [duplicate]
  28. Is there a library for retrieving a file from a remote zip? [closed]
  29. Python seek on remote file using HTTP
  30. Python requests.exception.ConnectionError: connection aborted “BadStatusLine”

Leave a Comment