Python seek on remote file using HTTP

by

If you are downloading the remote file through HTTP, you need to set the Range header.

Check in this example how it can be done. Looks like this:

myUrlclass.addheader("Range","bytes=%s-" % (existSize))

EDIT: I just found a better implementation. This class is very simple to use, as it can be seen in the docstring.

class HTTPRangeHandler(urllib2.BaseHandler):
"""Handler that enables HTTP Range headers.

This was extremely simple. The Range header is a HTTP feature to
begin with so all this class does is tell urllib2 that the 
"206 Partial Content" reponse from the HTTP server is what we 
expected.

Example:
    import urllib2
    import byterange

    range_handler = range.HTTPRangeHandler()
    opener = urllib2.build_opener(range_handler)

    # install it
    urllib2.install_opener(opener)

    # create Request and set Range header
    req = urllib2.Request('http://www.python.org/')
    req.header['Range'] = 'bytes=30-50'
    f = urllib2.urlopen(req)
"""

def http_error_206(self, req, fp, code, msg, hdrs):
    # 206 Partial Content Response
    r = urllib.addinfourl(fp, hdrs, req.get_full_url())
    r.code = code
    r.msg = msg
    return r

def http_error_416(self, req, fp, code, msg, hdrs):
    # HTTP's Range Not Satisfiable error
    raise RangeError('Requested Range Not Satisfiable')

Update: The “better implementation” has moved to github: excid3/urlgrabber in the byterange.py file.

More Related Contents:

  1. How to download a file over HTTP?
  2. urllib2.HTTPError: HTTP Error 403: Forbidden
  3. How do you send a HEAD HTTP request in Python 2?
  4. How to add both file and JSON body in a FastAPI POST request?
  5. How to avoid HTTP error 429 (Too Many Requests) python
  6. Is there an easy way to request a URL in python and NOT follow redirects?
  7. What is the most efficient way to get first and last line of a text file?
  8. Python: HTTP Post a large file with streaming
  9. Python urllib2 with keep alive
  10. Python ‘requests’ library – define specific DNS?
  11. How to encode UTF8 filename for HTTP headers? (Python, Django)
  12. Python urllib2 Progress Hook
  13. In Python, how do I decode GZIP encoding?
  14. Why am I getting this error in python ? (httplib)
  15. How do I send a POST request as a JSON?
  16. Using Flask, how do I modify the Cache-Control header for ALL output?
  17. python how to decode http response
  18. How to implement retry mechanism into python requests library?
  19. What should I do if socket.setdefaulttimeout() is not working?
  20. How to scrape a website that requires login first with Python
  21. Python: How do I get key/value pairs from the BaseHTTPRequestHandler HTTP POST handler?
  22. Download file using partial download (HTTP)
  23. Why am I getting httplib.BadStatusLine in python?
  24. Python – make a POST request using Python 3 urllib
  25. How to send and receive HTTP POST requests in Python [closed]
  26. Does Django have a way to open a HTTP long poll connection?
  27. Is it possible to run python SimpleHTTPServer on localhost only?
  28. Django: using and POST
  29. How to limit download rate of HTTP requests in requests python library?
  30. Python requests.exception.ConnectionError: connection aborted “BadStatusLine”

Leave a Comment