How do I prevent Python’s urllib(2) from following a redirect

by

You could do a couple of things:

  1. Build your own HTTPRedirectHandler that intercepts each redirect
  2. Create an instance of HTTPCookieProcessor and install that opener so that you have access to the cookiejar.

This is a quick little thing that shows both

import urllib2

#redirect_handler = urllib2.HTTPRedirectHandler()

class MyHTTPRedirectHandler(urllib2.HTTPRedirectHandler):
    def http_error_302(self, req, fp, code, msg, headers):
        print "Cookie Manip Right Here"
        return urllib2.HTTPRedirectHandler.http_error_302(self, req, fp, code, msg, headers)

    http_error_301 = http_error_303 = http_error_307 = http_error_302

cookieprocessor = urllib2.HTTPCookieProcessor()

opener = urllib2.build_opener(MyHTTPRedirectHandler, cookieprocessor)
urllib2.install_opener(opener)

response =urllib2.urlopen("WHEREEVER")
print response.read()

print cookieprocessor.cookiejar

More Related Contents:

  1. Import error: No module name urllib2
  2. Changing user agent on urllib2.urlopen
  3. Stream large binary files with urllib2 to file
  4. How can I use a SOCKS 4/5 proxy with urllib2?
  5. Python: URLError:
  6. Python: download files from google drive using url
  7. Python handling socket.error: [Errno 104] Connection reset by peer
  8. Python-Requests close http connection
  9. Python: HTTP Post a large file with streaming
  10. python: urllib2 how to send cookie with urlopen request
  11. urllib2 read to Unicode
  12. python ignore certificate validation urllib2
  13. Handling urllib2’s timeout? – Python
  14. Python urllib2.urlopen() is slow, need a better way to read several urls
  15. What should I do if socket.setdefaulttimeout() is not working?
  16. How can I speed up fetching pages with urllib2 in python?
  17. urllib2.URLError:
  18. Unescape Python Strings From HTTP
  19. Requests, bind to an ip
  20. Are urllib2 and httplib thread safe?
  21. Making HTTP HEAD request with urllib2 from Python 2
  22. How do I catch a specific HTTP error in Python?
  23. open url from pythonanywhere
  24. Submitting to a web form using python
  25. urllib2 HTTP Error 400: Bad Request
  26. Limiting number of processes in multiprocessing python
  27. Why do I get “‘str’ object has no attribute ‘read'” when trying to use `json.load` on a string? [duplicate]
  28. how to follow meta refreshes in Python
  29. Multiprocessing useless with urllib2?
  30. How to resolve URLError:

Leave a Comment