Python urllib2 with keep alive

by

Use the urlgrabber library. This includes an HTTP handler for urllib2 that supports HTTP 1.1 and keepalive:

>>> import urllib2
>>> from urlgrabber.keepalive import HTTPHandler
>>> keepalive_handler = HTTPHandler()
>>> opener = urllib2.build_opener(keepalive_handler)
>>> urllib2.install_opener(opener)
>>> 
>>> fo = urllib2.urlopen('http://www.python.org')

Note: you should use urlgrabber version 3.9.0 or earlier, as the keepalive module has been removed in version 3.9.1

There is a port of the keepalive module to Python 3.

More Related Contents:

  1. Using an HTTP PROXY – Python [duplicate]
  2. Python-Requests close http connection
  3. Python: HTTP Post a large file with streaming
  4. Python urllib2 Progress Hook
  5. Python urllib2.urlopen() is slow, need a better way to read several urls
  6. What should I do if socket.setdefaulttimeout() is not working?
  7. Unescape Python Strings From HTTP
  8. How do I catch a specific HTTP error in Python?
  9. Proxy with urllib2
  10. Using MultipartPostHandler to POST form-data with Python
  11. How to specify an authenticated proxy for a python http connection?
  12. Is there any way to do HTTP PUT in python
  13. How to download a file using python in a ‘smarter’ way?
  14. In Python, how do I decode GZIP encoding?
  15. Extracting text from script tag using BeautifulSoup in Python
  16. How do I send a POST request as a JSON?
  17. Python send POST with header
  18. Using Flask, how do I modify the Cache-Control header for ALL output?
  19. How to download any(!) webpage with correct charset in python?
  20. why is python string split() not splitting
  21. Python urllib2: Receive JSON response from url
  22. how to get access to error message from abort command when using custom error handler
  23. Download and decompress gzipped file in memory?
  24. How to save “complete webpage” not just basic html using Python
  25. Why do I get “‘str’ object has no attribute ‘read'” when trying to use `json.load` on a string? [duplicate]
  26. how to follow meta refreshes in Python
  27. Python seek on remote file using HTTP
  28. Multiprocessing useless with urllib2?
  29. How to resolve URLError:
  30. Python requests.exception.ConnectionError: connection aborted “BadStatusLine”

Leave a Comment