Handling urllib2’s timeout? – Python

by

There are very few cases where you want to use except:. Doing this captures any exception, which can be hard to debug, and it captures exceptions including SystemExit and KeyboardInterupt, which can make your program annoying to use..

At the very simplest, you would catch urllib2.URLError:

try:
    urllib2.urlopen("http://example.com", timeout = 1)
except urllib2.URLError, e:
    raise MyException("There was an error: %r" % e)

The following should capture the specific error raised when the connection times out:

import urllib2
import socket

class MyException(Exception):
    pass

try:
    urllib2.urlopen("http://example.com", timeout = 1)
except urllib2.URLError, e:
    # For Python 2.6
    if isinstance(e.reason, socket.timeout):
        raise MyException("There was an error: %r" % e)
    else:
        # reraise the original error
        raise
except socket.timeout, e:
    # For Python 2.7
    raise MyException("There was an error: %r" % e)

More Related Contents:

  1. What are the differences between the urllib, urllib2, urllib3 and requests module?
  2. Downloading a picture via urllib and python
  3. Python: URLError:
  4. Python URLLib / URLLib2 POST
  5. Making a POST call instead of GET using urllib2
  6. What should I do if socket.setdefaulttimeout() is not working?
  7. How to download any(!) webpage with correct charset in python?
  8. How do I catch a specific HTTP error in Python?
  9. Python 3 urllib produces TypeError: POST data should be bytes or an iterable of bytes. It cannot be of type str
  10. Submitting to a web form using python
  11. How to save “complete webpage” not just basic html using Python
  12. What is the global default timeout
  13. How to resolve URLError:
  14. Python3 error: initial_value must be str or None, with StringIO
  15. Proxy with urllib2
  16. Using an HTTP PROXY – Python [duplicate]
  17. Using MultipartPostHandler to POST form-data with Python
  18. Download Returned Zip file from URL
  19. Django: add image in an ImageField from image url
  20. Python-Requests close http connection
  21. How do I set headers using python’s urllib?
  22. How to correctly parse UTF-8 encoded HTML to Unicode strings with BeautifulSoup? [duplicate]
  23. SSL: CERTIFICATE_VERIFY_FAILED with Python3
  24. Python urllib2 Progress Hook
  25. multiprocessing.pool.MaybeEncodingError: ‘TypeError(“cannot serialize ‘_io.BufferedReader’ object”,)’
  26. How to extract tables from websites in Python
  27. Python urllib2: Receive JSON response from url
  28. Download and decompress gzipped file in memory?
  29. Why do I get “‘str’ object has no attribute ‘read'” when trying to use `json.load` on a string? [duplicate]
  30. Multiprocessing useless with urllib2?

Leave a Comment