How to know if urllib.urlretrieve succeeds?

by

Consider using urllib2 if it possible in your case. It is more advanced and easy to use than urllib.

You can detect any HTTP errors easily:

>>> import urllib2
>>> resp = urllib2.urlopen("http://google.com/abc.jpg")
Traceback (most recent call last):
<<MANY LINES SKIPPED>>
urllib2.HTTPError: HTTP Error 404: Not Found

resp is actually HTTPResponse object that you can do a lot of useful things with:

>>> resp = urllib2.urlopen("http://google.com/")
>>> resp.code
200
>>> resp.headers["content-type"]
'text/html; charset=windows-1251'
>>> resp.read()
"<<ACTUAL HTML>>"

More Related Contents:

  1. What are the differences between the urllib, urllib2, urllib3 and requests module?
  2. Downloading a picture via urllib and python
  3. can we use XPath with BeautifulSoup?
  4. How can I percent-encode URL parameters in Python?
  5. AttributeError: ‘module’ object has no attribute ‘urlopen’
  6. Python: URLError:
  7. should I call close() after urllib.urlopen()?
  8. Python URLLib / URLLib2 POST
  9. How can I check if an ip is in a network in Python?
  10. Python socket receive – incoming packets always have a different size
  11. python save image from url
  12. Python: Get HTTP headers from urllib2.urlopen call?
  13. How to unquote a urlencoded unicode string in python?
  14. Replace special characters in a string in Python
  15. What should I do if socket.setdefaulttimeout() is not working?
  16. Get size of a file before downloading in Python
  17. Sending a reset in TCP/IP Socket connection
  18. Python 3 urllib produces TypeError: POST data should be bytes or an iterable of bytes. It cannot be of type str
  19. Python – make a POST request using Python 3 urllib
  20. How to get Network Interface Card names in Python?
  21. Unwanted RST TCP packet with Scapy
  22. Why is host aborting connection?
  23. Download pdf using urllib?
  24. How to reliably generate Ethernet frame errors in software?
  25. Requests with multiple connections
  26. How to programmatically enable/disable network interfaces? (Windows XP)
  27. Python: check whether a network interface is up
  28. Python3 error: initial_value must be str or None, with StringIO
  29. How to close a socket left open by a killed program?
  30. Python 3.6 urllib TypeError: can’t concat bytes to str

Leave a Comment