Python check if website exists

by

You can use HEAD request instead of GET. It will only download the header, but not the content. Then you can check the response status from the headers.

For python 2.7.x, you can use httplib:

import httplib
c = httplib.HTTPConnection('www.example.com')
c.request("HEAD", '')
if c.getresponse().status == 200:
   print('web site exists')

or urllib2:

import urllib2
try:
    urllib2.urlopen('http://www.example.com/some_page')
except urllib2.HTTPError, e:
    print(e.code)
except urllib2.URLError, e:
    print(e.args)

or for 2.7 and 3.x, you can install requests

import requests
response = requests.get('http://www.example.com')
if response.status_code == 200:
    print('Web site exists')
else:
    print('Web site does not exist')

More Related Contents:

  1. Strip HTML from strings in Python
  2. How to find elements by class
  3. How can I select a html element no matter what frame it is in in selenium?
  4. Post values from an HTML form and access them in a Flask view
  5. How to retrieve the values of dynamic html content using Python
  6. How to convert webpage into PDF by using Python
  7. How to embed HTML into IPython output?
  8. Beautiful Soup findAll doesn’t find them all
  9. Can I remove script tags with BeautifulSoup?
  10. H14 error in heroku – “no web processes running”
  11. BeautifulSoup findAll() given multiple classes?
  12. Application not picking up .css file (flask/python) [duplicate]
  13. BeautifulSoup webscraping find_all( ): finding exact match
  14. BeautifulSoup innerhtml?
  15. Display a ‘loading’ message while a time consuming function is executed in Flask
  16. pandas read_html ValueError: No tables found
  17. Understand the Find() function in Beautiful Soup
  18. python beautifulsoup iframe document html extract
  19. BeautifulSoup: extract text from anchor tag
  20. How can I get all the plain text from a website with Scrapy?
  21. Checking if an element exists with Python Selenium
  22. pd.read_html() imports a list rather than a dataframe
  23. How to Download a File after POSTing data using FastAPI?
  24. Extracting lxml xpath for html table
  25. BeautifulSoup return unexpected extra spaces
  26. Flask css not updating [closed]
  27. HTML to IMAGE using Python
  28. BeautifulSoup: get css classes from html
  29. How to submit HTML form value using FastAPI and Jinja2 Templates?
  30. Using Find_All function returns an unexpected result set

Leave a Comment