Python requests. 403 Forbidden

by

It seems the page rejects GET requests that do not identify a User-Agent. I visited the page with a browser (Chrome) and copied the User-Agent header of the GET request (look in the Network tab of the developer tools):

import requests
url="http://worldagnetwork.com/"
headers = {'User-Agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_11_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/50.0.2661.102 Safari/537.36'}
result = requests.get(url, headers=headers)
print(result.content.decode())

# <!doctype html>
# <!--[if lt IE 7 ]><html class="no-js ie ie6" lang="en"> <![endif]-->
# <!--[if IE 7 ]><html class="no-js ie ie7" lang="en"> <![endif]-->
# <!--[if IE 8 ]><html class="no-js ie ie8" lang="en"> <![endif]-->
# <!--[if (gte IE 9)|!(IE)]><!--><html class="no-js" lang="en"> <!--<![endif]-->
# ...

More Related Contents:

  1. How to “log in” to a website using Python’s Requests module?
  2. Python Requests throwing SSLError
  3. Proxies with Python ‘Requests’ module
  4. Python Requests and persistent sessions
  5. Python Requests library redirect new url
  6. How could I use requests in asyncio?
  7. How do I disable the security certificate check in Python requests
  8. Python Requests – No connection adapters
  9. python ignore certificate validation urllib2
  10. Using Python Requests: Sessions, Cookies, and POST
  11. Difference between data and json parameters in python requests package
  12. Only download a part of the document using python requests
  13. OpenSSL errors in python requests
  14. Python – Requests, Selenium – passing cookies while logging in
  15. Python : Trying to POST form using requests
  16. How to get response SSL certificate from requests in python?
  17. Send http request through specific network interface
  18. How to resume file download in Python?
  19. parsing XML file gets UnicodeEncodeError (ElementTree) / ValueError (lxml)
  20. What is the difference between ‘content’ and ‘text’
  21. parse multipart/form-data, received from requests post
  22. python requests module and connection reuse
  23. Get html using Python requests?
  24. multipart data POST using python requests: no multipart boundary was found
  25. How to get the raw content of a response in requests with Python?
  26. How to disable cookie handling with the Python requests library?
  27. ImportError: No module named ‘Queue’ [duplicate]
  28. openssl, python requests error: “certificate verify failed”
  29. Using Find_All function returns an unexpected result set
  30. How do I clear cache with Python Requests?

Leave a Comment