Using an HTTP PROXY – Python [duplicate]

by

You can do it even without the HTTP_PROXY environment variable. Try this sample:

import urllib2

proxy_support = urllib2.ProxyHandler({"http":"http://61.233.25.166:80"})
opener = urllib2.build_opener(proxy_support)
urllib2.install_opener(opener)

html = urllib2.urlopen("http://www.google.com").read()
print html

In your case it really seems that the proxy server is refusing the connection.

Something more to try:

import urllib2

#proxy = "61.233.25.166:80"
proxy = "YOUR_PROXY_GOES_HERE"

proxies = {"http":"http://%s" % proxy}
url = "http://www.google.com/search?q=test"
headers={'User-agent' : 'Mozilla/5.0'}

proxy_support = urllib2.ProxyHandler(proxies)
opener = urllib2.build_opener(proxy_support, urllib2.HTTPHandler(debuglevel=1))
urllib2.install_opener(opener)

req = urllib2.Request(url, None, headers)
html = urllib2.urlopen(req).read()
print html

Edit 2014:
This seems to be a popular question / answer. However today I would use third party requests module instead.

For one request just do:

import requests

r = requests.get("http://www.google.com", 
                 proxies={"http": "http://61.233.25.166:80"})
print(r.text)

For multiple requests use Session object so you do not have to add proxies parameter in all your requests:

import requests

s = requests.Session()
s.proxies = {"http": "http://61.233.25.166:80"}

r = s.get("http://www.google.com")
print(r.text)

More Related Contents:

  1. Proxy with urllib2
  2. How can I use a SOCKS 4/5 proxy with urllib2?
  3. How to specify an authenticated proxy for a python http connection?
  4. Python-Requests close http connection
  5. Python: HTTP Post a large file with streaming
  6. Python urllib2 with keep alive
  7. Python urllib2 Progress Hook
  8. Python urllib2.urlopen() is slow, need a better way to read several urls
  9. What should I do if socket.setdefaulttimeout() is not working?
  10. Unescape Python Strings From HTTP
  11. How do I catch a specific HTTP error in Python?
  12. What is the fastest way to send 100,000 HTTP requests in Python?
  13. Import error: No module name urllib2
  14. Using pip behind a proxy with CNTLM
  15. Python: download files from google drive using url
  16. Python handling socket.error: [Errno 104] Connection reset by peer
  17. Proxy awareness with pip
  18. python ignore certificate validation urllib2
  19. Simple URL GET/POST function in Python
  20. Only download a part of the document using python requests
  21. How to get pip to work behind a proxy server [duplicate]
  22. Read timeout using either urllib2 or any other http library
  23. How to send zip files in the python Flask framework?
  24. Limiting number of processes in multiprocessing python
  25. Checking if a website is up via Python
  26. How to get the raw content of a response in requests with Python?
  27. Ideal method for sending multiple HTTP requests over Python? [duplicate]
  28. Django: using and POST
  29. How to pass all Python’s traffics through a http proxy?
  30. Proxy: Selenium + Python, Firefox

Leave a Comment