How i can get new ip from tor every requests in threads?

by

If you want different IPs for each connection, you can also use Stream Isolation over SOCKS by specifying a different proxy username:password combination for each connection.

With this method, you only need one Tor instance and each requests client can use a different stream with a different exit node.

In order to set this up, add unique proxy credentials for each requests.session object like so: socks5h://username:password@localhost:9050

import random
from multiprocessing import Pool
import requests

def check_ip():
    session = requests.session()
    creds = str(random.randint(10000,0x7fffffff)) + ":" + "foobar"
    session.proxies = {'http': 'socks5h://{}@localhost:9050'.format(creds), 'https': 'socks5h://{}@localhost:9050'.format(creds)}
    r = session.get('http://httpbin.org/ip')
    print(r.text)


with Pool(processes=8) as pool:
    for _ in range(9):
        pool.apply_async(check_ip)
    pool.close()
    pool.join()

Tor Browser isolates streams on a per-domain basis by setting the credentials to firstpartydomain:randompassword, where randompassword is a random nonce for each unique first party domain.

If you’re crawling the same site and you want random IP’s, then use a random username:password combination for each session. If you are crawling random domains and want to use the same circuit for requests to a domain, use Tor Browser’s method of domain:randompassword for credentials.

More Related Contents:

  1. Jupyter notebook never finishes processing using multiprocessing (Python 3)
  2. No multiprocessing print outputs (Spyder)
  3. Wait page to load before getting data with requests.get in python 3
  4. multiprocessing vs multithreading vs asyncio in Python 3
  5. How to use Tor with Chrome browser through Selenium
  6. Python async: Waiting for stdin input while doing other stuff
  7. multiprocessing vs multithreading vs asyncio
  8. Python SSL certificate verify error
  9. Fetching multiple urls with aiohttp in python
  10. Need help installing requests for python 3
  11. using Subprocess to avoid long-running task from disconnecting discord.py bot?
  12. How does asyncio actually work?
  13. selenium.common.exceptions.ElementNotInteractableException: Message: element not interactable when clicking on an element using Selenium Python
  14. Pygame window freezes when it opens
  15. finding values in pandas series – Python3
  16. Run a python script in virtual environment from windows task scheduler
  17. Installing modules to Anaconda from .tar.gz
  18. How to extract first 8 characters from a string in pandas
  19. python random.getstate() and random.setstate()
  20. Python selenium multiprocessing
  21. How to output x265 compressed video with cv2.VideoWriter
  22. How do I integrate custom exception handling with the FastAPI exception handling?
  23. Python OpenCV multiprocessing cv2.VideoCapture mp4
  24. How to use urllib with username/password authentication in python 3?
  25. Pandas send email containing dataframe as a visual table
  26. How do I print colored output with Python 3?
  27. How to retrieve the whole message body using Gmail API (python)
  28. Browser Cookie never expires
  29. Debugging Numpy VisibleDeprecationWarning (ndarray from ragged nested sequences)
  30. how to add a coroutine to a running asyncio loop?

Leave a Comment