How can I make a Selenium script undetectable using GeckoDriver and Firefox through Python?

by

There are different methods to avoid websites detecting the use of Selenium.

  1. The value of navigator.webdriver is set to true by default when using Selenium. This variable will be present in Chrome as well as Firefox. This variable should be set to “undefined” to avoid detection.

  2. A proxy server can also be used to avoid detection.

  3. Some websites are able to use the state of your browser to determine if you are using Selenium. You can set Selenium to use a custom browser profile to avoid this.

The code below uses all three of these approaches.

profile = webdriver.FirefoxProfile('C:\\Users\\You\\AppData\\Roaming\\Mozilla\\Firefox\\Profiles\\something.default-release')

PROXY_HOST = "12.12.12.123"
PROXY_PORT = "1234"
profile.set_preference("network.proxy.type", 1)
profile.set_preference("network.proxy.http", PROXY_HOST)
profile.set_preference("network.proxy.http_port", int(PROXY_PORT))
profile.set_preference("dom.webdriver.enabled", False)
profile.set_preference('useAutomationExtension', False)
profile.update_preferences()
desired = DesiredCapabilities.FIREFOX

driver = webdriver.Firefox(firefox_profile=profile, desired_capabilities=desired)

Once the code is run, you will be able to manually check that the browser run by Selenium now has your Firefox history and extensions. You can also type “navigator.webdriver” into the devtools console to check that it is undefined.

More Related Contents:

  1. Selenium using Python – Geckodriver executable needs to be in PATH
  2. Selenium using too much RAM with Firefox
  3. WebDriverException: Message: invalid argument: can’t kill an exited process with GeckoDriver, Selenium and Python on RaspberryPi3
  4. Python 3.5 – “Geckodriver executable needs to be in PATH”
  5. How to fix “WebDriverException: Message: connection refused”?
  6. Selenium python Error: element could not be scrolled into view
  7. selenium.common.exceptions.SessionNotCreatedException: Message: Unable to find a matching set of capabilities with Firefox 46 through Selenium
  8. Expected browser binary location, but unable to find binary in default location, no ‘moz:firefoxOptions.binary’ capability provided using GeckoDriver
  9. selenium.common.exceptions.WebDriverException: Message: ‘geckodriver’ executable needs to be in PATH with GeckoDriver Selenium Firefox
  10. FileNotFoundError: [Errno 2] No such file or directory: ‘geckodriver’: ‘geckodriver’ with GeckoDriver and Python in MAC OS
  11. How can Geckodriver/Firefox work without Marionette? (running python selenium 3 against FF 53)
  12. OSError: [Errno 8] Exec format error with GeckoDriver and Selenium on MacOS
  13. Download and save multiple csv files using selenium and python from popup
  14. selenium.common.exceptions.SessionNotCreatedException: Message: Unable to find a matching set of capabilities with GeckoDriver, Selenium and Firefox
  15. How to fix python-selenium error “connection refused” when initializing a selenium webdriver?
  16. “Failed to decode response from marionette” message in Python/Firefox headless scraping script
  17. Which Firefox browser versions supported for given Geckodriver version?
  18. Selenium : How to stop geckodriver process impacting PC memory, without calling driver.quit()?
  19. Selenium: FirefoxProfile exception Can’t load the profile
  20. Downloading file to specified location with Selenium and python
  21. Selenium using Python: enter/provide http proxy password for firefox
  22. Selenium – MoveTargetOutOfBoundsException with Firefox
  23. Setting path to firefox binary on windows with selenium webdriver
  24. Selenium-Debugging: Element is not clickable at point (X,Y)
  25. Selenium use of Firefox profile
  26. DeprecationWarning: firefox_profile has been deprecated, please pass in an Options object
  27. How to initiate a Tor Browser 9.5 which uses the default Firefox to 68.9.0esr using GeckoDriver and Selenium through Python
  28. Which Firefox version is compatible with Selenium 3.6.0
  29. Python / Selenium / Firefox: Can’t start firefox with specified profile path
  30. how can i remove notifications and alerts from browser? selenium python 2.7.7

Leave a Comment