Selenium can’t open a second page

by 
options.add_experimental_option(
    "excludeSwitches", ['enable-automation'])

options.add_argument(
    "user-agent=Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/87.0.4280.88 Safari/537.36")
options.add_argument("--remote-debugging-port=9222")

driver = webdriver.Chrome(options=options)
driver.get(
    "https://www.justdial.com/Chennai/Hr-Consultancy-Services/nct-10258625/page-2")
driver.set_page_load_timeout(30)
driver.get(
    "https://www.justdial.com/Chennai/Hr-Consultancy-Services/nct-10258625/page-3")

the website is detecting automation use above code 🙂

You can also do this in single line

Just add below argument:

options.add_argument('--disable-blink-features=AutomationControlled')

disabling enable-automation , or disabling automation controller disables webdriver.navigator which few websites uses to detect automation scripts

More Related Contents:

  1. Selenium: WebDriverException:Chrome failed to start: crashed as google-chrome is no longer running so ChromeDriver is assuming that Chrome has crashed
  2. WebDriverException: Message: ‘chromedriver’ executable needs to be in PATH while setting UserAgent through Selenium Chromedriver python
  3. unknown error: session deleted because of page crash from unknown error: cannot determine loading status from tab crashed with ChromeDriver Selenium
  4. ‘Webdrivers’ executable may have wrong permissions. Please see https://sites.google.com/a/chromium.org/chromedriver/home
  5. WebDriverException: unknown error: cannot find Chrome binary error with Selenium in Python for older versions of Google Chrome
  6. Way to change Google Chrome user agent in Selenium?
  7. How to work with a specific version of ChromeDriver while Chrome Browser gets updated automatically through Python selenium
  8. Selenium waitForElement
  9. WebDriverException: Message: Service chromedriver unexpectedly exited. Status code was: 127
  10. Error Message: ‘chromedriver’ executable needs to be PATH
  11. What is the fastest way to open urls in new tabs via Selenium – Python?
  12. Clicking on Get Data button for Monthly Settlement Statistics on nseindia.com doesn’t fetch results using Selenium and Python
  13. How to use Selenium with Python?
  14. How to download XML files avoiding the popup This type of file may harm your computer through ChromeDriver and Chrome using Selenium in Python
  15. Using Extensions with Selenium (Python)
  16. Set chrome browser binary through chromedriver in Python
  17. WebDriverException: Message: Service /content/chromedriver unexpectedly exited. Status code was: -6 with ChromeDriver Google Colab and Selenium
  18. TypeError: ‘module’ object is not callable error with driver=webdriver(“C:\\Python34\\Lib\\site-packages\\selenium\\webdriver\\chromedriver.exe”)
  19. SessionNotCreatedException: This version of ChromeDriver only supports Chrome version 84 using ChromeDriver and Chrome through Selenium and Python
  20. How to solve ‘Getting Default Adapter failed’ error when launching Chrome and try to access a webpage using the ChromeDriver using Selenium
  21. Why switching to alert through selenium is not stable?
  22. Chrome browser initiated through ChromeDriver gets detected
  23. WebDriverException: Service U:/Scraping/chromedriver.exe unexpectedly exited. Status code was: 1 while working with Chrome and Python
  24. Selenium – Python – AttributeError: ‘WebDriver’ object has no attribute ‘find_element_by_name’
  25. Automation Google login with python and selenium shows “”This browser or app may be not secure””
  26. Python Selenium accessing HTML source
  27. WebDriverException: Message: Service /usr/lib/chromium-browser/chromedriver unexpectedly exited on Raspberry-Pi with ChromeDriver and Selenium
  28. How to get past a cookie agreement page using Python and Selenium?
  29. selenium.common.exceptions.ElementNotVisibleException: Message: element not visible while trying to access an element with Python + Selenium
  30. How to click on Load More button within Google Trends and print all the titles through Selenium and Python

Leave a Comment