How to make Selenium not wait till full page load, which has a slow script?

by

When Selenium loads a page/url by default it follows a default configuration with pageLoadStrategy set to normal. To make Selenium not to wait for full page load we can configure the pageLoadStrategy. pageLoadStrategy supports 3 different values as follows:

  1. normal (full page load)
  2. eager (interactive)
  3. none

Here is the code block to configure the pageLoadStrategy :

  • Firefox :

    from selenium import webdriver
from selenium.webdriver.common.desired_capabilities import DesiredCapabilities

caps = DesiredCapabilities().FIREFOX
caps["pageLoadStrategy"] = "normal"  #  complete
#caps["pageLoadStrategy"] = "eager"  #  interactive
#caps["pageLoadStrategy"] = "none"
driver = webdriver.Firefox(desired_capabilities=caps, executable_path=r'C:\path\to\geckodriver.exe')
driver.get("http://google.com")

  • Chrome :

    from selenium import webdriver
from selenium.webdriver.common.desired_capabilities import DesiredCapabilities

caps = DesiredCapabilities().CHROME
caps["pageLoadStrategy"] = "normal"  #  complete
#caps["pageLoadStrategy"] = "eager"  #  interactive
#caps["pageLoadStrategy"] = "none"
driver = webdriver.Chrome(desired_capabilities=caps, executable_path=r'C:\path\to\chromedriver.exe')
driver.get("http://google.com")

Note : pageLoadStrategy values normal, eager and none is a requirement as per WebDriver W3C Editor’s Draft but pageLoadStrategy value as eager is still a WIP (Work In Progress) within ChromeDriver implementation. You can find a detailed discussion in “Eager” Page Load Strategy workaround for Chromedriver Selenium in Python

More Related Contents:

  1. Selenium: WebDriverException:Chrome failed to start: crashed as google-chrome is no longer running so ChromeDriver is assuming that Chrome has crashed
  2. How to open a Chrome Profile through Python
  3. unknown error: session deleted because of page crash from unknown error: cannot determine loading status from tab crashed with ChromeDriver Selenium
  4. ‘Webdrivers’ executable may have wrong permissions. Please see https://sites.google.com/a/chromium.org/chromedriver/home
  5. WebDriverException: unknown error: cannot find Chrome binary error with Selenium in Python for older versions of Google Chrome
  6. USB: usb_device_handle_win.cc:1020 Failed to read descriptor from node connection error with ChromeDriver v87 / Chrome v87 using Selenium on Windows10
  7. Change ChromeOptions in an existing webdriver
  8. How to work with a specific version of ChromeDriver while Chrome Browser gets updated automatically through Python selenium
  9. Running Selenium with Headless Chrome Webdriver
  10. WebDriverException: Message: Service chromedriver unexpectedly exited. Status code was: 127
  11. Error Message: ‘chromedriver’ executable needs to be PATH
  12. selenium.common.exceptions.WebDriverException: Message: invalid session id using Selenium with ChromeDriver and Chrome through Python
  13. Unable to use Selenium to automate Chase site login
  14. What is the fastest way to open urls in new tabs via Selenium – Python?
  15. Clicking on Get Data button for Monthly Settlement Statistics on nseindia.com doesn’t fetch results using Selenium and Python
  16. Failed to read descriptor from node connection: A device attached to the system is not functioning error using ChromeDriver Selenium on Windows OS
  17. How to download XML files avoiding the popup This type of file may harm your computer through ChromeDriver and Chrome using Selenium in Python
  18. How to disable CSS in Python selenium using ChromeOptions
  19. How to load extension within chrome driver in selenium with python
  20. How do I pass options to the Selenium Chrome driver using Python?
  21. Chromedriver only supports characters in the BMP error while sending Emoji with ChromeDriver Chrome using Selenium Python to Tkinter’s label() textbox
  22. TypeError: ‘module’ object is not callable error with driver=webdriver(“C:\\Python34\\Lib\\site-packages\\selenium\\webdriver\\chromedriver.exe”)
  23. SessionNotCreatedException: This version of ChromeDriver only supports Chrome version 84 using ChromeDriver and Chrome through Selenium and Python
  24. Chrome crashes after several hours while multiprocessing using Selenium through Python
  25. How to solve ‘Getting Default Adapter failed’ error when launching Chrome and try to access a webpage using the ChromeDriver using Selenium
  26. Chrome browser initiated through ChromeDriver gets detected
  27. WebDriverException: Service U:/Scraping/chromedriver.exe unexpectedly exited. Status code was: 1 while working with Chrome and Python
  28. Selenium – Python – AttributeError: ‘WebDriver’ object has no attribute ‘find_element_by_name’
  29. selenium.common.exceptions.ElementNotVisibleException: Message: element not interactable using Selenium
  30. How to install Chrome Extension using Selenium & Python

Leave a Comment