Don’t wait for a page to load using Selenium in Python

by

ChromeDriver 77.0 (which supports Chrome version 77) now supports eager as pageLoadStrategy.

Resolved issue 1902: Support eager page load strategy [Pri-2]

As you question mentions of click on elements and scrape data before the page has fully loaded in this case we can take help of an attribute pageLoadStrategy. When Selenium loads a page/url by default it follows a default configuration with pageLoadStrategy set to normal. Selenium can start executing the next line of code from different Document readiness state. Currently Selenium supports 3 different Document readiness state which we can configure through the pageLoadStrategy as follows:

  1. none (undefined)
  2. eager (page becomes interactive)
  3. normal (complete page load)

Here is the code block to configure the pageLoadStrategy:

from selenium import webdriver
from selenium.webdriver.common.desired_capabilities import DesiredCapabilities

binary = r'C:\Program Files\Mozilla Firefox\firefox.exe'
caps = DesiredCapabilities().FIREFOX
# caps["pageLoadStrategy"] = "normal"  #  complete
caps["pageLoadStrategy"] = "eager"  #  interactive
# caps["pageLoadStrategy"] = "none"   #  undefined
driver = webdriver.Firefox(capabilities=caps, firefox_binary=binary, executable_path="C:\\Utility\\BrowserDrivers\\geckodriver.exe")
driver.get("https://google.com")

More Related Contents:

  1. Selenium “selenium.common.exceptions.NoSuchElementException” when using Chrome
  2. How to sleep Selenium WebDriver in Python for milliseconds
  3. Switch to an iframe through Selenium and python
  4. Python + Selenium: Wait until element is fully loaded
  5. How to select a drop-down menu value with Selenium using Python?
  6. Get HTML source of WebElement in Selenium WebDriver using Python
  7. How to get attribute of element from Selenium?
  8. How to allow or deny notification geo-location microphone camera pop up
  9. find_element_by_* commands are deprecated in selenium
  10. Selenium: FirefoxProfile exception Can’t load the profile
  11. How to rotate Selenium webrowser IP address
  12. How do you fix the “element not interactable” exception?
  13. How to open multiple webpages in separate tabs within a browser using selenium-webdriver and python
  14. How to get rid of the infobar “Chrome is being controlled by automated test software” through Selenium
  15. Undetected Chromedriver not loading correctly
  16. How to change the User Agent using Selenium and Python
  17. selenium grid listening on node port instead of hub port
  18. How to test non-standard drop down lists through a crawler using Selenium and Python
  19. Python selenium: wait until element is clickable – not working
  20. How to get an attribute of an element from Selenium
  21. Finding elements by class name with Selenium in Python
  22. How to execute tests with selenium webdriver while browser is minimized
  23. Webpage Is Detecting Selenium Webdriver with Chromedriver as a bot
  24. How to select multiple options from multi select list using Selenium-Python?
  25. How to rotate various user agents using selenium python on each request
  26. __init__() takes 2 positional arguments but 3 were given using WebDriverWait and expected_conditions as element_to_be_clickable with Selenium Python
  27. What is unittest in selenium Python?
  28. Send keys not working selenium webdriver python
  29. selenium.common.exceptions.WebDriverException: Message: Can not connect to the Service chromedriver.exe while opening chrome browser
  30. Webdriver Screenshot

Leave a Comment