Python Selenium wait for several elements to load

by

First and foremost the elements are AJAX elements.

Now, as per the requirement to locate all the desired elements and create a list, the simplest approach would be to induce WebDriverWait for the visibility_of_all_elements_located() and you can use either of the following Locator Strategies:

  • Using CSS_SELECTOR:

    elements = WebDriverWait(driver, 20).until(EC.visibility_of_all_elements_located((By.CSS_SELECTOR, "ul.ltr li[id^='t_b_'] > a[id^='t_a_'][href]")))

  • Using XPATH:

    elements = WebDriverWait(driver, 20).until(EC.visibility_of_all_elements_located((By.XPATH, "//ul[@class="ltr"]//li[starts-with(@id, 't_b_')]/a[starts-with(@id, 't_a_') and starts-with(., 'Category')]")))

  • Note : You have to add the following imports :

    from selenium.webdriver.support.ui import WebDriverWait
from selenium.webdriver.common.by import By
from selenium.webdriver.support import expected_conditions as EC

Incase your usecase is to wait for certain number of elements to be loaded e.g. 10 elements, you can use you can use the lambda function as follows:

  • Using >:

    myLength = 9
WebDriverWait(driver, 20).until(lambda driver: len(driver.find_elements_by_xpath("//ul[@class="ltr"]//li[starts-with(@id, 't_b_')]/a[starts-with(@id, 't_a_') and starts-with(., 'Category')]")) > int(myLength))

  • Using ==:

    myLength = 10
WebDriverWait(driver, 20).until(lambda driver: len(driver.find_elements_by_xpath("//ul[@class="ltr"]//li[starts-with(@id, 't_b_')]/a[starts-with(@id, 't_a_') and starts-with(., 'Category')]")) == int(myLength))

You can find a relevant discussion in How to wait for number of elements to be loaded using Selenium and Python

References

You can find a couple of relevant detailed discussions in:

More Related Contents:

  1. How can I scroll a web page using selenium webdriver in python?
  2. Get HTML source of WebElement in Selenium WebDriver using Python
  3. Selenium waitForElement
  4. Select -> option abstraction
  5. Expected conditions in protractor
  6. Selenium – wait until element is present, visible and interactable
  7. How to select a drop-down menu value with Selenium using Python?
  8. selenium with scrapy for dynamic page
  9. How to make Firefox headless programmatically in Selenium with Python?
  10. Of the many findElement(s)/By functions in Selenium, when would you use one over the other?
  11. How can I download a file on a click event using selenium?
  12. Running Selenium WebDriver python bindings in chrome
  13. How to simulate HTML5 Drag and Drop in Selenium Webdriver?
  14. How to fix Selenium WebDriverException: The browser appears to have exited before we could connect?
  15. Turning off logging in Selenium (from Python)
  16. SyntaxError: Failed to execute ‘evaluate’ on ‘Document’: The string ‘//img[contains(‘1236548597′)]’ is not a valid XPath expression
  17. “NoSuchWindowException: no such window: window was already closed” while switching tabs using Selenium and WebDriver through Python3
  18. How to click a link by text with No Text in Python
  19. Set chrome browser binary through chromedriver in Python
  20. Fetch all href link using selenium in python
  21. How to properly stop phantomjs execution
  22. Why switching to alert through selenium is not stable?
  23. IOError: [Errno 13] Permission denied: ‘geckodriver.log when running Python/Selenium
  24. How to fix python-selenium error “connection refused” when initializing a selenium webdriver?
  25. Webpage Is Detecting Selenium Webdriver with Chromedriver as a bot
  26. How to select multiple options from multi select list using Selenium-Python?
  27. Python Selenium driver.execute_script WebDriverException: Message: unknown error: call function result missing ‘value’
  28. Browser performance tests through selenium
  29. Message: stale element reference: element is not attached to the page document in Python
  30. How to click on Load More button within Google Trends and print all the titles through Selenium and Python

Leave a Comment