How can I scroll a web page using selenium webdriver in python?

by

You can use

driver.execute_script("window.scrollTo(0, Y)")

where Y is the height (on a fullhd monitor it’s 1080). (Thanks to @lukeis)

You can also use

driver.execute_script("window.scrollTo(0, document.body.scrollHeight);")

to scroll to the bottom of the page.

If you want to scroll to a page with infinite loading, like social network ones, facebook etc. (thanks to @Cuong Tran)

SCROLL_PAUSE_TIME = 0.5

# Get scroll height
last_height = driver.execute_script("return document.body.scrollHeight")

while True:
    # Scroll down to bottom
    driver.execute_script("window.scrollTo(0, document.body.scrollHeight);")

    # Wait to load page
    time.sleep(SCROLL_PAUSE_TIME)

    # Calculate new scroll height and compare with last scroll height
    new_height = driver.execute_script("return document.body.scrollHeight")
    if new_height == last_height:
        break
    last_height = new_height

another method (thanks to Juanse) is, select an object and 

label.sendKeys(Keys.PAGE_DOWN);

More Related Contents:

  1. Get HTML source of WebElement in Selenium WebDriver using Python
  2. Python Selenium wait for several elements to load
  3. Selenium waitForElement
  4. Switch to an iframe through Selenium and python
  5. Python + Selenium: Wait until element is fully loaded
  6. How to get attribute of element from Selenium?
  7. ‘Webdrivers’ executable may have wrong permissions. Please see https://sites.google.com/a/chromium.org/chromedriver/home
  8. python selenium click on button
  9. Reducing size of pyinstaller exe
  10. How to use Selenium with Python?
  11. Selenium: FirefoxProfile exception Can’t load the profile
  12. How to get text of an element in Selenium WebDriver, without including child element text?
  13. How to extract info within a #shadow-root (open) using Selenium Python?
  14. How to download XML files avoiding the popup This type of file may harm your computer through ChromeDriver and Chrome using Selenium in Python
  15. ERROR:gpu_process_transport_factory.cc(1007)-Lost UI shared context : while initializing Chrome browser through ChromeDriver in Headless mode
  16. Using Extensions with Selenium (Python)
  17. How can I make sure if some HTML elements are loaded for Selenium + Python?
  18. Does anybody know how to identify shadow dom web elements using selenium webdriver?
  19. How do I set browser width and height in Selenium WebDriver?
  20. How to get rid of the infobar “Chrome is being controlled by automated test software” through Selenium
  21. SessionNotCreatedException: This version of ChromeDriver only supports Chrome version 84 using ChromeDriver and Chrome through Selenium and Python
  22. Finding elements by class name with Selenium in Python
  23. How to execute tests with selenium webdriver while browser is minimized
  24. Selenium – Python – AttributeError: ‘WebDriver’ object has no attribute ‘find_element_by_name’
  25. PhantomJS with Selenium error: Message: ‘phantomjs’ executable needs to be in PATH
  26. selenium webdriver upload file
  27. Handle notifications in Python + Selenium Chrome WebDriver
  28. How to rotate various user agents using selenium python on each request
  29. What is unittest in selenium Python?
  30. selenium.common.exceptions.WebDriverException: Message: Can not connect to the Service chromedriver.exe while opening chrome browser

Leave a Comment