Fetch all href link using selenium in python

by

Well, you have to simply loop through the list:

elems = driver.find_elements_by_xpath("//a[@href]")
for elem in elems:
    print(elem.get_attribute("href"))

find_elements_by_* returns a list of elements (note the spelling of ‘elements’). Loop through the list, take each element and fetch the required attribute value you want from it (in this case href).

More Related Contents:

  1. how to scrape web page that is not written directly using HTML, but is auto-generated using JavaScript? [closed]
  2. selenium with scrapy for dynamic page
  3. How can I download a file on a click event using selenium?
  4. Python: find_element_by_css_selector
  5. ‘list’ object has no attribute ‘get_attribute’ while iterating through WebElements
  6. How to click a link by text with No Text in Python
  7. Selenium-Debugging: Element is not clickable at point (X,Y)
  8. Python selenium error when trying to launch firefox
  9. ChromeDriver Error: ‘chromedriver’ executable needs to be in PATH [duplicate]
  10. selenium in python : NoSuchElementException: Message: no such element: Unable to locate element
  11. Selenium: WebDriverException:Chrome failed to start: crashed as google-chrome is no longer running so ChromeDriver is assuming that Chrome has crashed
  12. unknown error: session deleted because of page crash from unknown error: cannot determine loading status from tab crashed with ChromeDriver Selenium
  13. How to get attribute of element from Selenium?
  14. ‘Webdrivers’ executable may have wrong permissions. Please see https://sites.google.com/a/chromium.org/chromedriver/home
  15. find_element_by_* commands are deprecated in selenium
  16. Scrape website with dynamic mouseover event
  17. Get value of an input box using Selenium (Python)
  18. How to change the User Agent using Selenium and Python
  19. SessionNotCreatedException: This version of ChromeDriver only supports Chrome version 84 using ChromeDriver and Chrome through Selenium and Python
  20. Python and how to get text from Selenium element WebElement object?
  21. How to test non-standard drop down lists through a crawler using Selenium and Python
  22. How can I get text of an element in Selenium WebDriver, without including child element text?
  23. Python selenium: wait until element is clickable – not working
  24. How locate the pseudo-element ::before using Selenium Python
  25. Scraping dynamic data selenium – Unable to locate element
  26. How can we use Selenium Webdriver in colab.research.google.com?
  27. Selenium – visibility_of_element_located: __init__() takes exactly 2 arguments (3 given)
  28. How to locate the First name field within shadow-root (open) within the website https://www.virustotal.com using Selenium and Python
  29. Browser performance tests through selenium
  30. How to click on Load More button within Google Trends and print all the titles through Selenium and Python

Leave a Comment