How to extract info within a #shadow-root (open) using Selenium Python?

by

The products within the website https://www.tiendasjumbo.co/buscar?q=mani are located within a #shadow-root (open).

impulse-search

Solution

To extract the product label you have to use shadowRoot.querySelector() and you can use the following Locator Strategy:

  • Code Block:

    driver.get('https://www.tiendasjumbo.co/buscar?q=mani')
item = driver.execute_script("return document.querySelector('impulse-search').shadowRoot.querySelector('div.group-name-brand h1.impulse-title span.formatted-text')")
print(item.text)

  • Console Output:

    La especial mezcla de nueces, maní, almendras y marañones x 450 g

References

You can find a couple of relevant discussions in:

Microsoft Edge and Google Chrome version 96

Chrome v96 has changed the shadow root return values for Selenium. Some helpful links:

More Related Contents:

  1. How to get past a cookie agreement page using Python and Selenium?
  2. How to locate the First name field within shadow-root (open) within the website https://www.virustotal.com using Selenium and Python
  3. How to handle elements inside Shadow DOM from Selenium
  4. Does anybody know how to identify shadow dom web elements using selenium webdriver?
  5. How to handle the popup “Accepting all cookies” when the element is data-testid – Using Selenium in Python
  6. How to sleep Selenium WebDriver in Python for milliseconds
  7. WebDriverException: unknown error: cannot find Chrome binary error with Selenium in Python for older versions of Google Chrome
  8. Running Selenium Webdriver with a proxy in Python
  9. Unable to locate element of credit card number using selenium python
  10. How can I download a file on a click event using selenium?
  11. Python Selenium accessing HTML source
  12. Log into gmail using Selenium in Python
  13. Select -> option abstraction
  14. How to set the timeout of ‘driver.get’ for python selenium 3.8.0?
  15. in selenium web driver how to choose the correct iframe
  16. Expected browser binary location, but unable to find binary in default location, no ‘moz:firefoxOptions.binary’ capability provided using GeckoDriver
  17. Mouse scroll wheel with selenium webdriver, on element without scrollbar?
  18. Setting path to firefox binary on windows with selenium webdriver
  19. Selenium-Debugging: Element is not clickable at point (X,Y)
  20. Undetected Chromedriver not loading correctly
  21. Is there a way to perform a mouseover (hover over an element) using Selenium and Python bindings?
  22. How to solve ‘Getting Default Adapter failed’ error when launching Chrome and try to access a webpage using the ChromeDriver using Selenium
  23. How to find element by part of its id name in selenium with python
  24. How to get an attribute of an element from Selenium
  25. Selenium webdriver: How do I find ALL of an element’s attributes?
  26. selenium.common.exceptions.SessionNotCreatedException: Message: Unable to find a matching set of capabilities with GeckoDriver, Selenium and Firefox
  27. Chrome browser initiated through ChromeDriver gets detected
  28. WebDriverException: Service U:/Scraping/chromedriver.exe unexpectedly exited. Status code was: 1 while working with Chrome and Python
  29. What is unittest in selenium Python?
  30. selenium.common.exceptions.WebDriverException: Message: Can not connect to the Service chromedriver.exe while opening chrome browser

Leave a Comment