Decoding Class names on facebook through Selenium

by

You were pretty correct. Facebook is built through ReactJS which is pretty much evident from the presence of the following keywords and tags within the HTML DOM:

  • {"react_render":true,"reflow":true}
  • <!-- react-mount-point-unstable -->
  • ["React-prod"]
  • ["ReactDOM-prod"]
  • ReactComposerTaggerType:{r:["t5r69"],be:1}

So, the dynamically generated class names are bound to change after certain timegaps.

Solution

The solution would be to use the static attributes to construct a dynamic Locator Strategy.

To retrieve the first line of the address just below the text FIND US you need to induce WebDriverWait in conjunction with expected_conditions as visibility_of_element_located() and you can use the following optimized solution:

print(WebDriverWait(driver, 20).until(EC.visibility_of_element_located((By.XPATH, "//span[normalize-space()='FIND US']//following::span[2]"))))

References

You can find some relevant discussions in:

Outro

Note: Scraping Facebook violates their Terms of Service of section 3.2.3 and you are liable to be questioned and may even land up in Facebook Jail. Use Facebook Graph API instead.

More Related Contents:

  1. ElementNotInteractableException: Message: element not interactable error while sending text to Email field on Quora using Selenium with Python
  2. ElementNotInteractableException: Message: element not interactable error sending text in search field using Selenium Python
  3. Selenium – wait until element is present, visible and interactable
  4. How to sleep Selenium WebDriver in Python for milliseconds
  5. selenium.common.exceptions.NoSuchElementException: Message: no such element: Unable to locate element while trying to click Next button with selenium
  6. selenium in python : NoSuchElementException: Message: no such element: Unable to locate element
  7. Python + Selenium: Wait until element is fully loaded
  8. StaleElementException when iterating with Python
  9. How do you use EC.presence_of_element_located((By.ID, “myDynamicElement”)) except to specify class not ID
  10. Unable to locate element using selenium chrome webdriver in python selenium
  11. Selenium and iframe in html
  12. Selenium not able to click on Get Data button on using Python
  13. selenium.common.exceptions.ElementClickInterceptedException: Message: element click intercepted: Element is not clickable with Selenium and Python
  14. SyntaxError: Failed to execute ‘evaluate’ on ‘Document’: The string ‘//img[contains(‘1236548597′)]’ is not a valid XPath expression
  15. “NoSuchWindowException: no such window: window was already closed” while switching tabs using Selenium and WebDriver through Python3
  16. How to open a link embeded in a webelement with in the main tab, in a new tab of the same window using Control + Click of Selenium Webdriver
  17. Python Selenium – get href value
  18. ElementClickInterceptedException: Message: element click intercepted: Element is not clickable with Selenium and Python
  19. Getting all visible text from a webpage using Selenium
  20. Logic Operators in WebDriverWait Expected Conditions
  21. How to select kendo dropdown element with unselectable=”on” attribute using Selenium and Python
  22. How to send text to the Password field within https://mail.protonmail.com registration page?
  23. How to find element by part of its id name in selenium with python
  24. “selenium.common.exceptions.NoSuchElementException: Message: no such element: Unable to locate element” while clicking a ‘Next’ button with Selenium
  25. NoSuchElementException: Message: Unable to locate element while trying to click on the button VISA through Selenium and Python
  26. selenium.common.exceptions.ElementNotVisibleException: Message: element not visible while trying to access an element with Python + Selenium
  27. How to retrieve the title attribute through Selenium using Python?
  28. __init__() takes 2 positional arguments but 3 were given using WebDriverWait and expected_conditions as element_to_be_clickable with Selenium Python
  29. Message: stale element reference: element is not attached to the page document in Python
  30. How to click on Load More button within Google Trends and print all the titles through Selenium and Python

Leave a Comment