Get page generated with Javascript in Python

by

You could use Selenium Webdriver:

#!/usr/bin/env python
from contextlib import closing
from selenium.webdriver import Firefox # pip install selenium
from selenium.webdriver.support.ui import WebDriverWait

# use firefox to get page with javascript generated content
with closing(Firefox()) as browser:
     browser.get(url)
     button = browser.find_element_by_name('button')
     button.click()
     # wait for the page to load
     WebDriverWait(browser, timeout=10).until(
         lambda x: x.find_element_by_id('someId_that_must_be_on_new_page'))
     # store it to string variable
     page_source = browser.page_source
print(page_source)

More Related Contents:

  1. JavaScript blob filename without link
  2. How to trigger a file download when clicking an HTML button or JavaScript
  3. Using HTML5/JavaScript to generate and save a file
  4. Download A File At Different Location Using HTML5
  5. How to download a file without using element with download attribute or a server?
  6. Flask – Calling python function on button OnClick event
  7. How can I let a user download multiple files when a button is clicked?
  8. How can I execute a python script from an html button?
  9. Python library for rendering HTML and javascript [closed]
  10. Download textarea contents as a file using only Javascript (no server-side)
  11. How do I download a file from FastAPI backend using Fetch API in the frontend?
  12. How do i take picture from client side(html) and save it to server side(Python)
  13. How do I download a file from FastAPI backend using JavaScript Fetch API in the frontend?
  14. Double digit 30 seconds countdown
  15. Using HTML5/Canvas/JavaScript to take in-browser screenshots
  16. What’s the effect of adding ‘return false’ to a click event listener?
  17. Connecting to TCP Socket from browser using javascript
  18. Does HTML5/Canvas Support Double Buffering?
  19. Add a tooltip to a div
  20. How do I fix blurry text in my HTML5 canvas?
  21. File Upload without Form
  22. How to embed an autoplaying YouTube video in an iframe?
  23. How to reach the element itself inside jQuery’s `val`?
  24. Mechanize and Javascript
  25. Conditional comment for ‘Except IE8’?
  26. wget + JavaScript?
  27. Browser back button handling
  28. Drawing arrows on an HTML page to visualize semantic links between textual spans
  29. angularjs custom filter to check for values inside a data array
  30. JavaScript – Get size in bytes from HTML img src

Leave a Comment