PyQt4 to PyQt5 -> mainFrame() deprecated, need fix to load web pages

by

you must call the QWebEnginePage::toHtml() inside the definition of the class. QWebEnginePage::toHtml() takes a pointer function or a lambda as a parameter, and this pointer function must in turn take a parameter of ‘str’ type (this is the parameter that contains the page’s html). Here is sample code below.

import bs4 as bs
import sys
import urllib.request
from PyQt5.QtWebEngineWidgets import QWebEnginePage
from PyQt5.QtWidgets import QApplication
from PyQt5.QtCore import QUrl

class Page(QWebEnginePage):
    def __init__(self, url):
        self.app = QApplication(sys.argv)
        QWebEnginePage.__init__(self)
        self.html=""
        self.loadFinished.connect(self._on_load_finished)
        self.load(QUrl(url))
        self.app.exec_()

    def _on_load_finished(self):
        self.html = self.toHtml(self.Callable)
        print('Load finished')

    def Callable(self, html_str):
        self.html = html_str
        self.app.quit()


def main():
    page = Page('https://pythonprogramming.net/parsememcparseface/')
    soup = bs.BeautifulSoup(page.html, 'html.parser')
    js_test = soup.find('p', class_='jstest')
    print js_test.text

if __name__ == '__main__': main()

More Related Contents:

  1. PyQt4 to PyQt5 how?
  2. Passing extra arguments through connect
  3. PyQt: No error msg (traceback) on exit
  4. PyQt4 Wait in thread for user input from GUI
  5. How to install PyQt4 on Windows using pip?
  6. Is there a difference between QFileDialog strings in PyQt4 and PyQt5?
  7. Clear QLineEdit on click event
  8. Multiple inheritance metaclass conflict
  9. How to change UI in same window using PyQt5?
  10. PyQt5 failing import of QtGui
  11. How can I check if a keyboard modifier is pressed (Shift, Ctrl, or Alt)?
  12. PyQt4 center window on active screen
  13. QtDesigner changes will be lost after redesign User Interface
  14. Equivalent to time.sleep for a PyQt application
  15. Should wildcard import be avoided?
  16. How to capture output of Python’s interpreter and show in a Text widget?
  17. How to create collapsible box in PyQt
  18. PyQt: app.exec_() stops all following code from running
  19. PyQt5 QTextBrowser – setText – Alignment issue?
  20. PyQt5 – QThread: Destroyed while thread is still running
  21. time.sleep() and BackGround Windows PyQt5
  22. How to align the text to center of cells in a QTableWidget
  23. Hiding console window of Python GUI app with py2exe
  24. Show string values on x-axis in pyqtgraph
  25. Make QLabel clickable
  26. Connect to serial from a PyQt GUI
  27. Python 3.7.0 No module named ‘PyQt5.QtWebEngineWidgets’
  28. Matplotlib animation inside your own GUI
  29. PyQt Class not working for the second usage
  30. Unable to install PyQt5 on Raspberry Pi [duplicate]

Leave a Comment