Browser performance tests through selenium

by

There is a possibility to get closer to what browser-perf is doing by collecting the chrome performance logs and analyzing them.

To get performance logs, turn on performance logs by tweaking loggingPrefs desired capability:

from selenium import webdriver
from selenium.webdriver.common.desired_capabilities import DesiredCapabilities

caps = DesiredCapabilities.CHROME
caps['loggingPrefs'] = {'performance': 'ALL'}
driver = webdriver.Chrome(desired_capabilities=caps)

driver.get('https://stackoverflow.com')

logs = [json.loads(log['message'])['message'] for log in driver.get_log('performance')]

with open('devtools.json', 'wb') as f:
    json.dump(logs, f)

driver.close()

At this point, devtools.json file would contain a bunch of trace records:

[
  {
    "params": {
      "timestamp": 1419571233.19293,
      "frameId": "16639.1",
      "requestId": "16639.1",
      "loaderId": "16639.2",
      "type": "Document",
      "response": {
        "mimeType": "text/plain",
        "status": 200,
        "fromServiceWorker": false,
        "encodedDataLength": -1,
        "headers": {
          "Access-Control-Allow-Origin": "*",
          "Content-Type": "text/plain;charset=US-ASCII"
        },
        "url": "data:,",
        "statusText": "OK",
        "connectionId": 0,
        "connectionReused": false,
        "fromDiskCache": false
      }
    },
    "method": "Network.responseReceived"
  },
  {
    "params": {
      "timestamp": 1419571233.19294,
      "encodedDataLength": 0,
      "requestId": "16639.1"
    },
    "method": "Network.loadingFinished"
  },
  ..
]

Now, the question is, what to do with it.

One option that was initially suggested during the Google Test Automation Conference is to submit the logs to webpagetest.org. There is an example in java available here, but, at the moment, I had no luck implementing it in Python.

In theory, the UI report generated by webpagetest.org would look like this:

enter image description here

They also provide the metrics in JSON/XML and other formats that can be further analyzed.

This is really something, thanks to Vivek Singh for the pointing comment.

browser-perf also uses the logging functionality to pick up the tracing logs, and analyzes the data.

More Related Contents:

  1. Select -> option abstraction
  2. Expected conditions in protractor
  3. how to scrape web page that is not written directly using HTML, but is auto-generated using JavaScript? [closed]
  4. WebDriverException: Message: ‘chromedriver’ executable needs to be in PATH while setting UserAgent through Selenium Chromedriver python
  5. selenium with scrapy for dynamic page
  6. WebDriver click() vs JavaScript click()
  7. Python : no module named selenium
  8. Of the many findElement(s)/By functions in Selenium, when would you use one over the other?
  9. How can I download a file on a click event using selenium?
  10. How to simulate HTML5 Drag and Drop in Selenium Webdriver?
  11. selenium.common.exceptions.SessionNotCreatedException: Message: Unable to find a matching set of capabilities with Firefox 46 through Selenium
  12. How to fix Selenium WebDriverException: The browser appears to have exited before we could connect?
  13. Turning off logging in Selenium (from Python)
  14. SyntaxError: Failed to execute ‘evaluate’ on ‘Document’: The string ‘//img[contains(‘1236548597′)]’ is not a valid XPath expression
  15. “NoSuchWindowException: no such window: window was already closed” while switching tabs using Selenium and WebDriver through Python3
  16. How to click a link by text with No Text in Python
  17. Set chrome browser binary through chromedriver in Python
  18. Selenium on MAC, Message: ‘chromedriver’ executable may have wrong permissions
  19. Get all child elements
  20. Fetch all href link using selenium in python
  21. How to properly stop phantomjs execution
  22. Why switching to alert through selenium is not stable?
  23. IOError: [Errno 13] Permission denied: ‘geckodriver.log when running Python/Selenium
  24. Logic Operators in WebDriverWait Expected Conditions
  25. How to fix python-selenium error “connection refused” when initializing a selenium webdriver?
  26. Webpage Is Detecting Selenium Webdriver with Chromedriver as a bot
  27. How to select multiple options from multi select list using Selenium-Python?
  28. Python Selenium driver.execute_script WebDriverException: Message: unknown error: call function result missing ‘value’
  29. What is unittest in selenium Python?
  30. selenium.common.exceptions.WebDriverException: Message: Can not connect to the Service chromedriver.exe while opening chrome browser

Leave a Comment