Change user-agent for Selenium web-driver

by

There is no way in Selenium to read the request or response headers. You could do it by instructing your browser to connect through a proxy that records this kind of information.

Setting the User Agent in Firefox

The usual way to change the user agent for Firefox is to set the variable "general.useragent.override" in your Firefox profile. Note that this is independent from Selenium.

You can direct Selenium to use a profile different from the default one, like this:

from selenium import webdriver
profile = webdriver.FirefoxProfile()
profile.set_preference("general.useragent.override", "whatever you want")
driver = webdriver.Firefox(profile)

Setting the User Agent in Chrome

With Chrome, what you want to do is use the user-agent command line option. Again, this is not a Selenium thing. You can invoke Chrome at the command line with chrome --user-agent=foo to set the agent to the value foo.

With Selenium you set it like this:

from selenium import webdriver
from selenium.webdriver.chrome.options import Options
opts = Options()
opts.add_argument("user-agent=whatever you want")

driver = webdriver.Chrome(chrome_options=opts)

Both methods above were tested and found to work. I don’t know about other browsers.

Getting the User Agent

Selenium does not have methods to query the user agent from an instance of WebDriver. Even in the case of Firefox, you cannot discover the default user agent by checking what general.useragent.override would be if not set to a custom value. (This setting does not exist before it is set to some value.)

Once the browser is started, however, you can get the user agent by executing:

agent = driver.execute_script("return navigator.userAgent")

The agent variable will contain the user agent.

More Related Contents:

  1. Way to change Google Chrome user agent in Selenium?
  2. How to change the User Agent using Selenium and Python
  3. Selenium – wait until element is present, visible and interactable
  4. How to select a drop-down menu value with Selenium using Python?
  5. How to use Python requests to fake a browser visit a.k.a and generate User Agent?
  6. How to switch to new window in Selenium for Python?
  7. Unable to locate element using selenium chrome webdriver in python selenium
  8. WebDriverException: Message: invalid argument: can’t kill an exited process with GeckoDriver, Selenium and Python on RaspberryPi3
  9. Don’t wait for a page to load using Selenium in Python
  10. Find the reCAPTCHA element and click on it — Python + Selenium
  11. How to simulate HTML5 Drag and Drop in Selenium Webdriver?
  12. Download file through Google Chrome in headless mode
  13. Take screenshot of full page with Selenium Python with chromedriver
  14. Python webdriver to handle pop up browser windows which is not an alert
  15. How to fix Selenium WebDriverException: The browser appears to have exited before we could connect?
  16. SyntaxError: Failed to execute ‘evaluate’ on ‘Document’: The string ‘//img[contains(‘1236548597′)]’ is not a valid XPath expression
  17. Adding headers to requests module
  18. Selenium won’t open a new URL in a new tab (Python & Chrome)
  19. Set chrome browser binary through chromedriver in Python
  20. Python: Selenium with PhantomJS empty page source
  21. How to accept the popup presented when installing extension in Selenium?
  22. Fetch all href link using selenium in python
  23. Why switching to alert through selenium is not stable?
  24. NoSuchElementException: Message: Unable to locate element while trying to click on the button VISA through Selenium and Python
  25. How to fix python-selenium error “connection refused” when initializing a selenium webdriver?
  26. Webpage Is Detecting Selenium Webdriver with Chromedriver as a bot
  27. How to select multiple options from multi select list using Selenium-Python?
  28. How to send non-English unicode string using HTTP header?
  29. Can’t use chrome driver for Selenium
  30. Selenium / Python – Selecting via css selector

Leave a Comment