Downloading with chrome headless and selenium

by

Yes, it’s a “feature”, for security. As mentioned before here is the bug discussion: https://bugs.chromium.org/p/chromium/issues/detail?id=696481

Support was added in chrome version 62.0.3196.0 or above to enable downloading.

Here is a python implementation. I had to add the command to the chromedriver commands. I will try to submit a PR so it is included in the library in the future. 

def enable_download_in_headless_chrome(self, driver, download_dir):
    # add missing support for chrome "send_command"  to selenium webdriver
    driver.command_executor._commands["send_command"] = ("POST", '/session/$sessionId/chromium/send_command')

    params = {'cmd': 'Page.setDownloadBehavior', 'params': {'behavior': 'allow', 'downloadPath': download_dir}}
    command_result = driver.execute("send_command", params)

For reference here is a little repo to demonstrate how to use this:
https://github.com/shawnbutton/PythonHeadlessChrome

update 2020-05-01 There have been comments saying this is not working anymore. Given this patch is now over a year old it’s quite possible they have changed the underlying library.

More Related Contents:

  1. Running Selenium with Headless Chrome Webdriver
  2. How to set window size in Selenium Chrome Python
  3. Download file through Google Chrome in headless mode
  4. selenium.common.exceptions.WebDriverException: Message: ‘chromedriver’ executable needs to be in PATH error with Headless Chrome
  5. How to open a Chrome Profile through Python
  6. WebDriverException: Message: ‘chromedriver’ executable needs to be in PATH while setting UserAgent through Selenium Chromedriver python
  7. How to use Chrome Profile in Selenium Webdriver Python 3
  8. WebDriverException: unknown error: cannot find Chrome binary error with Selenium in Python for older versions of Google Chrome
  9. USB: usb_device_handle_win.cc:1020 Failed to read descriptor from node connection error with ChromeDriver v87 / Chrome v87 using Selenium on Windows10
  10. Change ChromeOptions in an existing webdriver
  11. Running Selenium WebDriver python bindings in chrome
  12. InvalidArgumentException: Message: invalid argument: user data directory is already in use error using –user-data-dir to start Chrome using Selenium
  13. Error Message: ‘chromedriver’ executable needs to be PATH
  14. selenium.common.exceptions.WebDriverException: Message: invalid session id using Selenium with ChromeDriver and Chrome through Python
  15. What is the fastest way to open urls in new tabs via Selenium – Python?
  16. Failed to read descriptor from node connection: A device attached to the system is not functioning error using ChromeDriver Selenium on Windows OS
  17. WebDriverException: Message: Service /usr/lib/chromium-browser/chromedriver unexpectedly exited on Raspberry-Pi with ChromeDriver and Selenium
  18. urllib3.exceptions.ProtocolError: (‘Connection aborted.’, error(10054, ‘An existing connection was forcibly closed by the remote host’))
  19. Selenium won’t open a new URL in a new tab (Python & Chrome)
  20. Set chrome browser binary through chromedriver in Python
  21. DeprecationWarning: use options instead of chrome_options error using ChromeDriver and Chrome through Selenium on Windows 10 system
  22. WebDriverException: Message: Service /content/chromedriver unexpectedly exited. Status code was: -6 with ChromeDriver Google Colab and Selenium
  23. TypeError: ‘module’ object is not callable error with driver=webdriver(“C:\\Python34\\Lib\\site-packages\\selenium\\webdriver\\chromedriver.exe”)
  24. Chrome crashes after several hours while multiprocessing using Selenium through Python
  25. How to accept the popup presented when installing extension in Selenium?
  26. How to solve ‘Getting Default Adapter failed’ error when launching Chrome and try to access a webpage using the ChromeDriver using Selenium
  27. Why switching to alert through selenium is not stable?
  28. Chrome browser initiated through ChromeDriver gets detected
  29. WebDriverException: Service U:/Scraping/chromedriver.exe unexpectedly exited. Status code was: 1 while working with Chrome and Python
  30. Selenium can’t open a second page

Leave a Comment