WebDriverException: Message: Service /content/chromedriver unexpectedly exited. Status code was: -6 with ChromeDriver Google Colab and Selenium

by

I have found the answer to the question about why I was getting an error. Please install the chromium-chromedriver and add it to your path variable as well as the bin directory.

This is the fully-fledged solution to the problem of how to scrape data using Selenium on Colab. There is one more method by using PhantomJS but this API has been deprecated by Selenium and hopefully they will remove it in the next Selenium update. 

# install chromium, its driver, and selenium
!apt-get update
!apt install chromium-chromedriver
!cp /usr/lib/chromium-browser/chromedriver /usr/bin
!pip install selenium
# set options to be headless, ..
from selenium import webdriver
options = webdriver.ChromeOptions()
options.add_argument('--headless')
options.add_argument('--no-sandbox')
options.add_argument('--disable-dev-shm-usage')
# open it, go to a website, and get results
wd = webdriver.Chrome('chromedriver',options=options)
wd.get("https://www.website.com")
print(wd.page_source)  # results

This would work for anyone who want to scrape their data on Google Colab and not on your local machine. Please execute the steps as shown sequentially in the same order.

You can find the notebook here https://colab.research.google.com/drive/1GFJKhpOju_WLAgiVPCzCGTBVGMkyAjtk .

More Related Contents:

  1. Selenium: WebDriverException:Chrome failed to start: crashed as google-chrome is no longer running so ChromeDriver is assuming that Chrome has crashed
  2. WebDriverException: Message: ‘chromedriver’ executable needs to be in PATH while setting UserAgent through Selenium Chromedriver python
  3. unknown error: session deleted because of page crash from unknown error: cannot determine loading status from tab crashed with ChromeDriver Selenium
  4. ‘Webdrivers’ executable may have wrong permissions. Please see https://sites.google.com/a/chromium.org/chromedriver/home
  5. WebDriverException: unknown error: cannot find Chrome binary error with Selenium in Python for older versions of Google Chrome
  6. Way to change Google Chrome user agent in Selenium?
  7. How to work with a specific version of ChromeDriver while Chrome Browser gets updated automatically through Python selenium
  8. WebDriverException: Message: Service chromedriver unexpectedly exited. Status code was: 127
  9. Error Message: ‘chromedriver’ executable needs to be PATH
  10. What is the fastest way to open urls in new tabs via Selenium – Python?
  11. Clicking on Get Data button for Monthly Settlement Statistics on nseindia.com doesn’t fetch results using Selenium and Python
  12. How to download XML files avoiding the popup This type of file may harm your computer through ChromeDriver and Chrome using Selenium in Python
  13. Using Extensions with Selenium (Python)
  14. Set chrome browser binary through chromedriver in Python
  15. TypeError: ‘module’ object is not callable error with driver=webdriver(“C:\\Python34\\Lib\\site-packages\\selenium\\webdriver\\chromedriver.exe”)
  16. SessionNotCreatedException: This version of ChromeDriver only supports Chrome version 84 using ChromeDriver and Chrome through Selenium and Python
  17. How to solve ‘Getting Default Adapter failed’ error when launching Chrome and try to access a webpage using the ChromeDriver using Selenium
  18. Why switching to alert through selenium is not stable?
  19. Chrome browser initiated through ChromeDriver gets detected
  20. How can we use Selenium Webdriver in colab.research.google.com?
  21. WebDriverException: Service U:/Scraping/chromedriver.exe unexpectedly exited. Status code was: 1 while working with Chrome and Python
  22. Selenium – Python – AttributeError: ‘WebDriver’ object has no attribute ‘find_element_by_name’
  23. Selenium can’t open a second page
  24. Selenium – wait until element is present, visible and interactable
  25. How to select a drop-down menu value with Selenium using Python?
  26. Selenium and iframe in html
  27. Download image with selenium python
  28. Selenium – MoveTargetOutOfBoundsException with Firefox
  29. Selenium testing without browser
  30. How to accept the popup presented when installing extension in Selenium?

Leave a Comment