java.io.IOException: Cannot run program “python” using Spark in Pycharm (Windows)

by

I had the same problem as you, and then I made the following changes:
set PYSPARK_PYTHON as environment variable to point to python.exe in Edit Configurations of Pycharm, here is my example:

PYSPARK_PYTHON = D:\Anaconda3\python.exe

SPARK_HOME = D:\spark-1.6.3-bin-hadoop2.6

PYTHONUNBUFFERED = 1

More Related Contents:

  1. How to link PyCharm with PySpark?
  2. Python worker failed to connect back
  3. How to configure Python Kivy for PyCharm on Windows?
  4. Interacting with program after execution
  5. pip install fails with “connection error: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:598)”
  6. Python – PIP install trouble shooting – PermissionError: [WinError 5] Access is denied
  7. Get screenshot on Windows with Python?
  8. PyWin32 and Python 3.8.0
  9. Python – Windows Shutdown Events
  10. Set up Python on Windows to not type “python” in cmd
  11. Count number of non-NaN entries in each column of Spark dataframe with Pyspark
  12. Fastest way to take a screenshot with python on windows
  13. collect_list by preserving order based on another variable
  14. Is Tensorflow compatible with a Windows workflow?
  15. How can I tell PyCharm what type a parameter is expected to be?
  16. Removing minimize/maximize buttons in Tkinter
  17. How do I run Python script using arguments in windows command line
  18. MSSQL2008 – Pyodbc – Previous SQL was not a query
  19. PyCharm doesn’t recognize installed module
  20. PyCharm and PYTHONPATH
  21. Process finished with exit code -1073741515 (0xC0000135)
  22. Changing the “locale preferred encoding” in Python 3 in Windows
  23. Kivy error (python 2.7) : sdl2 import error
  24. How to run Airflow on Windows
  25. How to print colour/color in python?
  26. How to pass a constant value to Python UDF?
  27. How to zip two array columns in Spark SQL
  28. How to make JSON flattening memory efficient?
  29. How to install pandas from pip on windows cmd?
  30. Batch equivalent of “source” on Windows: how to run a Python script from a virtualenv

Leave a Comment