Mac spark-shell Error initializing SparkContext

by

Following steps might help:

  1. Get your hostname by using “hostname” command.

  2. Make an entry in the /etc/hosts file for your hostname if not present as follows:

     127.0.0.1      your_hostname

More Related Contents:

  1. How to melt Spark DataFrame?
  2. How to stop INFO messages displaying on spark console?
  3. DataFrame join optimization – Broadcast Hash Join
  4. How does Spark partition(ing) work on files in HDFS?
  5. Overwrite specific partitions in spark dataframe write method
  6. Convert date from String to Date format in Dataframes
  7. How to check if spark dataframe is empty?
  8. What is the meaning of partitionColumn, lowerBound, upperBound, numPartitions parameters?
  9. Spark Transformation – Why is it lazy and what is the advantage?
  10. What is the difference between spark checkpoint and persist to a disk
  11. How to connect to remote hive server from spark [duplicate]
  12. Spark: Reading files using different delimiter than new line
  13. Spark MLlib LDA, how to infer the topics distribution of a new unseen document?
  14. Adding a group count column to a PySpark dataframe
  15. Why does format(“kafka”) fail with “Failed to find data source: kafka.” (even with uber-jar)?
  16. How to loop through each row of dataFrame in pyspark
  17. NoClassDefFoundError com.apache.hadoop.fs.FSDataInputStream when execute spark-shell
  18. How to group by common element in array?
  19. Spark: Best practice for retrieving big data from RDD to local machine
  20. Understanding Spark serialization
  21. Pyspark: Pass multiple columns in UDF
  22. How do I add an persistent column of row ids to Spark DataFrame?
  23. How does Spark aggregate function – aggregateByKey work?
  24. Convert null values to empty array in Spark DataFrame
  25. spark-shell error on Windows – can it be ignored if not using hadoop?
  26. How can I access python variable in Spark SQL?
  27. PySpark: How to fillna values in dataframe for specific columns?
  28. How to calculate Median in spark sqlContext for column of data type double
  29. PySpark error: AttributeError: ‘NoneType’ object has no attribute ‘_jvm’
  30. Understanding Spark’s caching

Leave a Comment