How to create SparkSession with Hive support (fails with “Hive classes are not found”)?

by

Add following dependency to your maven project.

<dependency>
        <groupId>org.apache.spark</groupId>
        <artifactId>spark-hive_2.11</artifactId>
        <version>2.0.0</version>
</dependency>

More Related Contents:

  1. How to handle this scenario in spark? [closed]
  2. How to do aggregate functions, may columns and extract back
  3. How to flatten a struct in a Spark dataframe?
  4. Spark sql how to explode without losing null values
  5. Spark Strutured Streaming automatically converts timestamp to local time
  6. spark broadcast variable Map giving null value
  7. How to set timezone to UTC in Apache Spark?
  8. Change output filename prefix for DataFrame.write()
  9. How do I call a UDF on a Spark DataFrame using JAVA?
  10. Retain keys with null values while writing JSON in spark
  11. How to use Column.isin in Java?
  12. Why does SparkSession execute twice for one action?
  13. Add JAR files to a Spark job – spark-submit
  14. Spark: How to map Python with Scala or Java User Defined Functions?
  15. How to control partition size in Spark SQL
  16. Spark read file from S3 using sc.textFile (“s3n://…)
  17. Spark Error – Unsupported class file major version
  18. How can I update a broadcast variable in spark streaming?
  19. How to save DataFrame directly to Hive?
  20. Apache Spark – foreach Vs foreachPartition When to use What?
  21. Matrix Multiplication in Apache Spark [closed]
  22. Use collect_list and collect_set in Spark SQL
  23. How to convert .txt file to Hadoop’s sequence file format
  24. TaskSchedulerImpl: Initial job has not accepted any resources;
  25. java.lang.NoClassDefFoundError: org/apache/spark/Logging
  26. Is gzip format supported in Spark?
  27. How can I force Spark to execute code?
  28. How to save models from ML Pipeline to S3 or HDFS?
  29. Converting mysql table to spark dataset is very slow compared to same from csv file
  30. Running custom Java class in PySpark

Leave a Comment