Begenner at spark Big data programming (spark code)

by

As mentioned by PinoSan this question is probably too generic, and you should be able to find your answer in any Spark Getting Started, or Tutorial.

Let me point you to some interesting content:

Disclaimer: I am working for MapR this is why I put online resources on Spark from MapR site

More Related Contents:

  1. How to open/stream .zip files through Spark?
  2. Spark on yarn concept understanding
  3. Pyspark: get list of files/directories on HDFS path
  4. java.lang.NoClassDefFoundError: org/apache/hadoop/fs/StorageStatistics
  5. How to access s3a:// files from Apache Spark?
  6. Is it better to have one large parquet file or lots of smaller parquet files?
  7. Apache Spark: The number of cores vs. the number of executors
  8. Apache Hadoop Yarn – Underutilization of cores
  9. Where are logs in Spark on YARN?
  10. Easiest way to install Python dependencies on Spark executor nodes?
  11. Spark iterate HDFS directory
  12. Cannot Read a file from HDFS using Spark
  13. How does Hadoop Namenode failover process works?
  14. How can PySpark be called in debug mode?
  15. Sqoop import : composite primary key and textual primary key
  16. When do reduce tasks start in Hadoop?
  17. Hadoop java.io.IOException: Mkdirs failed to create /some/path
  18. How to get ID of a map task in Spark?
  19. How can I access S3/S3n from a local Hadoop 2.6 installation?
  20. OOZIE: properties defined in file referenced in global job-xml not visible in workflow.xml
  21. How to get the input file name in the mapper in a Hadoop program?
  22. hadoop map reduce secondary sorting
  23. How can I force Spark to execute code?
  24. Parallel Algorithms for Generating Prime Numbers (possibly using Hadoop’s map reduce)
  25. Where does hadoop mapreduce framework send my System.out.print() statements ? (stdout)
  26. How does Hadoop perform input splits?
  27. Spark Scala list folders in directory
  28. Hadoop input split size vs block size
  29. Hadoop WordCount example stuck at map 100% reduce 0%
  30. Can Hive recursively descend into subdirectories without partitions or editing hive-site.xml?

Leave a Comment