How to get day of week in SparkSQL?

by

SPARK 1.5.0 has a date_format function that accepts a format as an argument. This format returns a name of a week day from a timestamp:

select date_format(my_timestamp, 'EEEE') from ....

Result: e.g. ‘Tuesday’

More Related Contents:

  1. Spark – repartition() vs coalesce()
  2. Find maximum row per group in Spark DataFrame
  3. How do I split an RDD into two or more RDDs?
  4. Integrating Spark Structured Streaming with the Confluent Schema Registry
  5. Partitioning in spark while reading from RDBMS via JDBC
  6. How to access element of a VectorUDT column in a Spark DataFrame?
  7. What is the difference between map and flatMap and a good use case for each?
  8. Python Spark Cumulative Sum by Group Using DataFrame
  9. Best Practice to launch Spark Applications via Web Application?
  10. Link Spark with iPython Notebook
  11. How to save/insert each DStream into a permanent table
  12. Default Partitioning Scheme in Spark
  13. How DAG works under the covers in RDD?
  14. Spark yarn cluster vs client – how to choose which one to use?
  15. Spark on YARN + Secured hbase
  16. Spark load data and add filename as dataframe column
  17. PySpark: how to resample frequencies
  18. Any performance issues forcing eager evaluation using count in spark?
  19. Explode array data into rows in spark [duplicate]
  20. Spark: how to get the number of written rows?
  21. Why are Spark Parquet files for an aggregate larger than the original?
  22. How to find count of Null and Nan values for each column in a PySpark dataframe efficiently?
  23. Apache spark dealing with case statements
  24. When are accumulators truly reliable?
  25. Serialize a custom transformer using python to be used within a Pyspark ML pipeline
  26. Not able to cat dbfs file in databricks community edition cluster. FileNotFoundError: [Errno 2] No such file or directory:
  27. How to optimize shuffle spill in Apache Spark application
  28. Spark + s3 – error – java.lang.ClassNotFoundException: Class org.apache.hadoop.fs.s3a.S3AFileSystem not found
  29. Spark: disk I/O on stage boundaries explanation
  30. spark.ml StringIndexer throws ‘Unseen label’ on fit()

Leave a Comment