How to run stored procedure on SQL server from Spark (Databricks) JDBC python?

by

Yes, it’s possible you just need to get access to the underlying Java classes of JDBC, something like this:

# the first line is the main entry point into JDBC world
driver_manager = spark._sc._gateway.jvm.java.sql.DriverManager
connection = driver_manager.getConnection(mssql_url, mssql_user, mssql_pass)
connection.prepareCall("EXEC sys.sp_tables").execute()
connection.close()

More Related Contents:

  1. Calling Java/Scala function from a task
  2. How to use JDBC source to write and read data in (Py)Spark?
  3. How to turn off INFO logging in Spark?
  4. Does spark predicate pushdown work with JDBC?
  5. How to use a Scala class inside Pyspark
  6. What is the equivalent to scala.util.Try in pyspark?
  7. How to find median and quantiles using Spark
  8. Transpose column to row with Spark
  9. Spark Dataframe distinguish columns with duplicated name
  10. How to change dataframe column names in pyspark?
  11. How to export a table dataframe in PySpark to csv?
  12. How can we JOIN two Spark SQL dataframes using a SQL-esque “LIKE” criterion?
  13. Spark RDD to DataFrame python
  14. Why is Apache-Spark – Python so slow locally as compared to pandas?
  15. Spark groupByKey alternative
  16. PySpark create new column with mapping from a dict
  17. Tuning parameters for implicit pyspark.ml ALS matrix factorization model through pyspark.ml CrossValidator
  18. Spark iteration time increasing exponentially when using join
  19. PySpark DataFrames – way to enumerate without converting to Pandas?
  20. Getting Spark, Python, and MongoDB to work together
  21. Using UDF ignores condition in when
  22. Create single row dataframe from list of list PySpark
  23. Total size of serialized results of 16 tasks (1048.5 MB) is bigger than spark.driver.maxResultSize (1024.0 MB)
  24. pyspark parse fixed width text file
  25. Concatenating string by rows in pyspark
  26. Multiple condition filter on dataframe
  27. How to return a “Tuple type” in a UDF in PySpark?
  28. How to connect HBase and Spark using Python?
  29. Pyspark 2.4.0, read avro from kafka with read stream – Python
  30. Apache Spark — Assign the result of UDF to multiple dataframe columns

Leave a Comment