Scala’s “for comprehension” with futures

by

First about for comprehension. It was answered on SO many many times, that it’s an abstraction over a couple of monadic operations: map, flatMap, withFilter. When you use <-, scalac desugars this lines into monadic flatMap:

r <- monad into monad.flatMap(r => ... )

it looks like an imperative computation (what a monad is all about), you bind a computation result to the r. And yield part is desugared into map call. Result type depends on the type of monad‘s.

Future trait has a flatMap and map functions, so we can use for comprehension with it. In your example can be desugared into the following code:

future1.flatMap(r1 => future2.flatMap(r2 => future3.map(r3 => r1 + r2 + r3) ) )

Parallelism aside

It goes without saying that if execution of future2 depends on r1 then you can’t escape sequential execution, but if the future computations are independent, you have two choices. You can enforce sequential execution, or allow for parallel execution. You can’t enforce the latter, as the execution context will handle this.

val res = for {
   r1 <- computationReturningFuture1(...)
   r2 <- computationReturningFuture2(...)
   r3 <- computationReturningFuture3(...)
} yield (r1+r2+r3)

will always run sequentially. It can be easily explained by the desugaring, after which the subsequent computationReturningFutureX calls are only invoked inside of the flatMaps, i.e.

computationReturningFuture1(...).flatMap(r1 => 
    computationReturningFuture2(...).flatMap(r2 => 
        computationReturningFuture3(...).map(r3 => r1 + r2 + r3) ) )

However this is able to run in parallel and the for comprehension aggregates the results:

val future1 = computationReturningFuture1(...)
val future2 = computationReturningFuture2(...)
val future3 = computationReturningFuture3(...)

val res = for {
   r1 <- future1
   r2 <- future2
   r3 <- future3
} yield (r1+r2+r3)

More Related Contents:

  1. Scala: List[Future] to Future[List] disregarding failed futures
  2. Accessing value returned by scala futures
  3. How do I make a function involving futures tail recursive?
  4. How to wait for several Futures?
  5. Scala recover or recoverWith
  6. Futures do not run before program termination
  7. Futures / Success race
  8. What is the difference between a var and val definition in Scala?
  9. What is the apply function in Scala?
  10. How do I apply the enrich-my-library pattern to Scala collections?
  11. How to cancel Future in Scala?
  12. How to import build.gradle into IntelliJ
  13. How to model type-safe enum types?
  14. Scala 2.8 collections design tutorial
  15. Change nullable property of column in spark dataframe
  16. What type to use to store an in-memory mutable data table in Scala?
  17. Usefulness (as in practical applications) of Currying v.s. Partial Application in Scala
  18. Perform a typed join in Scala with Spark Datasets
  19. Left Anti join in Spark?
  20. How to Define Custom partitioner for Spark RDDs of equally sized partition where each partition has equal number of elements?
  21. DataFrame-ified zipWithIndex
  22. How to access parameter list of case class in a dotty macro
  23. Get a TypeTag from a Type?
  24. Can’t access Parent’s Members while dealing with Macro Annotations
  25. Why is join not possible after show operator?
  26. What does a single apostrophe mean in Scala? [duplicate]
  27. Treating an SQL ResultSet like a Scala Stream
  28. Queries with streaming sources must be executed with writeStream.start();
  29. Singletons as Synthetic classes in Scala?
  30. Akka-Stream implementation slower than single threaded implementation

Leave a Comment