Composing Option with List in for-comprehension gives type mismatch depending on order

by

For comprehensions are converted into calls to the map or flatMap method. For example this one:

for(x <- List(1) ; y <- List(1,2,3)) yield (x,y)

becomes that:

List(1).flatMap(x => List(1,2,3).map(y => (x,y)))

Therefore, the first loop value (in this case, List(1)) will receive the flatMap method call. Since flatMap on a List returns another List, the result of the for comprehension will of course be a List. (This was new to me: For comprehensions don’t always result in streams, not even necessarily in Seqs.)

Now, take a look at how flatMap is declared in Option:

def flatMap [B] (f: (A) ⇒ Option[B]) : Option[B]

Keep this in mind. Let’s see how the erroneous for comprehension (the one with Some(1)) gets converted to a sequence of map calls:

Some(1).flatMap(x => List(1,2,3).map(y => (x, y)))

Now, it’s easy to see that the parameter of the flatMap call is something that returns a List, but not an Option, as required.

In order to fix the thing, you can do the following:

for(x <- Some(1).toSeq ; y <- List(1,2,3)) yield (x, y)

That compiles just fine. It is worth noting that Option is not a subtype of Seq, as is often assumed.

More Related Contents:

  1. Method parameters validation in Scala, with for comprehension and monads
  2. How do I break out of a loop in Scala?
  3. Confused with the for-comprehension to flatMap/Map transformation
  4. Getting the desugared part of a Scala for/comprehension expression?
  5. Cartesian product of two lists
  6. withFilter instead of filter
  7. Scala “
  8. Scala: convert string to Int or None
  9. What are Scala context and view bounds?
  10. Best way to merge two maps and sum the values of same key?
  11. (Why) do we need to call cache or persist on a RDD
  12. Return in Scala
  13. Where does the “flatmap that s***” idiomatic expression in Scala come from?
  14. What is the Scala annotation to ensure a tail recursive function is optimized?
  15. When should I choose Vector in Scala?
  16. Scala currying vs partially applied functions
  17. Mixing in a trait dynamically
  18. How to change setting inside SBT command?
  19. Function returns an empty List in Spark
  20. Scala: Implicit parameter resolution precedence
  21. Operate on neighbor elements in RDD in Spark
  22. Renaming column names of a DataFrame in Spark Scala
  23. Difference between fold and foldLeft or foldRight?
  24. Get TypeTag[A] from Class[A]
  25. In Scala, what exactly does ‘val a: A = _’ (underscore) mean?
  26. Spark: long delay between jobs
  27. Scala recover or recoverWith
  28. When is @uncheckedVariance needed in Scala, and why is it used in GenericTraversableTemplate?
  29. How to create DataFrame from Scala’s List of Iterables?
  30. Howto model named parameters in method invocations with Scala macros?

Leave a Comment