Is flatMap guaranteed to be lazy? [duplicate]

by

Under the current implementation, flatmap is eager; like any other stateful intermediate operation (like sorted and distinct). And it’s very easy to prove :

 int result = Stream.of(1)
            .flatMap(x -> Stream.generate(() -> ThreadLocalRandom.current().nextInt()))
            .findFirst()
            .get();

    System.out.println(result);

This never finishes as flatMap is computed eagerly. For your example:

urls.stream()
    .flatMap(url -> fetchDataFromInternet(url).stream())
    .filter(...)
    .findFirst()
    .get();

It means that for each url, the flatMap will block all others operation that come after it, even if you care about a single one. So let’s suppose that from a single url your fetchDataFromInternet(url) generates 10_000 lines, well your findFirst will have to wait for all 10_000 to be computed, even if you care about only one.

EDIT

This is fixed in Java 10, where we get our laziness back: see JDK-8075939

EDIT 2

This is fixed in Java 8 too (8u222): JDK-8225328

More Related Contents:

  1. Java 8 Streams FlatMap method example
  2. How to convert to Java 8 map grouping by Map [closed]
  3. Java 8 List into Map
  4. Collection to stream to a new collection
  5. How to convert a Java 8 Stream to an Array?
  6. In Java, what are the advantages of streams over loops? [closed]
  7. How to sum a list of integers with java streams?
  8. Java 8 stream’s .min() and .max(): why does this compile?
  9. Why does Stream not implement Iterable?
  10. How can I create a stream from an array?
  11. In Java 8, is there a ByteStream class?
  12. Sum values from specific field of the objects in a list
  13. Why is this java Stream operated upon twice?
  14. Files.walk(), calculate total size
  15. Does Stream.forEach respect the encounter order of sequential streams?
  16. Most efficient way to get the last element of a stream
  17. Why does findFirst() throw a NullPointerException if the first element it finds is null?
  18. Sort map by value using lambdas and streams
  19. Java 8 Stream IllegalStateException: Stream has already been operated on or closed
  20. Equivalent of Scala dropWhile
  21. Why does Stream.allMatch() return true for an empty stream?
  22. Modifying Objects within stream in Java8 while iterating
  23. Take every nth element from a Java 8 stream
  24. How to sum values in a Map with a stream?
  25. Static context cannot access non-static in Collectors
  26. What Java 8 Stream.collect equivalents are available in the standard Kotlin library?
  27. Java 8, how can I implement a switch statement using streams?
  28. BigDecimal summary statistics
  29. Nested Java 8 parallel forEach loop perform poor. Is this behavior expected?
  30. Parallel flatMap always sequential

Leave a Comment