Copy a stream to avoid “stream has already been operated upon or closed”

by

I think your assumption about efficiency is kind of backwards. You get this huge efficiency payback if you’re only going to use the data once, because you don’t have to store it, and streams give you powerful “loop fusion” optimizations that let you flow the whole data efficiently through the pipeline.

If you want to re-use the same data, then by definition you either have to generate it twice (deterministically) or store it. If it already happens to be in a collection, great; then iterating it twice is cheap.

We did experiment in the design with “forked streams”. What we found was that supporting this had real costs; it burdened the common case (use once) at the expense of the uncommon case. The big problem was dealing with “what happens when the two pipelines don’t consume data at the same rate.” Now you’re back to buffering anyway. This was a feature that clearly didn’t carry its weight.

If you want to operate on the same data repeatedly, either store it, or structure your operations as Consumers and do the following:

stream()...stuff....forEach(e -> { consumerA(e); consumerB(e); });

You might also look into the RxJava library, as its processing model lends itself better to this kind of “stream forking”.

More Related Contents:

  1. Java 8 List into Map
  2. Why filter() after flatMap() is “not completely” lazy in Java streams?
  3. How can I throw CHECKED exceptions from inside Java 8 streams?
  4. How to force max to return ALL maximum values in a Java Stream?
  5. Java 8 lambdas, Function.identity() or t->t
  6. Java 8 Nested (Multi level) group by
  7. Using Java 8’s Optional with Stream::flatMap
  8. Java 8 Streams: multiple filters vs. complex condition
  9. Group by and sum objects like in SQL with Java lambdas?
  10. Retrieving a List from a java.util.stream.Stream in Java 8
  11. Filter Java Stream to 1 and only 1 element
  12. Java 8, Streams to find the duplicate elements
  13. Why doesn’t java.util.Collection implement the new Stream interface?
  14. Find maximum, minimum, sum and average of a list in Java 8
  15. Does Java SE 8 have Pairs or Tuples?
  16. How to use a Java8 lambda to sort a stream in reverse order?
  17. Java 8 Collectors.toMap SortedMap
  18. Why does Stream.allMatch() return true for an empty stream?
  19. Java 8 grouping using custom collector?
  20. How can I throw CHECKED exceptions from inside Java 8 lambdas/streams?
  21. How to apply multiple predicates to a java.util.Stream?
  22. Parallel stream from a HashSet doesn’t run in parallel
  23. Picking elements of a list until condition is met with Java 8 Lambdas
  24. Non-interference exact meaning in Java 8 streams
  25. In Java 8 how do I transform a Map to another Map using a lambda?
  26. Convert String array to Map using Java 8 Lambda expressions
  27. Group sequences of values
  28. Java 8 stream map to list of keys sorted by values
  29. How does combiner in Stream.collect method work in java 8?
  30. Visualization of Java Stream parallelization

Leave a Comment