Custom thread pool in Java 8 parallel stream

by

There actually is a trick how to execute a parallel operation in a specific fork-join pool. If you execute it as a task in a fork-join pool, it stays there and does not use the common one.

final int parallelism = 4;
ForkJoinPool forkJoinPool = null;
try {
    forkJoinPool = new ForkJoinPool(parallelism);
    final List<Integer> primes = forkJoinPool.submit(() ->
        // Parallel task here, for example
        IntStream.range(1, 1_000_000).parallel()
                .filter(PrimesPrint::isPrime)
                .boxed().collect(Collectors.toList())
    ).get();
    System.out.println(primes);
} catch (InterruptedException | ExecutionException e) {
    throw new RuntimeException(e);
} finally {
    if (forkJoinPool != null) {
        forkJoinPool.shutdown();
    }
}

The trick is based on ForkJoinTask.fork which specifies: “Arranges to asynchronously execute this task in the pool the current task is running in, if applicable, or using the ForkJoinPool.commonPool() if not inForkJoinPool()“

More Related Contents:

  1. Parallel streams, collectors and thread safety
  2. Nested Java 8 parallel forEach loop perform poor. Is this behavior expected?
  3. Should I always use a parallel stream when possible?
  4. Java 8’s streams: why parallel stream is slower?
  5. Is this a bug in Files.lines(), or am I misunderstanding something about parallel streams?
  6. Stream.skip behavior with unordered terminal operation
  7. Why parallel stream get collected sequentially in Java 8
  8. Why should I use concurrent characteristic in parallel stream with collect?
  9. Parallel stream from a HashSet doesn’t run in parallel
  10. Why is Files.list() parallel stream performing so much slower than using Collection.parallelStream()?
  11. Visualization of Java Stream parallelization
  12. Is there a concise way to iterate over a stream with indices in Java 8?
  13. How to ensure order of processing in java8 streams?
  14. What’s the difference between map() and flatMap() methods in Java 8?
  15. Ignore duplicates when producing map using streams
  16. Can you split a stream into two streams?
  17. Why does parallel stream with lambda in static initializer cause a deadlock?
  18. Adding up BigDecimals using Streams
  19. Java 8, Streams to find the duplicate elements
  20. Why is Files.lines (and similar Streams) not automatically closed?
  21. How to use a Java8 lambda to sort a stream in reverse order?
  22. In Stream reduce method, must the identity always be 0 for sum and 1 for multiplication?
  23. How to implement a Java stream?
  24. Why didn’t Stream have a toList() method?
  25. How to pause/resume all threads in an ExecutorService in Java?
  26. Using Java8 Stream to find the highest values from map
  27. ‘Optional.get()’ without ‘isPresent()’ check
  28. Most elegant way to join a Map to a String in Java 8
  29. Group sequences of values
  30. How to combine 3 or more CompletionStages?

Leave a Comment