Running a limited number of child processes in parallel in bash? [duplicate]

by

I know I’m late to the party with this answer but I thought I would post an alternative that, IMHO, makes the body of the script cleaner and simpler. (Clearly you can change the values 2 & 5 to be appropriate for your scenario.)

function max2 {
   while [ `jobs | wc -l` -ge 2 ]
   do
      sleep 5
   done
}

find . -type f | while read name ; 
do 
   max2; some_heavy_processing_command ${name} &
done
wait

More Related Contents:

  1. How do you run multiple programs in parallel from a bash script?
  2. How to parallelize for-loop in bash limiting number of processes
  3. Is there a way to make bash job control quiet?
  4. Running programs in parallel using xargs
  5. Running several scripts in parallel bash script [duplicate]
  6. Parallel wget in Bash [duplicate]
  7. How to reload .bashrc settings without logging out and back in again?
  8. How do I iterate over a range of numbers defined by variables in Bash?
  9. How to loop through file names returned by find?
  10. How can I pipe stderr, and not stdout?
  11. When are square brackets required in a Bash if statement?
  12. What is the meaning of the ${0##…} syntax with variable, braces and hash character in bash?
  13. Using the RUN instruction in a Dockerfile with ‘source’ does not work
  14. Is there a TRY CATCH command in Bash
  15. Parsing variables from config file in Bash
  16. Why is “[[ 10 < 2 ]]" true when comparing numbers in bash? [duplicate]
  17. Bash variable substitution vs dirname and basename
  18. How does one output bold text in Bash?
  19. How to go to each directory and execute a command?
  20. Is the behavior behind the Shellshock vulnerability in Bash documented or at all intentional?
  21. Why bash alias doesn’t work in scripts? [duplicate]
  22. How to bold one output text in Bash?
  23. pipe stdout and stderr to two different processes in shell script?
  24. Copy all files with a certain extension from all subdirectories
  25. Add numbers to the beginning of every line in a file
  26. How to iterate over list which contains whitespaces in bash
  27. Get the name of the caller script in bash script
  28. How does testing if a string is ‘greater’ than another work in Bash?
  29. What is the shortest way to get n-th column of an output?
  30. Can bash script be written inside a AWS Lambda function

Leave a Comment