Parallelize Bash script with maximum number of processes

by

Depending on what you want to do xargs also can help (here: converting documents with pdf2ps):

cpus=$( ls -d /sys/devices/system/cpu/cpu[[:digit:]]* | wc -w )

find . -name \*.pdf | xargs --max-args=1 --max-procs=$cpus  pdf2ps

From the docs:

--max-procs=max-procs
-P max-procs
       Run up to max-procs processes at a time; the default is 1.
       If max-procs is 0, xargs will run as many processes as  possible  at  a
       time.  Use the -n option with -P; otherwise chances are that only one
       exec will be done.

More Related Contents:

  1. Command not found error in Bash variable assignment
  2. Why does shell ignore quoting characters in arguments passed to it through variables? [duplicate]
  3. How can I use a file in a command and redirect output to the same file without truncating it?
  4. How to check if a variable is set in Bash
  5. Why does a space in a variable assignment give an error in Bash? [duplicate]
  6. Return value in a Bash function
  7. Shell equality operators (=, ==, -eq)
  8. What is a simple explanation for how pipes work in Bash?
  9. Indirect variable assignment in bash
  10. redirect COPY of stdout to log file from within bash script itself
  11. Shell script to delete directories older than n days
  12. Error when using ‘sed’ with ‘find’ command on OS X: “invalid command code .”
  13. How to check the exit status using an ‘if’ statement
  14. Best way to make a shell script daemon?
  15. What does -z mean in Bash? [duplicate]
  16. Longest line in a file
  17. How to properly handle a gzipped page when using curl?
  18. Parse Date in Bash
  19. Percent sign % not working in crontab
  20. Simple method to shuffle the elements of an array in BASH shell?
  21. Grepping a huge file (80GB) any way to speed it up?
  22. Launch Google Chrome from the command line with specific window coordinates
  23. What does “plus colon” (“+:”) mean in shell script expressions?
  24. How does AND and OR operators work in Bash?
  25. How to effectively abort the execution of a Bash script from a function
  26. How can I check if a package is installed and install it if not?
  27. Root user/sudo equivalent in Cygwin?
  28. How to tell if a string is not defined in a Bash shell script
  29. BASH: Writing a Script to Recursively Travel a Directory of N Levels
  30. How to grep for case insensitive string in a file?

Leave a Comment