Using wget to recursively fetch a directory with arbitrary files in it

by

You have to pass the -np/--no-parent option to wget (in addition to -r/--recursive, of course), otherwise it will follow the link in the directory index on my site to the parent directory. So the command would look like this:

wget --recursive --no-parent http://example.com/configs/.vim/

To avoid downloading the auto-generated index.html files, use the -R/--reject option:

wget -r -np -R "index.html*" http://example.com/configs/.vim/

More Related Contents:

  1. How to mkdir only if a directory does not already exist?
  2. Check if a file exists with a wildcard in a shell script [duplicate]
  3. How to pass command line arguments to a shell alias? [duplicate]
  4. How do I kill background processes / jobs when my shell script exits?
  5. How can I check if a command exists in a shell script? [duplicate]
  6. sed whole word search and replace
  7. Test if remote TCP port is open from a shell script
  8. How to invoke bash, run commands inside the new shell, and then give control back to user?
  9. Meaning of $? (dollar question mark) in shell scripts
  10. What is /dev/null 2>&1?
  11. How/When does Execute Shell mark a build as failure in Jenkins?
  12. Using find to locate files that match one of multiple patterns
  13. How to download GitHub Release from private repo using command line
  14. How to input a path with a white space?
  15. Do a tail -F until matching a pattern
  16. How to get “wc -l” to print just the number of lines without file name?
  17. Compare a string using sh shell
  18. Automate scp file transfer using a shell script
  19. What does set -e and exec “$@” do for docker entrypoint scripts?
  20. Make xargs handle filenames that contain spaces
  21. How to assign the output of a command to a Makefile variable
  22. Curl to return http status code along with the response
  23. Block Comments in a Shell Script
  24. Emacs shell scripts – how to put initial options into the script?
  25. Input from within shell script
  26. Execute Shell Script after post build in Jenkins
  27. How do I determine if a web page exists with shell scripting?
  28. How to run commands via NodeJS child process?
  29. How to run SWI-Prolog from the command line?
  30. Exclude specific filename from shell globbing

Leave a Comment