Using wildcards in wget or curl query

by

You can’t use wildcards in wget but the -A flag should work. From the wget manpage:

You want to download all the gifs from a directory on an http server. You tried wget http://www.server.com/dir/*.gif, but that didn’t work because http retrieval does not support globbing. In that case, use:
wget -r -l1 --no-parent -A.gif http://www.server.com/dir/

Edit: found a related question

Regarding directories:

There’s a utility called LFTP, which has some support for globbing. Take a look at the manpage. There’s another question on Linux & Unix that covers its usage in a scenario similar to yours.

More Related Contents:

  1. wget/curl large file from google drive
  2. How do I measure request and response times at once using cURL?
  3. How to download a Google Drive url via curl or wget
  4. Batch script get html site and parse content (without wget, curl or other external app)
  5. curl: (60) SSL certificate problem: unable to get local issuer certificate
  6. How to send a header using a HTTP request through a cURL call?
  7. Downloading a large file using curl
  8. How can you debug a CORS request with cURL?
  9. How do I deal with certificates using cURL while trying to access an HTTPS url?
  10. How do you properly install libcurl for use in visual studio 2017?
  11. How can I download a single raw file from a private github repo using the command line?
  12. curl follow location error
  13. How to display request headers with command line curl
  14. Simulate a specific CURL in PostMan
  15. CURLOPT_FOLLOWLOCATION cannot be activated [duplicate]
  16. Why is curl truncating this query string?
  17. wget command to download a file and save as a different filename
  18. Set cURL to use local virtual hosts
  19. How to download HTTP directory with all files and sub-directories as they appear on the online files/folders list?
  20. Is there a way to follow redirects with command line cURL?
  21. Sending Push via Postman using Firebase Messaging
  22. How to set the authorization header using cURL
  23. curl -GET and -X GET
  24. How to download all files (but not HTML) from a website using wget?
  25. How to use curl to get a GET request exactly same as using Chrome?
  26. Passing a URL with brackets to curl
  27. Why is Google Calendar API (oauth2) responding with ‘Insufficient Permission’?
  28. How do I install cURL on cygwin?
  29. passing parameter to jenkins job through curl POST not working?
  30. Install curl with openssl

Leave a Comment